2024-09-10T06:09:32.500 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T06:09:32.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T06:09:32.599 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789 branch: wip-cls-rgw-busy-resharding description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7898789' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cls-rgw-busy-resharding sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4606 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-cls-rgw-busy-resharding suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMmrhYNzMWmNM3fb7ENr895bYEl++HtK6xXSqEXhLByVpEF2cRV9c4kmLD0Cv7BHG8ZmqJhmWv6ghMgRm1+zFA= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkO0VSzro/ks0e3rlpgnITQNQP4ITY6EjfksqZTSuuPm9ZMkhSpmG7MMtL05coJ9jdFppOdDGQR3hI3RIL4kJo= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:24:22 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T06:09:32.599 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa; will attempt to use it 2024-09-10T06:09:32.600 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa/tasks 2024-09-10T06:09:32.600 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T06:09:32.601 INFO:teuthology.task.internal:Checking packages... 2024-09-10T06:09:32.623 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-10T06:09:32.623 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T06:09:32.623 INFO:teuthology.packaging:ref: None 2024-09-10T06:09:32.623 INFO:teuthology.packaging:tag: None 2024-09-10T06:09:32.623 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-10T06:09:32.623 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:09:32.623 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-10T06:09:32.773 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:09:32.774 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T06:09:32.781 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T06:09:32.781 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T06:09:32.793 INFO:teuthology.task.internal:Saving configuration 2024-09-10T06:09:32.805 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T06:09:32.812 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T06:09:32.833 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 06:04:01.080610', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtqwfILU9MeijNETra4PMpuNEbAFoGzYekYEpt7uAgj'} 2024-09-10T06:09:32.853 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 06:04:01.079445', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB2MXWjyQOZkXeJtp4pE9Csa1A1jc9w6XBFeiZJpTv4/'} 2024-09-10T06:09:32.853 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T06:09:32.861 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-10T06:09:32.861 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-10T06:09:32.861 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T06:09:32.907 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a97377be0>, signals=[15]) 2024-09-10T06:09:32.907 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T06:09:32.914 INFO:teuthology.task.internal:Opening connections... 2024-09-10T06:09:32.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T06:09:32.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:09:32.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:09:32.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:09:33.076 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T06:09:33.084 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-10T06:09:33.089 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-10T06:09:33.089 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-09-10T06:09:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-09-10T06:09:33.138 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T06:09:33.138 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T06:09:33.138 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T06:09:33.138 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T06:09:33.138 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-09-10T06:09:33.138 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-10T06:09:33.165 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-10T06:09:33.170 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-10T06:09:33.170 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T06:09:33.217 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T06:09:33.218 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T06:09:33.218 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T06:09:33.218 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2024-09-10T06:09:33.218 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-10T06:09:33.241 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T06:09:33.249 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T06:09:33.256 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T06:09:33.257 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-10T06:09:33.259 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-10T06:09:33.264 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T06:09:33.270 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T06:09:33.270 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-10T06:09:33.307 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-10T06:09:33.378 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T06:09:33.436 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T06:09:33.452 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T06:09:33.452 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T06:09:33.453 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T06:09:33.453 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T06:09:33.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:09:33.458 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-10T06:09:33.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:09:33.459 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-10T06:09:33.506 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-56-generic 2024-09-10T06:09:33.506 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.15.0-56-generic 2024-09-10T06:09:33.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-09-10T06:09:33.508 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-56-generic 2024-09-10T06:09:33.508 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.15.0-56-generic 2024-09-10T06:09:33.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2024-09-10T06:09:33.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-09-10T06:09:33.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2024-09-10T06:09:33.755 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T06:09:33.780 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:09:33.811 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T06:09:33.878 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T06:09:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:09:33.898 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T06:09:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T06:09:33.973 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T06:09:34.006 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T06:09:34.068 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T06:09:34.073 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T06:09:34.075 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T06:09:34.076 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T06:09:34.076 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T06:09:34.096 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T06:09:34.097 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T06:09:34.099 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T06:09:34.099 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T06:09:34.102 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T06:09:34.106 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T06:09:34.106 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T06:09:34.107 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T06:09:34.107 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T06:09:34.111 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T06:09:34.112 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T06:09:34.113 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T06:09:34.117 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T06:09:34.117 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T06:09:34.129 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T06:09:34.133 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T06:09:34.133 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T06:09:34.139 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T06:09:34.148 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T06:09:34.151 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T06:09:34.151 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T06:09:34.151 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T06:09:34.156 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T06:09:34.176 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T06:09:34.176 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T06:09:34.177 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T06:09:34.177 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T06:09:34.178 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T06:09:34.178 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T06:09:34.178 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T06:09:34.179 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T06:09:34.193 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T06:09:34.193 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T06:09:34.329 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T06:09:34.340 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T06:09:34.468 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T06:09:34.758 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T06:09:34.775 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T06:09:34.784 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T06:09:34.784 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T06:09:34.784 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T06:09:34.819 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T06:09:34.834 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T06:09:34.835 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T06:09:34.880 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T06:09:34.881 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T06:09:34.892 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T06:09:34.892 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T06:09:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T06:09:34.904 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T06:09:34.916 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T06:09:34.919 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T06:09:34.920 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T06:09:34.937 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T06:09:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T06:09:34.942 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T06:09:34.942 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T06:09:34.954 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T06:09:34.973 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T06:09:34.978 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T06:09:34.978 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T06:09:34.980 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T06:09:35.021 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T06:09:35.022 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T06:09:35.029 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T06:09:35.030 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T06:09:35.030 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T06:09:35.032 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T06:09:35.062 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T06:09:35.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T06:09:35.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T06:09:35.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T06:09:35.064 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T06:09:35.111 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T06:09:40.276 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 15.8 MB in 2s (7,515 kB/s) 2024-09-10T06:09:40.381 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 15.8 MB in 2s (7,472 kB/s) 2024-09-10T06:09:41.675 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:09:41.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:09:41.752 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:09:41.778 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:09:41.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:09:41.856 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:09:41.959 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-09-10T06:09:41.959 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-09-10T06:09:42.043 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-09-10T06:09:42.044 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-09-10T06:09:42.134 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:09:42.134 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:09:42.134 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:09:42.135 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:09:42.135 INFO:teuthology.orchestra.run.smithi084.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T06:09:42.135 INFO:teuthology.orchestra.run.smithi084.stdout: python2.7-minimal 2024-09-10T06:09:42.135 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:09:42.136 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-09-10T06:09:42.136 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:09:42.136 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T06:09:42.136 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T06:09:42.138 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-09-10T06:09:42.138 INFO:teuthology.orchestra.run.smithi084.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T06:09:42.138 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2024-09-10T06:09:42.138 INFO:teuthology.orchestra.run.smithi084.stdout: thermald 2024-09-10T06:09:42.188 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-09-10T06:09:42.188 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:09:42.188 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T06:09:42.189 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T06:09:42.190 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2024-09-10T06:09:42.190 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T06:09:42.211 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:09:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:09:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:09:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:09:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T06:09:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: python2.7-minimal 2024-09-10T06:09:42.212 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:09:42.213 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-09-10T06:09:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:09:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T06:09:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T06:09:42.215 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-09-10T06:09:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T06:09:42.215 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-09-10T06:09:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2024-09-10T06:09:42.241 INFO:teuthology.orchestra.run.smithi084.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:09:42.241 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 113 MB of archives. 2024-09-10T06:09:42.241 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T06:09:42.241 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T06:09:42.259 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-09-10T06:09:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:09:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T06:09:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T06:09:42.260 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-09-10T06:09:42.261 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T06:09:42.311 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:09:42.311 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 113 MB of archives. 2024-09-10T06:09:42.311 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T06:09:42.311 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T06:09:42.695 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T06:09:42.743 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T06:09:42.793 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T06:09:42.841 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T06:09:43.602 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T06:09:43.602 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T06:09:43.602 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T06:09:43.652 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T06:09:43.652 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T06:09:43.652 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T06:09:43.723 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T06:09:43.744 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T06:09:43.774 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T06:09:43.795 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T06:09:44.174 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 113 MB in 2s (74.2 MB/s) 2024-09-10T06:09:44.206 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 113 MB in 2s (70.3 MB/s) 2024-09-10T06:09:44.339 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T06:09:44.380 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T06:09:46.404 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T06:09:46.408 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:46.434 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T06:09:46.438 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:46.567 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:46.644 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:48.661 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T06:09:48.682 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:48.765 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:48.845 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T06:09:48.866 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:48.956 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:49.222 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T06:09:49.242 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:49.280 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:49.389 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T06:09:49.410 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:09:49.448 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:09:55.755 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:09:55.842 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:09:55.882 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:09:55.970 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:09:56.248 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:09:56.303 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:09:56.352 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:09:56.415 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:09:56.638 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T06:09:56.661 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T06:09:56.696 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:09:56.701 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T06:09:56.723 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T06:09:56.768 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:10:02.178 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T06:10:02.216 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:10:02.252 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:02.885 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T06:10:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:10:02.959 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:05.206 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:10:05.329 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:10:05.654 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:10:05.655 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:10:05.775 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:05.778 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:10:05.901 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T06:10:06.030 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:06.113 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:10:06.233 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:06.367 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T06:10:06.496 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:07.346 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:07.347 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:07.347 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:07.347 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:07.526 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:07.764 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:07.764 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:07.765 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:07.765 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:07.905 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:08.932 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:09.957 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:10.492 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T06:10:10.593 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T06:10:10.719 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:10.783 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T06:10:10.783 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:11.518 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T06:10:11.643 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T06:10:11.753 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:10:11.812 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T06:10:11.812 INFO:teuthology.orchestra.run.smithi084.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:25.440 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T06:10:25.440 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2024-09-10T06:10:25.447 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:10:25.469 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2024-09-10T06:10:25.760 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:25.774 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:26.089 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:26.094 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:26.164 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:10:26.169 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:10:26.342 INFO:teuthology.orchestra.run.smithi117.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:10:26.342 INFO:teuthology.orchestra.run.smithi117.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:10:26.342 INFO:teuthology.orchestra.run.smithi117.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:10:26.390 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-09-10T06:10:26.423 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T06:10:26.423 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub' 2024-09-10T06:10:26.435 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:10:26.454 INFO:teuthology.orchestra.run.smithi084.stdout:Generating grub configuration file ... 2024-09-10T06:10:26.733 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:26.749 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:26.868 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-09-10T06:10:26.886 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-09-10T06:10:26.886 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.119.119 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:10:26.887 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-09-10T06:10:26.888 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-09-10T06:10:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:10:26.888 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-09-10T06:10:26.888 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T06:10:26.888 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T06:10:26.888 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T06:10:26.888 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-10T06:10:26.888 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T06:10:26.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-09-10T06:10:27.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-09-10T06:10:27.062 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:27.068 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:27.146 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:10:27.151 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:10:27.299 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:10:27.299 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:10:27.327 INFO:teuthology.orchestra.run.smithi084.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:10:27.327 INFO:teuthology.orchestra.run.smithi084.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:10:27.327 INFO:teuthology.orchestra.run.smithi084.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:10:27.358 INFO:teuthology.orchestra.run.smithi084.stdout:done 2024-09-10T06:10:27.362 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:10:27.444 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:10:27.834 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2024-09-10T06:10:27.859 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 21 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.119.119 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2024-09-10T06:10:27.860 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:10:27.861 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2024-09-10T06:10:27.861 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T06:10:27.862 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T06:10:27.862 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T06:10:27.862 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T06:10:27.862 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T06:10:27.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2024-09-10T06:10:28.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2024-09-10T06:10:28.154 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:10:28.274 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:10:28.356 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:10:28.437 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:10:28.741 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:10:28.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:10:28.822 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:10:29.031 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-09-10T06:10:29.031 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:10:29.210 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:10:29.211 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:10:29.211 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:10:29.250 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:10:29.252 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-09-10T06:10:29.268 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.119.119 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:10:29.269 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-09-10T06:10:29.269 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-10T06:10:29.316 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.4QNyIpoUFR 2024-09-10T06:10:29.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4QNyIpoUFR 2024-09-10T06:10:29.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.4QNyIpoUFR 2024-09-10T06:10:29.496 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.4QNyIpoUFR is 10KB 2024-09-10T06:10:29.509 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.4QNyIpoUFR 2024-09-10T06:10:29.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T06:10:29.567 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:10:29.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T06:10:29.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T06:10:29.625 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:10:29.631 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T06:10:29.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2024-09-10T06:10:29.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:10:29.705 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:10:29.914 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-09-10T06:10:29.914 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-09-10T06:10:30.099 INFO:teuthology.orchestra.run.smithi084.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T06:10:30.100 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:10:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:10:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:10:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:10:30.100 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:10:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:10:30.101 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:10:30.140 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:10:30.142 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2024-09-10T06:10:30.157 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 21 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.119.119 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:10:30.158 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2024-09-10T06:10:30.159 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-10T06:10:30.205 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.DCanu4b9dY 2024-09-10T06:10:30.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DCanu4b9dY 2024-09-10T06:10:30.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.DCanu4b9dY 2024-09-10T06:10:30.384 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.DCanu4b9dY is 10KB 2024-09-10T06:10:30.396 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.DCanu4b9dY 2024-09-10T06:10:30.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T06:10:30.456 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:10:30.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T06:10:30.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T06:10:30.523 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T06:10:30.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo update-grub 2024-09-10T06:10:30.899 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-09-10T06:10:30.900 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:10:30.903 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-10T06:10:31.086 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:31.091 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:31.334 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:31.340 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:31.376 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:10:31.380 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:10:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:10:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:10:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:10:31.530 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-10T06:10:31.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-10T06:10:31.702 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2024-09-10T06:10:31.703 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:10:31.705 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-09-10T06:10:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:10:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:10:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:10:32.136 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:10:32.180 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:10:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:10:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:10:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:10:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:10:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-09-10T06:10:32.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-09-10T06:11:01.569 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-10T06:11:01.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:11:01.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:11:02.375 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T06:11:02.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:11:02.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:11:20.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-10T06:11:29.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:11:29.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:11:32.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-10T06:11:36.125 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-10T06:11:44.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:11:44.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:11:45.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:11:45.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:12:03.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-10T06:12:03.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-10T06:12:15.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:12:15.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:12:16.128 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-10T06:12:16.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:12:16.852 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-10T06:12:16.852 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-10T06:12:16.898 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-119-generic 2024-09-10T06:12:16.899 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T06:12:16.899 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T06:12:16.899 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T06:12:17.899 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-10T06:12:17.900 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T06:12:18.045 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-10T06:12:18.076 DEBUG:teuthology.parallel:result is None 2024-09-10T06:12:18.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:12:18.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:12:18.509 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-10T06:12:19.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:12:19.117 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T06:12:19.117 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-10T06:12:19.163 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-119-generic 2024-09-10T06:12:19.163 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T06:12:19.163 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T06:12:19.163 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T06:12:20.164 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T06:12:20.165 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T06:12:20.517 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-09-10T06:12:20.549 DEBUG:teuthology.parallel:result is None 2024-09-10T06:12:20.550 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T06:12:20.557 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T06:12:20.557 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T06:12:20.560 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T06:12:20.566 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T06:12:20.573 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T06:12:20.582 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T06:12:20.583 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T06:12:20.608 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T06:12:20.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T06:12:20.646 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T06:12:20.647 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T06:12:20.673 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T06:12:20.694 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:12:20.701 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:12:20.702 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:12:20.711 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:12:20.713 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T06:12:20.719 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T06:12:20.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T06:12:20.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T06:12:20.765 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T06:12:20.774 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T06:12:20.774 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T06:12:20.813 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T06:12:20.818 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T06:12:20.868 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T06:12:20.915 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:12:20.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T06:12:21.011 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T06:12:21.017 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T06:12:21.067 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:12:21.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T06:12:21.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-10T06:12:21.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-10T06:12:21.213 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T06:12:21.221 INFO:teuthology.task.internal:Starting timer... 2024-09-10T06:12:21.221 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T06:12:21.237 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T06:12:21.245 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2024-09-10T06:12:21.245 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2024-09-10T06:12:21.246 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T06:12:21.246 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T06:12:21.246 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T06:12:21.246 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T06:12:21.254 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T06:12:21.266 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T06:12:21.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T06:19:48.017 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-10T06:19:48.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:19:48.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:19:48.100 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-10T06:19:48.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T06:19:48.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:19:48.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:19:48.261 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-10T06:19:48.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-10T06:19:48.341 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T06:19:48.357 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T06:19:48.358 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T06:19:48.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:19:48.361 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T06:19:48.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:19:48.385 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Command line: ntpd -gq 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: ---------------------------------------------------- 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: corporation. Support and training for ntp-4 are 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: available at https://www.nwtime.org/support 2024-09-10T06:19:48.386 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: ---------------------------------------------------- 2024-09-10T06:19:48.387 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: proto: precision = 0.043 usec (-24) 2024-09-10T06:19:48.387 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: basedate set to 2022-02-04 2024-09-10T06:19:48.387 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: gps base set to 2022-02-06 (week 2196) 2024-09-10T06:19:48.388 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:19:48.388 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:19:48.388 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:19:48.388 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:19:48.389 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T06:19:48.389 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T06:19:48.389 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T06:19:48.390 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2024-09-10T06:19:48.390 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen normally on 4 lo [::1]:123 2024-09-10T06:19:48.390 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2024-09-10T06:19:48.390 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:48 ntpd[18435]: Listening on routing socket on fd #22 for interface updates 2024-09-10T06:19:48.409 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T06:19:48.409 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Command line: ntpd -gq 2024-09-10T06:19:48.409 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: ---------------------------------------------------- 2024-09-10T06:19:48.409 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: corporation. Support and training for ntp-4 are 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: available at https://www.nwtime.org/support 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: ---------------------------------------------------- 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: proto: precision = 0.045 usec (-24) 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: basedate set to 2022-02-04 2024-09-10T06:19:48.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: gps base set to 2022-02-06 (week 2196) 2024-09-10T06:19:48.411 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:19:48.411 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:19:48.411 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:19:48.411 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:19:48.412 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T06:19:48.412 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T06:19:48.413 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T06:19:48.413 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2024-09-10T06:19:48.413 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen normally on 4 lo [::1]:123 2024-09-10T06:19:48.413 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2024-09-10T06:19:48.413 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:48 ntpd[18449]: Listening on routing socket on fd #22 for interface updates 2024-09-10T06:19:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:50 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:50.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:50 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:52.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:52 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:52.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:52 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:53.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:53 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:53 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:54.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:54.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:54.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:54 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:54 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:55.386 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:55.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:55 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:55.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:55.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:55.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:55.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:55.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:55 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:56.387 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 06:19:56 ntpd[18435]: ntpd: time slew -0.000693 s 2024-09-10T06:19:56.388 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time slew -0.000693s 2024-09-10T06:19:56.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T06:19:56.388 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 06:19:56 ntpd[18435]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stdout:10 Sep 06:19:56 ntpd[18449]: ntpd: time slew -0.001077 s 2024-09-10T06:19:56.410 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew -0.001077s 2024-09-10T06:19:56.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T06:19:56.411 INFO:teuthology.orchestra.run.smithi117.stderr:10 Sep 06:19:56 ntpd[18449]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T06:19:56.444 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:19:56.444 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-09-10T06:19:56.444 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.444 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.445 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.445 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.456 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:19:56.457 INFO:teuthology.run_tasks:Running task install... 2024-09-10T06:19:56.467 DEBUG:teuthology.task.install:project ceph 2024-09-10T06:19:56.467 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-10T06:19:56.468 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-10T06:19:56.468 INFO:teuthology.task.install:Using flavor: default 2024-09-10T06:19:56.472 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T06:19:56.473 INFO:teuthology.task.install:extra packages: [] 2024-09-10T06:19:56.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2024-09-10T06:19:56.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2024-09-10T06:19:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T06:19:56.551 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T06:19:56.574 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T06:19:56.574 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T06:19:56.575 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T06:19:56.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:19:56.580 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T06:19:56.580 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T06:19:56.580 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T06:19:56.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:19:56.714 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T06:19:56.715 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:19:56.723 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T06:19:56.723 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:19:57.048 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:19:57.048 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T06:19:57.060 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:19:57.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T06:19:57.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2024-09-10T06:19:57.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-09-10T06:19:57.228 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:19:57.235 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:19:57.238 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:19:57.247 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:19:57.255 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:19:57.263 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:19:57.350 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:19:57.358 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:19:57.464 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T06:19:57.465 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T06:19:57.521 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T06:19:57.521 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T06:19:57.578 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T06:19:57.581 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T06:19:57.634 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T06:19:57.639 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T06:19:57.702 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T06:19:57.705 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T06:19:57.787 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 29.2 kB in 1s (54.8 kB/s) 2024-09-10T06:19:57.798 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 29.2 kB in 1s (55.3 kB/s) 2024-09-10T06:19:58.822 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:19:58.826 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:19:58.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T06:19:58.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T06:19:58.897 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2024-09-10T06:19:58.901 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-09-10T06:19:59.081 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2024-09-10T06:19:59.081 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2024-09-10T06:19:59.109 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-09-10T06:19:59.110 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-09-10T06:19:59.263 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:19:59.263 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:19:59.263 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:19:59.263 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:19:59.264 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:19:59.264 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:19:59.264 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:19:59.265 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2024-09-10T06:19:59.265 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T06:19:59.265 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T06:19:59.265 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T06:19:59.265 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:19:59.266 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T06:19:59.267 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet zip 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2024-09-10T06:19:59.268 INFO:teuthology.orchestra.run.smithi084.stdout: btrfs-tools 2024-09-10T06:19:59.301 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:19:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:19:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:19:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:19:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:19:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:19:59.302 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:19:59.303 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-09-10T06:19:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T06:19:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T06:19:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T06:19:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T06:19:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T06:19:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T06:19:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet zip 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T06:19:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T06:19:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T06:19:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T06:19:59.307 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-09-10T06:19:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2024-09-10T06:19:59.371 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2024-09-10T06:19:59.371 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T06:19:59.371 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T06:19:59.371 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T06:19:59.372 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T06:19:59.372 INFO:teuthology.orchestra.run.smithi084.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T06:19:59.372 INFO:teuthology.orchestra.run.smithi084.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T06:19:59.373 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T06:19:59.374 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T06:19:59.374 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T06:19:59.374 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T06:19:59.374 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T06:19:59.374 INFO:teuthology.orchestra.run.smithi084.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T06:19:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T06:19:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T06:19:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T06:19:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T06:19:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T06:19:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T06:19:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T06:19:59.562 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T06:19:59.563 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 251 MB of archives. 2024-09-10T06:19:59.563 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T06:19:59.563 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T06:19:59.586 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T06:19:59.599 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T06:19:59.599 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 251 MB of archives. 2024-09-10T06:19:59.599 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T06:19:59.599 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T06:19:59.618 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T06:19:59.889 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T06:19:59.973 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T06:19:59.982 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T06:19:59.982 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T06:19:59.994 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T06:20:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T06:20:00.007 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T06:20:00.008 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T06:20:00.014 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T06:20:00.017 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T06:20:00.019 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T06:20:00.024 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T06:20:00.031 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T06:20:00.075 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T06:20:00.113 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T06:20:00.203 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T06:20:00.265 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T06:20:00.303 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T06:20:00.315 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T06:20:00.322 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T06:20:00.323 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T06:20:00.328 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T06:20:00.329 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T06:20:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T06:20:00.344 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T06:20:00.353 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T06:20:00.353 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T06:20:00.354 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T06:20:00.355 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T06:20:00.373 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T06:20:00.378 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T06:20:00.382 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T06:20:00.382 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T06:20:00.383 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T06:20:00.385 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T06:20:00.391 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T06:20:00.392 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T06:20:00.393 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T06:20:00.411 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T06:20:00.414 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T06:20:00.416 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T06:20:00.417 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T06:20:00.423 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T06:20:00.425 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T06:20:00.433 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T06:20:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T06:20:00.470 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T06:20:00.475 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T06:20:00.478 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T06:20:00.479 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T06:20:00.480 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T06:20:00.482 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T06:20:00.482 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T06:20:00.483 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T06:20:00.505 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T06:20:00.509 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T06:20:00.513 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T06:20:00.517 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T06:20:00.518 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T06:20:00.519 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T06:20:00.521 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T06:20:00.549 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T06:20:00.566 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T06:20:00.566 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T06:20:00.567 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T06:20:00.573 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T06:20:00.574 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T06:20:00.575 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T06:20:00.575 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T06:20:00.587 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T06:20:00.587 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T06:20:00.588 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T06:20:00.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T06:20:00.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T06:20:00.668 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T06:20:00.706 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T06:20:00.707 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T06:20:00.711 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T06:20:00.712 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T06:20:00.713 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T06:20:00.714 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T06:20:00.714 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T06:20:00.715 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T06:20:00.716 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T06:20:00.717 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T06:20:00.728 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T06:20:00.728 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T06:20:00.729 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T06:20:00.749 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T06:20:00.750 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T06:20:00.751 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T06:20:00.751 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T06:20:00.772 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T06:20:00.786 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T06:20:00.793 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T06:20:00.796 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T06:20:00.799 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T06:20:00.831 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T06:20:00.833 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T06:20:00.834 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T06:20:00.845 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T06:20:00.845 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T06:20:00.846 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T06:20:00.848 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T06:20:00.875 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T06:20:00.877 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T06:20:00.879 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T06:20:00.884 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T06:20:00.885 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T06:20:00.887 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T06:20:00.893 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T06:20:00.913 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T06:20:00.916 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T06:20:00.918 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T06:20:00.999 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T06:20:01.001 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T06:20:01.005 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T06:20:01.006 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T06:20:01.008 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T06:20:01.013 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T06:20:01.057 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T06:20:01.059 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T06:20:01.062 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T06:20:01.063 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T06:20:01.065 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T06:20:01.126 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T06:20:01.129 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T06:20:01.129 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T06:20:01.174 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T06:20:01.176 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T06:20:01.178 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T06:20:01.178 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T06:20:01.180 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T06:20:01.212 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T06:20:01.213 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T06:20:01.215 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T06:20:01.224 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T06:20:01.249 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T06:20:01.249 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T06:20:01.277 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T06:20:01.277 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T06:20:01.285 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T06:20:01.286 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T06:20:01.286 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T06:20:01.287 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T06:20:01.288 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T06:20:01.289 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T06:20:01.297 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T06:20:01.306 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T06:20:01.310 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T06:20:01.311 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T06:20:01.341 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T06:20:01.342 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T06:20:01.343 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T06:20:01.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T06:20:01.345 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T06:20:01.346 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T06:20:01.352 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T06:20:01.367 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T06:20:01.372 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T06:20:01.377 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T06:20:01.387 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T06:20:01.394 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T06:20:01.397 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T06:20:01.399 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T06:20:01.409 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T06:20:01.411 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T06:20:01.418 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T06:20:01.420 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T06:20:01.423 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T06:20:01.427 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T06:20:01.428 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T06:20:01.469 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T06:20:01.471 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T06:20:01.472 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T06:20:01.505 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T06:20:01.512 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T06:20:01.514 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T06:20:01.515 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T06:20:01.526 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T06:20:01.527 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T06:20:01.535 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T06:20:01.550 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T06:20:01.553 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T06:20:01.572 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T06:20:01.573 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T06:20:01.574 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T06:20:01.580 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T06:20:01.581 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T06:20:01.586 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T06:20:01.588 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T06:20:01.589 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T06:20:01.616 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T06:20:01.668 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T06:20:01.670 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T06:20:01.687 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T06:20:01.687 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T06:20:01.688 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T06:20:01.693 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T06:20:01.695 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T06:20:01.982 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T06:20:02.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T06:20:02.100 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T06:20:02.126 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T06:20:02.191 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T06:20:02.309 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T06:20:02.310 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T06:20:02.327 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T06:20:02.369 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T06:20:02.379 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T06:20:02.381 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T06:20:02.389 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T06:20:03.436 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T06:20:03.437 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T06:20:03.454 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T06:20:03.495 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T06:20:03.511 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T06:20:03.533 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T06:20:04.371 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T06:20:04.544 INFO:teuthology.orchestra.run.smithi084.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T06:20:04.552 INFO:teuthology.orchestra.run.smithi084.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T06:20:05.884 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T06:20:06.093 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T06:20:06.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T06:20:06.322 INFO:teuthology.orchestra.run.smithi084.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T06:20:06.324 INFO:teuthology.orchestra.run.smithi084.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T06:20:06.326 INFO:teuthology.orchestra.run.smithi084.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T06:20:06.820 INFO:teuthology.orchestra.run.smithi084.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T06:20:07.389 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 251 MB in 7s (33.7 MB/s) 2024-09-10T06:20:07.469 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T06:20:07.472 INFO:teuthology.orchestra.run.smithi117.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T06:20:07.473 INFO:teuthology.orchestra.run.smithi117.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T06:20:07.519 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T06:20:07.617 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T06:20:07.622 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T06:20:07.750 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:20:07.782 INFO:teuthology.orchestra.run.smithi117.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T06:20:08.079 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T06:20:08.105 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T06:20:08.145 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:20:08.363 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 251 MB in 8s (30.0 MB/s) 2024-09-10T06:20:08.482 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T06:20:08.494 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T06:20:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T06:20:08.549 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:20:08.592 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T06:20:08.597 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T06:20:08.693 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:20:08.919 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T06:20:08.945 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:08.996 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T06:20:09.018 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:09.022 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T06:20:09.062 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:20:09.332 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T06:20:09.355 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T06:20:09.399 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:20:09.405 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T06:20:09.431 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:09.471 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:09.816 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T06:20:09.842 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:09.844 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T06:20:09.870 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:09.882 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:09.918 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:10.202 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T06:20:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T06:20:10.252 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:20:10.297 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T06:20:10.323 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:10.363 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:10.572 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librados2. 2024-09-10T06:20:10.598 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:10.638 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:10.641 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T06:20:10.667 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:20:10.708 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:20:11.069 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T06:20:11.082 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librbd1. 2024-09-10T06:20:11.095 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T06:20:11.108 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:11.136 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:20:11.149 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:11.464 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librados2. 2024-09-10T06:20:11.490 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:11.530 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:11.569 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T06:20:11.595 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:11.627 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:11.871 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2024-09-10T06:20:11.897 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:11.938 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:12.141 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librbd1. 2024-09-10T06:20:12.156 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:12.191 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:12.257 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T06:20:12.283 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:12.324 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:12.576 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T06:20:12.591 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:12.643 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:12.661 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T06:20:12.687 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:12.727 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:12.921 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T06:20:12.947 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:12.979 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:13.013 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2024-09-10T06:20:13.028 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:13.071 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:13.249 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T06:20:13.275 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T06:20:13.307 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:20:13.391 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T06:20:13.417 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:13.457 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:13.651 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T06:20:13.668 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T06:20:13.677 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T06:20:13.695 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:13.718 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T06:20:13.726 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:13.979 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T06:20:14.005 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:14.029 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T06:20:14.045 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:14.055 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:14.095 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:14.340 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T06:20:14.366 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T06:20:14.406 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:20:14.432 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T06:20:14.458 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T06:20:14.498 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:20:14.617 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T06:20:14.632 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T06:20:14.675 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:20:14.801 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T06:20:14.828 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T06:20:14.868 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T06:20:14.970 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T06:20:14.985 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T06:20:15.028 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:20:15.104 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T06:20:15.119 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:15.154 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:15.340 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua5.1. 2024-09-10T06:20:15.366 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T06:20:15.406 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:20:15.498 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T06:20:15.524 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T06:20:15.573 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:20:15.692 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-any. 2024-09-10T06:20:15.707 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T06:20:15.742 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T06:20:15.901 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T06:20:15.927 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T06:20:15.975 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:20:15.987 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package zip. 2024-09-10T06:20:16.013 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T06:20:16.053 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T06:20:16.303 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T06:20:16.319 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T06:20:16.365 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package unzip. 2024-09-10T06:20:16.378 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:20:16.391 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T06:20:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:20:16.740 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua5.1. 2024-09-10T06:20:16.766 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T06:20:16.807 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:20:17.027 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package luarocks. 2024-09-10T06:20:17.053 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T06:20:17.094 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:20:17.240 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-any. 2024-09-10T06:20:17.266 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T06:20:17.318 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T06:20:17.417 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2024-09-10T06:20:17.433 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:17.476 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:17.612 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package zip. 2024-09-10T06:20:17.627 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T06:20:17.670 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T06:20:17.990 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package unzip. 2024-09-10T06:20:18.017 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T06:20:18.057 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:20:18.095 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T06:20:18.110 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:18.153 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:18.444 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package luarocks. 2024-09-10T06:20:18.470 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T06:20:18.489 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T06:20:18.510 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:20:18.512 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T06:20:18.556 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:20:18.817 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T06:20:18.843 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:18.875 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:18.935 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2024-09-10T06:20:18.962 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:19.010 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:19.295 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2024-09-10T06:20:19.321 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:19.353 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:19.612 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T06:20:19.634 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:19.678 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:19.998 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T06:20:20.024 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T06:20:20.064 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:20:20.343 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T06:20:20.369 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:20.401 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:20.821 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2024-09-10T06:20:20.825 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2024-09-10T06:20:20.847 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:20.851 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:20.887 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:20.901 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:21.463 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T06:20:21.489 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T06:20:21.529 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:20:21.990 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T06:20:22.017 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T06:20:22.082 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:20:22.393 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T06:20:22.420 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T06:20:22.451 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:20:22.542 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2024-09-10T06:20:22.568 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:22.618 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:22.729 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T06:20:22.755 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T06:20:22.796 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:20:23.099 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T06:20:23.125 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T06:20:23.165 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:20:23.205 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T06:20:23.231 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T06:20:23.271 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:20:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T06:20:23.503 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T06:20:23.543 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T06:20:23.616 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T06:20:23.642 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T06:20:23.691 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:20:23.804 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-portend. 2024-09-10T06:20:23.830 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T06:20:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T06:20:24.094 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T06:20:24.120 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T06:20:24.132 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T06:20:24.158 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T06:20:24.168 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:20:24.198 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T06:20:24.488 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T06:20:24.501 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T06:20:24.514 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T06:20:24.527 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T06:20:24.554 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:20:24.576 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:20:24.858 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T06:20:24.884 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T06:20:24.921 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T06:20:24.924 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:20:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T06:20:24.988 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T06:20:25.260 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T06:20:25.286 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T06:20:25.299 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T06:20:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T06:20:25.335 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T06:20:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T06:20:25.644 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T06:20:25.670 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T06:20:25.702 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:20:25.704 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-portend. 2024-09-10T06:20:25.731 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T06:20:25.771 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T06:20:25.980 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2024-09-10T06:20:26.006 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T06:20:26.046 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:20:26.083 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T06:20:26.109 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T06:20:26.149 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T06:20:26.341 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T06:20:26.356 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T06:20:26.416 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:20:26.435 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T06:20:26.461 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T06:20:26.502 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:20:26.685 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T06:20:26.712 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T06:20:26.752 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:20:26.864 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T06:20:26.890 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T06:20:26.930 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T06:20:27.046 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2024-09-10T06:20:27.073 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T06:20:27.113 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:20:27.233 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T06:20:27.260 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T06:20:27.300 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T06:20:27.466 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T06:20:27.492 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T06:20:27.535 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:20:27.560 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T06:20:27.576 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T06:20:27.610 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:20:27.802 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T06:20:27.829 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T06:20:27.868 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:20:27.913 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2024-09-10T06:20:27.940 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T06:20:27.980 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:20:28.171 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2024-09-10T06:20:28.198 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T06:20:28.238 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:20:28.308 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T06:20:28.335 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T06:20:28.375 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:20:28.524 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T06:20:28.551 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T06:20:28.582 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:20:28.644 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T06:20:28.671 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T06:20:28.710 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:20:28.885 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T06:20:28.912 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T06:20:28.952 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:20:29.013 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2024-09-10T06:20:29.040 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T06:20:29.080 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:20:29.255 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T06:20:29.282 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T06:20:29.321 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T06:20:29.466 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T06:20:29.493 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T06:20:29.536 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:20:29.649 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T06:20:29.676 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T06:20:29.716 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:20:29.827 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T06:20:29.854 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T06:20:29.894 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:20:30.062 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T06:20:30.089 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T06:20:30.129 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T06:20:30.222 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2024-09-10T06:20:30.248 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T06:20:30.296 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:20:30.448 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-idna. 2024-09-10T06:20:30.464 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T06:20:30.498 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:20:30.616 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T06:20:30.643 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T06:20:30.683 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:20:30.776 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T06:20:30.803 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T06:20:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:20:30.969 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T06:20:30.996 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T06:20:31.036 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:20:31.121 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests. 2024-09-10T06:20:31.136 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T06:20:31.179 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:20:31.339 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T06:20:31.365 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T06:20:31.405 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T06:20:31.490 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T06:20:31.516 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T06:20:31.556 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:20:31.703 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T06:20:31.729 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T06:20:31.766 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:20:31.843 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T06:20:31.869 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:31.909 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:32.088 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T06:20:32.114 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T06:20:32.146 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T06:20:32.448 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T06:20:32.474 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:32.789 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:33.357 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-idna. 2024-09-10T06:20:33.367 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T06:20:33.384 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T06:20:33.394 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T06:20:33.424 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:20:33.433 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:20:33.720 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T06:20:33.743 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T06:20:33.746 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T06:20:33.770 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T06:20:33.786 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T06:20:33.809 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:20:34.123 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T06:20:34.138 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests. 2024-09-10T06:20:34.149 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:34.164 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T06:20:34.189 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:34.204 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:20:34.516 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T06:20:34.542 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T06:20:34.543 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T06:20:34.569 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:34.582 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:20:34.600 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T06:20:34.884 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:34.926 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:35.240 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T06:20:35.266 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:35.306 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:35.340 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T06:20:35.367 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:35.407 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:35.751 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T06:20:35.778 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T06:20:35.817 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:20:36.095 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T06:20:36.110 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T06:20:36.145 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T06:20:36.309 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2024-09-10T06:20:36.336 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:36.367 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:36.456 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T06:20:36.483 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:36.523 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T06:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:36.918 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T06:20:36.944 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:36.984 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:37.073 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T06:20:37.100 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:37.139 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:37.709 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2024-09-10T06:20:37.721 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T06:20:37.735 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:37.748 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:37.775 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:37.846 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:38.036 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T06:20:38.063 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T06:20:38.102 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T06:20:38.430 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T06:20:38.446 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:20:38.480 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:20:38.899 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2024-09-10T06:20:38.914 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:38.957 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:39.285 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T06:20:39.312 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:39.351 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:39.469 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-babel. 2024-09-10T06:20:39.496 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:20:39.535 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:20:39.730 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T06:20:39.756 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:39.796 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:39.871 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T06:20:39.898 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T06:20:39.938 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:20:40.193 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2024-09-10T06:20:40.219 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:40.259 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:40.274 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T06:20:40.301 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:40.570 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T06:20:40.597 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T06:20:40.637 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T06:20:40.686 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T06:20:40.713 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T06:20:40.752 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T06:20:40.964 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T06:20:40.980 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:20:41.021 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2024-09-10T06:20:41.022 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:20:41.037 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T06:20:41.071 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:20:41.366 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T06:20:41.393 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:41.424 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:42.010 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-babel. 2024-09-10T06:20:42.026 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:20:42.060 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:20:42.355 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T06:20:42.370 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T06:20:42.404 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:20:42.724 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T06:20:42.751 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:42.782 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:43.161 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T06:20:43.188 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T06:20:43.253 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T06:20:43.539 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2024-09-10T06:20:43.565 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T06:20:43.596 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:20:43.950 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T06:20:43.976 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:44.016 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:44.129 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T06:20:44.147 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T06:20:44.187 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:20:44.649 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T06:20:44.677 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T06:20:44.715 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:20:45.060 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T06:20:45.088 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T06:20:45.127 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:20:45.396 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T06:20:45.424 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T06:20:45.462 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:20:46.196 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T06:20:46.224 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:46.348 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:46.854 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T06:20:46.883 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T06:20:46.937 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:20:47.310 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T06:20:47.338 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T06:20:47.376 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T06:20:47.457 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T06:20:47.484 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T06:20:47.523 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:20:47.680 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T06:20:47.708 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T06:20:47.746 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:20:47.835 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T06:20:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T06:20:47.893 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:20:48.171 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T06:20:48.199 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T06:20:48.237 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:20:48.308 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T06:20:48.336 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T06:20:48.366 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:20:48.652 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T06:20:48.680 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T06:20:48.710 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T06:20:48.887 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T06:20:48.915 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:49.022 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T06:20:49.039 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:49.050 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T06:20:49.089 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T06:20:49.409 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T06:20:49.436 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T06:20:49.475 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:20:49.786 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T06:20:49.814 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T06:20:49.853 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T06:20:49.951 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T06:20:49.979 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T06:20:50.009 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T06:20:50.148 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T06:20:50.175 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T06:20:50.214 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:20:50.287 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T06:20:50.315 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T06:20:50.353 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:20:50.698 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T06:20:50.726 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T06:20:50.765 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:20:50.861 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T06:20:50.877 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:50.928 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:51.076 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T06:20:51.104 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T06:20:51.160 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T06:20:51.189 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T06:20:51.205 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T06:20:51.239 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:20:51.446 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T06:20:51.462 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T06:20:51.496 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T06:20:51.575 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T06:20:51.603 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:20:51.641 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:20:51.791 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T06:20:51.818 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T06:20:51.857 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:20:51.902 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2024-09-10T06:20:51.927 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:20:51.969 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T06:20:52.177 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T06:20:52.196 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2024-09-10T06:20:52.204 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T06:20:52.212 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T06:20:52.243 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T06:20:52.246 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:20:52.542 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T06:20:52.555 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T06:20:52.569 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T06:20:52.582 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T06:20:52.599 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:20:52.621 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:20:53.120 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2024-09-10T06:20:53.136 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:53.170 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:53.710 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T06:20:53.727 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:53.768 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:54.004 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T06:20:54.032 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T06:20:54.070 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:20:54.415 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T06:20:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:20:54.482 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:20:54.751 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2024-09-10T06:20:54.767 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:20:54.809 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T06:20:55.062 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2024-09-10T06:20:55.078 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T06:20:55.112 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:20:55.406 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T06:20:55.422 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T06:20:55.465 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:20:55.566 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T06:20:55.579 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:55.624 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:55.786 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2024-09-10T06:20:55.802 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:55.835 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:55.887 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T06:20:55.915 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:55.944 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:56.256 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T06:20:56.283 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T06:20:56.322 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:20:56.643 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T06:20:56.671 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T06:20:56.710 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:20:57.047 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T06:20:57.075 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T06:20:57.105 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:20:57.494 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pkg-config. 2024-09-10T06:20:57.522 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T06:20:57.551 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:20:57.813 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T06:20:57.841 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T06:20:57.879 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:20:58.291 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T06:20:58.319 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T06:20:58.356 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T06:20:58.357 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T06:20:58.384 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:20:58.422 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:58.643 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T06:20:58.672 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T06:20:58.710 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T06:20:58.768 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T06:20:58.796 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:20:58.859 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:20:59.030 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T06:20:59.058 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T06:20:59.096 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:20:59.171 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T06:20:59.199 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T06:20:59.237 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:20:59.374 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T06:20:59.403 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T06:20:59.432 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T06:20:59.541 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T06:20:59.558 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T06:20:59.599 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:20:59.777 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2024-09-10T06:20:59.805 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T06:20:59.843 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T06:20:59.978 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T06:21:00.007 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T06:21:00.045 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:21:00.131 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T06:21:00.158 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T06:21:00.188 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:21:00.467 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pkg-config. 2024-09-10T06:21:00.495 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T06:21:00.533 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:21:00.642 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T06:21:00.670 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T06:21:00.709 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:21:00.786 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T06:21:00.802 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T06:21:00.844 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:21:01.028 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-toml. 2024-09-10T06:21:01.056 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T06:21:01.094 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T06:21:01.272 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T06:21:01.288 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T06:21:01.330 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T06:21:01.422 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T06:21:01.450 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T06:21:01.489 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:21:01.625 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T06:21:01.653 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T06:21:01.682 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T06:21:01.834 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T06:21:01.862 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T06:21:01.900 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:21:01.961 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T06:21:01.989 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T06:21:02.027 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:21:02.186 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T06:21:02.214 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T06:21:02.253 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:21:02.338 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T06:21:02.366 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T06:21:02.405 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T06:21:02.767 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2024-09-10T06:21:02.794 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T06:21:02.833 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T06:21:02.940 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2024-09-10T06:21:02.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:21:02.990 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:03.153 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T06:21:03.181 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T06:21:03.219 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:21:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T06:21:03.659 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T06:21:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:21:03.868 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T06:21:03.884 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:21:03.925 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:04.017 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-toml. 2024-09-10T06:21:04.045 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T06:21:04.083 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T06:21:04.222 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T06:21:04.386 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T06:21:04.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T06:21:04.453 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:21:04.706 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:21:04.806 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T06:21:04.832 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:21:04.834 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T06:21:04.872 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:21:05.092 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T06:21:05.150 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T06:21:05.178 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T06:21:05.217 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:21:05.433 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T06:21:05.856 INFO:teuthology.orchestra.run.smithi084.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T06:21:05.925 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:05.996 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2024-09-10T06:21:06.024 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:21:06.062 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:06.424 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2024-09-10T06:21:06.581 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:21:06.849 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:21:06.948 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T06:21:06.964 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:21:07.006 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:07.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:21:07.201 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:21:07.319 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T06:21:07.460 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T06:21:07.569 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:21:07.704 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:21:07.720 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:21:07.846 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T06:21:07.970 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T06:21:08.148 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:21:08.298 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T06:21:08.491 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T06:21:08.695 INFO:teuthology.orchestra.run.smithi117.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T06:21:08.734 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T06:21:08.788 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:09.002 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:21:09.262 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:21:09.338 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2024-09-10T06:21:09.521 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:21:09.537 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:21:09.772 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:21:10.015 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:10.022 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:21:10.257 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:21:10.308 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:21:10.400 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:21:10.408 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:21:10.535 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:21:10.659 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T06:21:10.661 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:21:10.918 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:21:10.928 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:21:11.069 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T06:21:11.304 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T06:21:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T06:21:11.371 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:21:11.390 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:21:11.499 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T06:21:11.714 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T06:21:11.842 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:21:11.958 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T06:21:11.959 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T06:21:12.234 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:21:12.485 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:21:12.503 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:21:12.769 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:21:12.829 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T06:21:12.955 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:21:13.045 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:21:13.330 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:21:13.649 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:21:13.715 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:21:13.841 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:21:13.891 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:21:14.017 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:21:14.152 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:21:14.242 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:21:14.453 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T06:21:14.610 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:21:14.829 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T06:21:14.984 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T06:21:15.016 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T06:21:15.079 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:21:15.080 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:21:15.222 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T06:21:15.457 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:21:15.582 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:21:15.707 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T06:21:15.741 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:21:15.984 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:21:16.084 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:21:16.268 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:21:16.344 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:21:16.470 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:16.569 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T06:21:16.695 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:21:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:21:17.072 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:21:17.372 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:21:17.623 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:21:17.749 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:21:17.900 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:21:18.177 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:21:18.226 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T06:21:18.429 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:18.538 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T06:21:18.619 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T06:21:18.798 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:21:18.878 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:21:18.908 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:21:19.008 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:21:19.246 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:21:19.293 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:21:19.539 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:21:19.554 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T06:21:19.797 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:19.882 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:21:19.923 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:21:20.142 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:21:20.224 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:21:20.293 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:20.475 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T06:21:20.611 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:21:20.734 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T06:21:20.937 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:21:20.985 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:21:21.236 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T06:21:21.504 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:21:21.630 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T06:21:21.898 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:21:22.023 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:21:22.109 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:21:22.324 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:21:22.402 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:22.536 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T06:21:22.634 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:21:22.804 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:21:22.885 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:21:22.930 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:21:23.036 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:21:23.056 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:21:23.170 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:21:23.259 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T06:21:23.349 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:21:23.505 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:21:23.606 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:21:23.625 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T06:21:23.885 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:23.991 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:21:24.019 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:21:24.250 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T06:21:24.312 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:21:24.376 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T06:21:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T06:21:24.627 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:24.753 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:21:24.806 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T06:21:25.057 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:21:25.071 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:21:25.316 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T06:21:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:21:25.600 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:21:25.631 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T06:21:25.726 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T06:21:25.732 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T06:21:25.999 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T06:21:26.011 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:21:26.137 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:21:26.267 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:21:26.446 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:21:26.612 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:21:26.750 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:21:26.997 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T06:21:27.009 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:21:27.151 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:21:27.256 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:21:27.277 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:21:27.367 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T06:21:27.600 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:21:27.604 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:21:27.713 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:21:27.726 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:27.861 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:27.987 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:21:28.106 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:21:28.306 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:28.374 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T06:21:28.407 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:28.525 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T06:21:28.533 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T06:21:28.793 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:21:28.809 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:28.919 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:21:28.935 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:29.062 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:29.245 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:21:29.272 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:21:29.272 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:21:29.538 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:21:29.738 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:29.839 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T06:21:29.855 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:29.965 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T06:21:29.973 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:30.091 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:21:30.250 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T06:21:30.526 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:21:30.879 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:21:31.256 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T06:21:31.544 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:31.549 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:21:31.695 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:31.821 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:31.893 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:21:31.938 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.019 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.048 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.162 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.287 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:21:32.582 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2024-09-10T06:21:32.641 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.791 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:32.941 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2024-09-10T06:21:32.942 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T06:21:33.110 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2024-09-10T06:21:33.126 INFO:teuthology.orchestra.run.smithi084.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T06:21:33.219 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:33.264 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T06:21:33.320 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:33.429 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:33.598 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T06:21:33.645 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:21:33.645 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:21:34.048 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:34.147 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:34.174 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:34.282 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:34.433 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:34.584 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:21:34.644 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:21:34.645 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:21:35.068 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:35.417 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T06:21:35.746 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:35.844 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:35.872 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:35.998 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:36.093 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:21:36.093 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:21:36.165 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:36.317 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:36.546 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:36.747 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:21:36.747 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:21:36.859 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2024-09-10T06:21:37.214 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:37.261 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2024-09-10T06:21:37.430 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2024-09-10T06:21:37.447 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T06:21:37.496 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:21:37.496 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:21:37.583 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T06:21:37.882 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T06:21:37.957 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:38.083 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:38.234 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:38.334 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:38.435 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:38.452 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:21:38.452 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:21:38.868 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:21:38.868 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:21:38.902 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:39.053 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:39.187 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:39.312 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:39.313 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:39.661 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T06:21:39.665 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T06:21:39.776 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T06:21:39.927 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T06:21:40.336 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:40.569 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:21:40.570 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:21:41.020 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:41.070 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T06:21:41.237 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:21:41.237 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:21:41.704 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:41.712 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T06:21:41.719 DEBUG:teuthology.parallel:result is None 2024-09-10T06:21:41.978 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:21:41.978 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:21:42.431 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:42.590 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:42.766 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:42.977 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:21:42.977 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:21:43.442 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:43.594 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:43.720 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:43.870 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:21:44.240 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T06:21:44.341 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T06:21:44.510 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T06:21:45.745 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T06:21:46.378 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T06:21:46.383 DEBUG:teuthology.parallel:result is None 2024-09-10T06:21:46.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:21:46.526 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2024-09-10T06:21:46.545 INFO:teuthology.orchestra.run.smithi084.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T06:21:46.545 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:21:46.546 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T06:21:46.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:21:46.683 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2024-09-10T06:21:46.702 INFO:teuthology.orchestra.run.smithi117.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T06:21:46.702 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:21:46.702 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T06:21:46.704 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T06:21:46.704 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:46.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T06:21:46.719 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:46.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T06:21:46.759 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T06:21:46.760 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:46.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T06:21:46.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T06:21:46.829 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:46.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T06:21:46.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T06:21:46.898 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T06:21:46.898 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:46.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T06:21:46.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T06:21:46.965 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:46.965 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T06:21:46.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T06:21:47.030 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T06:21:47.030 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:47.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T06:21:47.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T06:21:47.097 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:47.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T06:21:47.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T06:21:47.166 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T06:21:47.244 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T06:21:47.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-09-10T06:21:47.247 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-10T06:21:47.259 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T06:21:47.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T06:21:47.302 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T06:21:47.315 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T06:21:47.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T06:21:47.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T06:21:47.378 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T06:21:47.379 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T06:21:47.379 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7898789', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4606, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cls-rgw-busy-resharding', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMmrhYNzMWmNM3fb7ENr895bYEl++HtK6xXSqEXhLByVpEF2cRV9c4kmLD0Cv7BHG8ZmqJhmWv6ghMgRm1+zFA=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkO0VSzro/ks0e3rlpgnITQNQP4ITY6EjfksqZTSuuPm9ZMkhSpmG7MMtL05coJ9jdFppOdDGQR3hI3RIL4kJo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:24:22', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T06:21:47.379 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T06:21:47.410 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T06:21:47.419 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T06:21:47.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T06:21:47.474 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:47.474 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T06:21:47.517 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T06:21:47.518 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-10T06:21:47.565 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 06:16:15.281790278 +0000 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 06:16:15.005818411 +0000 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 06:16:15.005818411 +0000 2024-09-10T06:21:47.566 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-09-10T06:21:47.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T06:21:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T06:21:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T06:21:47.619 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000445396 s, 1.1 MB/s 2024-09-10T06:21:47.621 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T06:21:47.671 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-10T06:21:47.717 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T06:21:47.717 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:47.717 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-10T06:21:47.717 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:47.717 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 06:16:15.761741350 +0000 2024-09-10T06:21:47.718 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 06:16:15.521765813 +0000 2024-09-10T06:21:47.718 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 06:16:15.521765813 +0000 2024-09-10T06:21:47.718 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-09-10T06:21:47.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T06:21:47.771 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T06:21:47.771 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T06:21:47.771 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000369432 s, 1.4 MB/s 2024-09-10T06:21:47.773 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T06:21:47.822 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-10T06:21:47.869 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 06:16:16.217695731 +0000 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 06:16:15.981718925 +0000 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 06:16:15.981718925 +0000 2024-09-10T06:21:47.870 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-09-10T06:21:47.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T06:21:47.924 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T06:21:47.924 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T06:21:47.924 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000377172 s, 1.4 MB/s 2024-09-10T06:21:47.925 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T06:21:47.974 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 06:16:16.693649114 +0000 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 06:16:16.445673402 +0000 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 06:16:16.445673402 +0000 2024-09-10T06:21:48.022 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-09-10T06:21:48.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T06:21:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T06:21:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T06:21:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00032558 s, 1.6 MB/s 2024-09-10T06:21:48.077 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T06:21:48.126 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T06:21:48.127 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:48.127 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T06:21:48.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T06:21:48.132 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-10 06:16:17.719978774 +0000 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-10 06:16:17.459981096 +0000 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-10 06:16:17.459981096 +0000 2024-09-10T06:21:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-09-10T06:21:48.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T06:21:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-10T06:21:48.233 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-10T06:21:48.234 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000429267 s, 1.2 MB/s 2024-09-10T06:21:48.235 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T06:21:48.284 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-10 06:16:18.179974666 +0000 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-10 06:16:17.943976773 +0000 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-10 06:16:17.943976773 +0000 2024-09-10T06:21:48.331 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-09-10T06:21:48.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T06:21:48.387 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-10T06:21:48.387 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-10T06:21:48.387 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000332428 s, 1.5 MB/s 2024-09-10T06:21:48.388 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T06:21:48.436 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-10 06:16:18.615970771 +0000 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-10 06:16:18.403972665 +0000 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-10 06:16:18.403972665 +0000 2024-09-10T06:21:48.483 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-09-10T06:21:48.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T06:21:48.536 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-10T06:21:48.536 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-10T06:21:48.537 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00032545 s, 1.6 MB/s 2024-09-10T06:21:48.538 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T06:21:48.584 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-10 06:16:19.119966270 +0000 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-10 06:16:18.863968556 +0000 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-10 06:16:18.863968556 +0000 2024-09-10T06:21:48.631 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-09-10T06:21:48.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T06:21:48.685 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-10T06:21:48.685 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-10T06:21:48.685 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000390993 s, 1.3 MB/s 2024-09-10T06:21:48.686 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T06:21:48.736 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T06:21:48.736 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T06:21:48.736 INFO:tasks.ceph:Generating config... 2024-09-10T06:21:48.737 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T06:21:48.737 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-10T06:21:48.737 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-10T06:21:48.737 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-10T06:21:48.737 INFO:tasks.ceph:[client] setuser = ceph 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T06:21:48.738 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T06:21:48.739 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T06:21:48.739 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T06:21:48.739 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T06:21:48.739 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T06:21:48.739 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T06:21:48.739 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T06:21:48.739 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T06:21:48.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T06:21:48.774 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T06:21:48.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T06:21:48.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:21:48.917 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84')] 2024-09-10T06:21:48.917 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-10T06:21:48.918 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:48.918 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T06:21:48.966 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:49.044 INFO:teuthology.orchestra.run.smithi084.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:21:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:21:49.045 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:49.045 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 2ef3ea51-0aa2-410c-a700-42b75c2c5647 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 2ef3ea51-0aa2-410c-a700-42b75c2c5647 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2024-09-10T06:21:49.046399+0000 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-10T06:21:49.046399+0000 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 17 (quincy) 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2024-09-10T06:21:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-10T06:21:49.047 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-10T06:21:49.048 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T06:21:49.094 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2ef3ea51-0aa2-410c-a700-42b75c2c5647... 2024-09-10T06:21:49.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T06:21:49.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T06:21:49.167 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-09-10T06:21:49.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-09-10T06:21:49.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.170 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-09-10T06:21:49.171 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = 172.21.15.84 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 2ef3ea51-0aa2-410c-a700-42b75c2c5647 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-09-10T06:21:49.172 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-09-10T06:21:49.173 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug objclass = 20 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore allocator = bitmap 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 1/20 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2024-09-10T06:21:49.174 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:21:49.175 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-09-10T06:21:49.177 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: rgw gc obj min wait = 15 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: debug rgw = 20 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: setgroup = ceph 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout: setuser = ceph 2024-09-10T06:21:49.178 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-09-10T06:21:49.179 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-10T06:21:49.179 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-10T06:21:49.179 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.180 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-10T06:21:49.181 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-10T06:21:49.182 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = 172.21.15.84 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 2ef3ea51-0aa2-410c-a700-42b75c2c5647 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-10T06:21:49.183 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.184 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: debug objclass = 20 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-09-10T06:21:49.185 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-10T06:21:49.186 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-10T06:21:49.187 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-10T06:21:49.188 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: rgw gc obj min wait = 15 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: debug rgw = 20 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: setgroup = ceph 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout: setuser = ceph 2024-09-10T06:21:49.189 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-10T06:21:49.191 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T06:21:49.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T06:21:49.281 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T06:21:49.282 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:49.282 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T06:21:49.287 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:49.287 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T06:21:49.337 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T06:21:49.337 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:49.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T06:21:49.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:21:49.400 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:21:49.400 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:49.449 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:21:49.450 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:49.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T06:21:49.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:21:49.474 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:21:49.475 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:49.523 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T06:21:49.523 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T06:21:49.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T06:21:49.608 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T06:21:49.623 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T06:21:49.623 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T06:21:49.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T06:21:49.705 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T06:21:49.715 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T06:21:49.716 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T06:21:49.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T06:21:49.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T06:21:49.729 INFO:tasks.ceph:role: osd.0 2024-09-10T06:21:49.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T06:21:49.730 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:21:49.793 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:21:49.794 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:21:49.794 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:21:49.794 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:21:50.235 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-09-10T06:21:50.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-09-10T06:21:50.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T06:21:50.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T06:21:50.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:21:50.369 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:21:50.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:50.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:21:50.477+0000 7f2f8903d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T06:21:50.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:21:50.485+0000 7f2f8903d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T06:21:50.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:21:50.485+0000 7f2f8903d7c0 -1 bdev(0x564873a8f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T06:21:50.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:21:50.485+0000 7f2f8903d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T06:21:53.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T06:21:53.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T06:21:53.681 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T06:21:53.682 INFO:tasks.ceph:role: osd.1 2024-09-10T06:21:53.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:21:53.682 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T06:21:53.747 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:21:53.747 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:21:53.747 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:21:53.747 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:21:53.747 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:21:53.748 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:21:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:21:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:21:53.748 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:21:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:21:54.202 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-10T06:21:54.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-10T06:21:54.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-10T06:21:54.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T06:21:54.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:21:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:21:54.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T06:21:54.356 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T06:21:54.356 INFO:tasks.ceph:role: osd.2 2024-09-10T06:21:54.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:21:54.356 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T06:21:54.419 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:21:54.419 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:21:54.420 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:21:54.885 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-10T06:21:54.887 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-10T06:21:54.887 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-10T06:21:55.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T06:21:55.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:21:55.060 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:21:55.060 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T06:21:55.114 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T06:21:55.114 INFO:tasks.ceph:role: osd.3 2024-09-10T06:21:55.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:21:55.114 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T06:21:55.178 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:21:55.178 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:21:55.178 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:21:55.178 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:21:55.178 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:21:55.179 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:21:55.661 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-10T06:21:55.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-10T06:21:55.663 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-10T06:21:55.809 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T06:21:55.820 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:21:55.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:21:55.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:55.930+0000 7fed231d77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T06:21:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:55.930+0000 7fed231d77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T06:21:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:55.930+0000 7fed231d77c0 -1 bdev(0x5583d68b1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T06:21:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:55.934+0000 7fed231d77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T06:21:59.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T06:21:59.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:21:59.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:59.198+0000 7f03c198c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T06:21:59.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:59.198+0000 7f03c198c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T06:21:59.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:59.198+0000 7f03c198c7c0 -1 bdev(0x5625e593d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T06:21:59.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:21:59.198+0000 7f03c198c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T06:22:02.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T06:22:02.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:22:02.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:02.494+0000 7f502f5287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T06:22:02.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:02.494+0000 7f502f5287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T06:22:02.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:02.494+0000 7f502f5287c0 -1 bdev(0x5652d634d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T06:22:02.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:02.494+0000 7f502f5287c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T06:22:05.626 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T06:22:05.683 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T06:22:05.683 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:22:05.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T06:22:05.698 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:05.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T06:22:05.737 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:05.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T06:22:05.794 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:05.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T06:22:05.850 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:05.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T06:22:05.906 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:05.906 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T06:22:05.955 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T06:22:05.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T06:22:05.967 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-09-10T06:22:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB+5d9mVHOvHBAAhv7uV2xbqqX5P6UQ1FDv1w== 2024-09-10T06:22:05.967 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB95d9mGn5VJBAAdxCMbFw5DFhhzsLYLReitw== 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCD5d9mAWu1NxAA1PXemJlN+kvisJ8V1oNOEw== 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCH5d9maIMEDBAAFFpvxiqkWwg84hDYOOjNow== 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCK5d9mbR2rHRAAuYZthcOB1+otw3Pb/m2IGQ== 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-09-10T06:22:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB95d9mke4cKhAAc7tTRLqFAFC5J/A23SgQwA== 2024-09-10T06:22:05.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:22:06.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T06:22:06.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:22:06.185 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:22:06.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:22:06.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T06:22:06.440 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T06:22:06.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T06:22:06.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T06:22:06.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T06:22:06.604 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:22:06.652 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T06:22:06.653 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T06:22:06.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T06:22:06.698 INFO:tasks.ceph.mon.a:Started 2024-09-10T06:22:06.698 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T06:22:06.699 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T06:22:06.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T06:22:06.701 INFO:tasks.ceph.mgr.x:Started 2024-09-10T06:22:06.701 DEBUG:tasks.ceph:set 0 configs 2024-09-10T06:22:06.701 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T06:22:06.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T06:22:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f4e16b640 1 Processor -- start 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f4e16b640 1 -- start start 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f4e16b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f4e16b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f48050d70 con 0x7f1f4806e4e0 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f4e16b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1f48073960 con 0x7f1f4806dbc0 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f46ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1f4806e4e0 0x7f1f48095060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45302/0 (socket says 172.21.15.84:45302) 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f46ffd640 1 -- 172.21.15.84:0/2533794801 learned_addr learned my addr 172.21.15.84:0/2533794801 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f477fe640 1 --2- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f477fe640 1 -- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 msgr2=0x7f1f4806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f477fe640 1 -- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 msgr2=0x7f1f4806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f477fe640 1 --2- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T06:22:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.821+0000 7f1f477fe640 1 --2- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499641545 0 0) 0x7f1f48050d70 con 0x7f1f4806e4e0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f34003530 con 0x7f1f4806e4e0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 723041832 0 0) 0x7f1f34003530 con 0x7f1f4806e4e0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 msgr2=0x7f1f4806dfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 --2- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4806e8f0 con 0x7f1f4806e4e0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3847991633 0 0) 0x7f1f30001630 con 0x7f1f4806e4e0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 >> v1:172.21.15.84:6789/0 conn(0x7f1f4806e4e0 legacy=0x7f1f48095060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 --2- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f34003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48073960 con 0x7f1f34003a60 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f477fe640 1 --2- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f34003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.833+0000 7f1f477fe640 1 -- 172.21.15.84:0/2533794801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34003530 con 0x7f1f34003a60 2024-09-10T06:22:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 --2- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f34003e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c7a0 tx=0x7f1f4001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10d4ef8dd45b650 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f4000f040 con 0x7f1f34003a60 2024-09-10T06:22:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400af070 con 0x7f1f34003a60 2024-09-10T06:22:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f467fc640 1 -- 172.21.15.84:0/2533794801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f400aa690 con 0x7f1f34003a60 2024-09-10T06:22:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 msgr2=0x7f1f34003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 --2- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f34003e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c7a0 tx=0x7f1f4001c5d0 comp rx=0 tx=0).stop 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- 172.21.15.84:0/2533794801 shutdown_connections 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 --2- 172.21.15.84:0/2533794801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f34003e60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 --2- 172.21.15.84:0/2533794801 >> v2:172.21.15.84:3300/0 conn(0x7f1f4806dbc0 0x7f1f4806dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- 172.21.15.84:0/2533794801 >> 172.21.15.84:0/2533794801 conn(0x7f1f4809cde0 msgr2=0x7f1f4809d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- 172.21.15.84:0/2533794801 shutdown_connections 2024-09-10T06:22:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- 172.21.15.84:0/2533794801 wait complete. 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 Processor -- start 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- start start 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f4e16b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48138260 con 0x7f1f34003a60 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43624/0 (socket says 172.21.15.84:43624) 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 -- 172.21.15.84:0/1221309181 learned_addr learned my addr 172.21.15.84:0/1221309181 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 -- 172.21.15.84:0/1221309181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f48095470 con 0x7f1f34003a60 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f477fe640 1 --2- 172.21.15.84:0/1221309181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c10 tx=0x7f1f34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.853+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f400b4a60 con 0x7f1f34003a60 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400b4c00 con 0x7f1f34003a60 2024-09-10T06:22:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f48127a30 con 0x7f1f34003a60 2024-09-10T06:22:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f400be3f0 con 0x7f1f34003a60 2024-09-10T06:22:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f481256c0 con 0x7f1f34003a60 2024-09-10T06:22:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f400c5060 con 0x7f1f34003a60 2024-09-10T06:22:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f400c7900 con 0x7f1f34003a60 2024-09-10T06:22:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f48076880 con 0x7f1f34003a60 2024-09-10T06:22:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.857+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1f400de860 con 0x7f1f34003a60 2024-09-10T06:22:06.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1f4806e4e0 con 0x7f1f34003a60 2024-09-10T06:22:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f3ffff640 1 -- 172.21.15.84:0/1221309181 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1f400cc070 con 0x7f1f34003a60 2024-09-10T06:22:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-09-10T06:22:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 msgr2=0x7f1f48124fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 --2- 172.21.15.84:0/1221309181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c10 tx=0x7f1f34005840 comp rx=0 tx=0).stop 2024-09-10T06:22:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 shutdown_connections 2024-09-10T06:22:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 --2- 172.21.15.84:0/1221309181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f34003a60 0x7f1f48124fb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 >> 172.21.15.84:0/1221309181 conn(0x7f1f4809cde0 msgr2=0x7f1f4812da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 shutdown_connections 2024-09-10T06:22:06.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:06.925+0000 7f1f4e16b640 1 -- 172.21.15.84:0/1221309181 wait complete. 2024-09-10T06:22:06.944 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T06:22:06.944 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T06:22:06.945 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T06:22:06.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T06:22:06.954 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:06.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T06:22:06.967 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:06.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T06:22:07.021 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-10T06:22:07.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T06:22:07.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9 0 2024-09-10T06:22:07.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7d0f0640 1 Processor -- start 2024-09-10T06:22:07.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7d0f0640 1 -- start start 2024-09-10T06:22:07.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7d0f0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e7811b8d0 0x7f5e7811dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7d0f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7811e290 con 0x7f5e78113070 2024-09-10T06:22:07.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7d0f0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7811f470 con 0x7f5e7811b8d0 2024-09-10T06:22:07.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e76d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e78113070 0x7f5e78113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:58602/0 (socket says 172.21.15.117:58602) 2024-09-10T06:22:07.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e76d9d640 1 -- 172.21.15.117:0/452706710 learned_addr learned my addr 172.21.15.117:0/452706710 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:07.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e7811b8d0 0x7f5e7811dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7659c640 1 -- 172.21.15.117:0/452706710 >> v1:172.21.15.84:6789/0 conn(0x7f5e78113070 legacy=0x7f5e78113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.242+0000 7f5e7659c640 1 -- 172.21.15.117:0/452706710 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7811f5f0 con 0x7f5e7811b8d0 2024-09-10T06:22:07.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7659c640 1 --2- 172.21.15.117:0/452706710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e7811b8d0 0x7f5e7811dcc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009740 tx=0x7f5e6801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4611ee3f6e1aab54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e75d9b640 1 -- 172.21.15.117:0/452706710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e680b1070 con 0x7f5e7811b8d0 2024-09-10T06:22:07.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e75d9b640 1 -- 172.21.15.117:0/452706710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e680ac520 con 0x7f5e7811b8d0 2024-09-10T06:22:07.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e75d9b640 1 -- 172.21.15.117:0/452706710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e680ac820 con 0x7f5e7811b8d0 2024-09-10T06:22:07.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/452706710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e7811b8d0 msgr2=0x7f5e7811dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 --2- 172.21.15.117:0/452706710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e7811b8d0 0x7f5e7811dcc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009740 tx=0x7f5e6801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/452706710 shutdown_connections 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 --2- 172.21.15.117:0/452706710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e7811b8d0 0x7f5e7811dcc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/452706710 >> 172.21.15.117:0/452706710 conn(0x7f5e7806f3b0 msgr2=0x7f5e7806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/452706710 shutdown_connections 2024-09-10T06:22:07.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/452706710 wait complete. 2024-09-10T06:22:07.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 Processor -- start 2024-09-10T06:22:07.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- start start 2024-09-10T06:22:07.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.246+0000 7f5e7d0f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7811f120 con 0x7f5e78113070 2024-09-10T06:22:07.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e76d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e76d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:35000/0 (socket says 172.21.15.117:35000) 2024-09-10T06:22:07.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e76d9d640 1 -- 172.21.15.117:0/4108888378 learned_addr learned my addr 172.21.15.117:0/4108888378 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:07.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e76d9d640 1 -- 172.21.15.117:0/4108888378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e781aa4c0 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e76d9d640 1 --2- 172.21.15.117:0/4108888378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c450 tx=0x7f5e6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e60017070 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e60005c20 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e600070d0 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e781aa7b0 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e781af900 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e6001a070 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5e60012400 con 0x7f5e78113070 2024-09-10T06:22:07.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.250+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e781134d0 con 0x7f5e78113070 2024-09-10T06:22:07.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.258+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5e6001c440 con 0x7f5e78113070 2024-09-10T06:22:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.326+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9", "id": 0} v 0) -- 0x7f5e781aaaf0 con 0x7f5e78113070 2024-09-10T06:22:07.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e6f7fe640 1 -- 172.21.15.117:0/4108888378 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5e600072c0 con 0x7f5e78113070 2024-09-10T06:22:07.331 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-09-10T06:22:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 msgr2=0x7f5e781a9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 --2- 172.21.15.117:0/4108888378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c450 tx=0x7f5e6000c910 comp rx=0 tx=0).stop 2024-09-10T06:22:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 shutdown_connections 2024-09-10T06:22:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 --2- 172.21.15.117:0/4108888378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78113070 0x7f5e781a9ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 >> 172.21.15.117:0/4108888378 conn(0x7f5e7806f3b0 msgr2=0x7f5e7811c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 shutdown_connections 2024-09-10T06:22:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.330+0000 7f5e7d0f0640 1 -- 172.21.15.117:0/4108888378 wait complete. 2024-09-10T06:22:07.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 5d55d896-afbf-4432-bd18-58d467a7d1f4 1 2024-09-10T06:22:07.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85fa010640 1 Processor -- start 2024-09-10T06:22:07.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85fa010640 1 -- start start 2024-09-10T06:22:07.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85fa010640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85f406ea10 0x7f85f411e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85fa010640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f406ee80 con 0x7f85f4070010 2024-09-10T06:22:07.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85fa010640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f85f406f050 con 0x7f85f406ea10 2024-09-10T06:22:07.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85f2ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f85f406ea10 0x7f85f411e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85f37fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f85f4070010 0x7f85f406e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:58612/0 (socket says 172.21.15.117:58612) 2024-09-10T06:22:07.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85f37fe640 1 -- 172.21.15.117:0/974097680 learned_addr learned my addr 172.21.15.117:0/974097680 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:07.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85f2ffd640 1 -- 172.21.15.117:0/974097680 >> v1:172.21.15.84:6789/0 conn(0x7f85f4070010 legacy=0x7f85f406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.462+0000 7f85f2ffd640 1 -- 172.21.15.117:0/974097680 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f411f770 con 0x7f85f406ea10 2024-09-10T06:22:07.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85f2ffd640 1 --2- 172.21.15.117:0/974097680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f411e220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009740 tx=0x7f85e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16453953dc58e6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85f27fc640 1 -- 172.21.15.117:0/974097680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e80b1070 con 0x7f85f406ea10 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85f27fc640 1 -- 172.21.15.117:0/974097680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e80ac520 con 0x7f85f406ea10 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85f27fc640 1 -- 172.21.15.117:0/974097680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e80ac820 con 0x7f85f406ea10 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 -- 172.21.15.117:0/974097680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 msgr2=0x7f85f411e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 --2- 172.21.15.117:0/974097680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f411e220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009740 tx=0x7f85e801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:07.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 -- 172.21.15.117:0/974097680 shutdown_connections 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 --2- 172.21.15.117:0/974097680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f411e220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 -- 172.21.15.117:0/974097680 >> 172.21.15.117:0/974097680 conn(0x7f85f4071e50 msgr2=0x7f85f4074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 -- 172.21.15.117:0/974097680 shutdown_connections 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.466+0000 7f85fa010640 1 -- 172.21.15.117:0/974097680 wait complete. 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 Processor -- start 2024-09-10T06:22:07.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 -- start start 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85f411f3f0 con 0x7f85f406ea10 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85f37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85f37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:35026/0 (socket says 172.21.15.117:35026) 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85f37fe640 1 -- 172.21.15.117:0/1792340817 learned_addr learned my addr 172.21.15.117:0/1792340817 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:07.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85f37fe640 1 -- 172.21.15.117:0/1792340817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f41aa4c0 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85f37fe640 1 --2- 172.21.15.117:0/1792340817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c480 tx=0x7f85e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4017070 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e4005c20 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f41aa7b0 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4007070 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f41af980 con 0x7f85f406ea10 2024-09-10T06:22:07.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85e401a070 con 0x7f85f406ea10 2024-09-10T06:22:07.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f85e4012400 con 0x7f85f406ea10 2024-09-10T06:22:07.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.470+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f406e380 con 0x7f85f406ea10 2024-09-10T06:22:07.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.478+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f85e401c440 con 0x7f85f406ea10 2024-09-10T06:22:07.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.550+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5d55d896-afbf-4432-bd18-58d467a7d1f4", "id": 1} v 0) -- 0x7f85f41aaaf0 con 0x7f85f406ea10 2024-09-10T06:22:07.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85dbfff640 1 -- 172.21.15.117:0/1792340817 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d55d896-afbf-4432-bd18-58d467a7d1f4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f85e4007210 con 0x7f85f406ea10 2024-09-10T06:22:07.555 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 msgr2=0x7f85f41a9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 --2- 172.21.15.117:0/1792340817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c480 tx=0x7f85e400c940 comp rx=0 tx=0).stop 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 shutdown_connections 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 --2- 172.21.15.117:0/1792340817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85f406ea10 0x7f85f41a9ef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 >> 172.21.15.117:0/1792340817 conn(0x7f85f4071e50 msgr2=0x7f85f411a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 shutdown_connections 2024-09-10T06:22:07.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.554+0000 7f85fa010640 1 -- 172.21.15.117:0/1792340817 wait complete. 2024-09-10T06:22:07.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8acf9814-f38c-4435-a9b9-9e76a12de1e0 2 2024-09-10T06:22:07.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f9536958640 1 Processor -- start 2024-09-10T06:22:07.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f9536958640 1 -- start start 2024-09-10T06:22:07.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f9536958640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9530111750 0x7f953006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f9536958640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9530111cb0 con 0x7f953006d730 2024-09-10T06:22:07.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f9536958640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f953006dbc0 con 0x7f9530111750 2024-09-10T06:22:07.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f952ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9530111750 0x7f953006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f952f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f953006d730 0x7f953011d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:58626/0 (socket says 172.21.15.117:58626) 2024-09-10T06:22:07.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f952f7fe640 1 -- 172.21.15.117:0/1760236900 learned_addr learned my addr 172.21.15.117:0/1760236900 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:07.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f952ffff640 1 -- 172.21.15.117:0/1760236900 >> v1:172.21.15.84:6789/0 conn(0x7f953006d730 legacy=0x7f953011d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.686+0000 7f952ffff640 1 -- 172.21.15.117:0/1760236900 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953006dd70 con 0x7f9530111750 2024-09-10T06:22:07.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952ffff640 1 --2- 172.21.15.117:0/1760236900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9530111750 0x7f953006d1f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9520009740 tx=0x7f952001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1742658c332899a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952effd640 1 -- 172.21.15.117:0/1760236900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200b0070 con 0x7f9530111750 2024-09-10T06:22:07.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952effd640 1 -- 172.21.15.117:0/1760236900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95200ab530 con 0x7f9530111750 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952effd640 1 -- 172.21.15.117:0/1760236900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200ab830 con 0x7f9530111750 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- 172.21.15.117:0/1760236900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9530111750 msgr2=0x7f953006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 --2- 172.21.15.117:0/1760236900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9530111750 0x7f953006d1f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9520009740 tx=0x7f952001c370 comp rx=0 tx=0).stop 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- 172.21.15.117:0/1760236900 shutdown_connections 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 --2- 172.21.15.117:0/1760236900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9530111750 0x7f953006d1f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- 172.21.15.117:0/1760236900 >> 172.21.15.117:0/1760236900 conn(0x7f9530070d50 msgr2=0x7f9530073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- 172.21.15.117:0/1760236900 shutdown_connections 2024-09-10T06:22:07.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- 172.21.15.117:0/1760236900 wait complete. 2024-09-10T06:22:07.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 Processor -- start 2024-09-10T06:22:07.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- start start 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f9536958640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f95301216d0 con 0x7f953006d730 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:35034/0 (socket says 172.21.15.117:35034) 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.690+0000 7f952ffff640 1 -- 172.21.15.117:0/3500412632 learned_addr learned my addr 172.21.15.117:0/3500412632 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:07.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952ffff640 1 -- 172.21.15.117:0/3500412632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95301aa6d0 con 0x7f953006d730 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952ffff640 1 --2- 172.21.15.117:0/3500412632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95200ae040 tx=0x7f952001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200b0050 con 0x7f953006d730 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95200b1040 con 0x7f953006d730 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200aaba0 con 0x7f953006d730 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95301aa960 con 0x7f953006d730 2024-09-10T06:22:07.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95301af940 con 0x7f953006d730 2024-09-10T06:22:07.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95200be030 con 0x7f953006d730 2024-09-10T06:22:07.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f95200bc070 con 0x7f953006d730 2024-09-10T06:22:07.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.694+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953006d270 con 0x7f953006d730 2024-09-10T06:22:07.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.702+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f95200c5060 con 0x7f953006d730 2024-09-10T06:22:07.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.770+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8acf9814-f38c-4435-a9b9-9e76a12de1e0", "id": 2} v 0) -- 0x7f9530111750 con 0x7f953006d730 2024-09-10T06:22:07.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.774+0000 7f952cff9640 1 -- 172.21.15.117:0/3500412632 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8acf9814-f38c-4435-a9b9-9e76a12de1e0", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9520015ff0 con 0x7f953006d730 2024-09-10T06:22:07.778 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-09-10T06:22:07.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 msgr2=0x7f95301aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 --2- 172.21.15.117:0/3500412632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95200ae040 tx=0x7f952001abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 shutdown_connections 2024-09-10T06:22:07.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 --2- 172.21.15.117:0/3500412632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f953006d730 0x7f95301aa100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 >> 172.21.15.117:0/3500412632 conn(0x7f9530070d50 msgr2=0x7f953011db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 shutdown_connections 2024-09-10T06:22:07.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.778+0000 7f9536958640 1 -- 172.21.15.117:0/3500412632 wait complete. 2024-09-10T06:22:07.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 2ff55d34-0779-423c-9fe7-52cc85bf4cac 3 2024-09-10T06:22:07.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4058114640 1 Processor -- start 2024-09-10T06:22:07.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4058114640 1 -- start start 2024-09-10T06:22:07.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4058114640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4050074c50 0x7f4050110ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4058114640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050111850 con 0x7f40501113e0 2024-09-10T06:22:07.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4058114640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4050111a20 con 0x7f4050074c50 2024-09-10T06:22:07.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4055eb0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4050074c50 0x7f4050110ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f40556af640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f40501113e0 0x7f4050119f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:58632/0 (socket says 172.21.15.117:58632) 2024-09-10T06:22:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4055eb0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4050074c50 0x7f4050110ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:35036/0 (socket says 172.21.15.117:35036) 2024-09-10T06:22:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f40556af640 1 -- 172.21.15.117:0/3361354278 learned_addr learned my addr 172.21.15.117:0/3361354278 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4055eb0640 1 -- 172.21.15.117:0/3361354278 >> v1:172.21.15.84:6789/0 conn(0x7f40501113e0 legacy=0x7f4050119f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.902+0000 7f4055eb0640 1 -- 172.21.15.117:0/3361354278 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4050111bd0 con 0x7f4050074c50 2024-09-10T06:22:07.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4055eb0640 1 --2- 172.21.15.117:0/3361354278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4050074c50 0x7f4050110ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f404c009740 tx=0x7f404c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bad5843b44d9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4054eae640 1 -- 172.21.15.117:0/3361354278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f404c0b1070 con 0x7f4050074c50 2024-09-10T06:22:07.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4054eae640 1 -- 172.21.15.117:0/3361354278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c0ac570 con 0x7f4050074c50 2024-09-10T06:22:07.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4054eae640 1 -- 172.21.15.117:0/3361354278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f404c0ac870 con 0x7f4050074c50 2024-09-10T06:22:07.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- 172.21.15.117:0/3361354278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4050074c50 msgr2=0x7f4050110ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 --2- 172.21.15.117:0/3361354278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4050074c50 0x7f4050110ea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f404c009740 tx=0x7f404c01c400 comp rx=0 tx=0).stop 2024-09-10T06:22:07.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- 172.21.15.117:0/3361354278 shutdown_connections 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 --2- 172.21.15.117:0/3361354278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4050074c50 0x7f4050110ea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- 172.21.15.117:0/3361354278 >> 172.21.15.117:0/3361354278 conn(0x7f4050070390 msgr2=0x7f40500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- 172.21.15.117:0/3361354278 shutdown_connections 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- 172.21.15.117:0/3361354278 wait complete. 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 Processor -- start 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- start start 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:07.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4058114640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f405011e2a0 con 0x7f40501113e0 2024-09-10T06:22:07.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.906+0000 7f4055eb0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:07.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4055eb0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:35044/0 (socket says 172.21.15.117:35044) 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4055eb0640 1 -- 172.21.15.117:0/466910191 learned_addr learned my addr 172.21.15.117:0/466910191 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4055eb0640 1 -- 172.21.15.117:0/466910191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40501a84e0 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4055eb0640 1 --2- 172.21.15.117:0/466910191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f404c01a030 tx=0x7f404c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f404c0b1050 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c0b2040 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40501a8770 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f404c0aa9d0 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40501ad750 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f404c0bf030 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f404c0bd070 con 0x7f40501113e0 2024-09-10T06:22:07.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.910+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4050110ea0 con 0x7f40501113e0 2024-09-10T06:22:07.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.914+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f404c0c6060 con 0x7f40501113e0 2024-09-10T06:22:07.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.982+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ff55d34-0779-423c-9fe7-52cc85bf4cac", "id": 3} v 0) -- 0x7f40501ad9d0 con 0x7f40501113e0 2024-09-10T06:22:07.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.986+0000 7f40467fc640 1 -- 172.21.15.117:0/466910191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ff55d34-0779-423c-9fe7-52cc85bf4cac", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f404c015ff0 con 0x7f40501113e0 2024-09-10T06:22:07.989 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 msgr2=0x7f40501a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 --2- 172.21.15.117:0/466910191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f404c01a030 tx=0x7f404c01ac40 comp rx=0 tx=0).stop 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 shutdown_connections 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 --2- 172.21.15.117:0/466910191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40501113e0 0x7f40501a7f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 >> 172.21.15.117:0/466910191 conn(0x7f4050070390 msgr2=0x7f4050072dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:07.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 shutdown_connections 2024-09-10T06:22:07.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:07.990+0000 7f4058114640 1 -- 172.21.15.117:0/466910191 wait complete. 2024-09-10T06:22:08.005 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T06:22:08.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T06:22:08.008 INFO:tasks.ceph.osd.0:Started 2024-09-10T06:22:08.008 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T06:22:08.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T06:22:08.010 INFO:tasks.ceph.osd.1:Started 2024-09-10T06:22:08.010 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T06:22:08.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T06:22:08.012 INFO:tasks.ceph.osd.2:Started 2024-09-10T06:22:08.013 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T06:22:08.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T06:22:08.015 INFO:tasks.ceph.osd.3:Started 2024-09-10T06:22:08.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa07a6bf640 1 Processor -- start 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa07a6bf640 1 -- start start 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa07a6bf640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa074072f10 0x7fa0740732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa07a6bf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07406d520 con 0x7fa074073830 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa07a6bf640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa07406fd80 con 0x7fa074072f10 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa073fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa074072f10 0x7fa0740732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa0737fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa074073830 0x7fa074123420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45328/0 (socket says 172.21.15.84:45328) 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa073fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa074072f10 0x7fa0740732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43642/0 (socket says 172.21.15.84:43642) 2024-09-10T06:22:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa0737fe640 1 -- 172.21.15.84:0/2840617934 learned_addr learned my addr 172.21.15.84:0/2840617934 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa073fff640 1 -- 172.21.15.84:0/2840617934 >> v1:172.21.15.84:6789/0 conn(0x7fa074073830 legacy=0x7fa074123420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa072ffd640 1 -- 172.21.15.84:0/2840617934 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029248508 0 0) 0x7fa07406d520 con 0x7fa074073830 2024-09-10T06:22:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.133+0000 7fa073fff640 1 -- 172.21.15.84:0/2840617934 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074070a80 con 0x7fa074072f10 2024-09-10T06:22:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 --2- 172.21.15.84:0/2840617934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0740732f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa064009740 tx=0x7fa06401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bce134c3d727a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa072ffd640 1 -- 172.21.15.84:0/2840617934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b0070 con 0x7fa074072f10 2024-09-10T06:22:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa072ffd640 1 -- 172.21.15.84:0/2840617934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640ab530 con 0x7fa074072f10 2024-09-10T06:22:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa072ffd640 1 -- 172.21.15.84:0/2840617934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640ab830 con 0x7fa074072f10 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2840617934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 msgr2=0x7fa0740732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 --2- 172.21.15.84:0/2840617934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0740732f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa064009740 tx=0x7fa06401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2840617934 shutdown_connections 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 --2- 172.21.15.84:0/2840617934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0740732f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2840617934 >> 172.21.15.84:0/2840617934 conn(0x7fa07409e870 msgr2=0x7fa07409ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2840617934 shutdown_connections 2024-09-10T06:22:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2840617934 wait complete. 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 Processor -- start 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- start start 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa074136270 con 0x7fa074072f10 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43658/0 (socket says 172.21.15.84:43658) 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 -- 172.21.15.84:0/2069792792 learned_addr learned my addr 172.21.15.84:0/2069792792 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 -- 172.21.15.84:0/2069792792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074132c70 con 0x7fa074072f10 2024-09-10T06:22:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa073fff640 1 --2- 172.21.15.84:0/2069792792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa064019fa0 tx=0x7fa06401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b0050 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640b1040 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074132960 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b5930 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741c5ac0 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0640be030 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa0640bc070 con 0x7fa074072f10 2024-09-10T06:22:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.137+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0740732f0 con 0x7fa074072f10 2024-09-10T06:22:08.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.141+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa0640c5020 con 0x7fa074072f10 2024-09-10T06:22:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0741222e0 con 0x7fa074072f10 2024-09-10T06:22:08.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa070ff9640 1 -- 172.21.15.84:0/2069792792 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fa064015ff0 con 0x7fa074072f10 2024-09-10T06:22:08.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:08.203 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:07.987315+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 msgr2=0x7fa0741c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 --2- 172.21.15.84:0/2069792792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa064019fa0 tx=0x7fa06401abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 shutdown_connections 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 --2- 172.21.15.84:0/2069792792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa074072f10 0x7fa0741c5580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 >> 172.21.15.84:0/2069792792 conn(0x7fa07409e870 msgr2=0x7fa07406f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 shutdown_connections 2024-09-10T06:22:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:08.201+0000 7fa07a6bf640 1 -- 172.21.15.84:0/2069792792 wait complete. 2024-09-10T06:22:08.220 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T06:22:08.220 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T06:22:08.626 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facafae1640 1 Processor -- start 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facafae1640 1 -- start start 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facafae1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faca812d580 0x7faca812d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facafae1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca8073730 con 0x7faca8110da0 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facafae1640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faca8114b80 con 0x7faca812d580 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facad87d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faca812d580 0x7faca812d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:08.750 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facad07c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faca8110da0 0x7faca81111a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45344/0 (socket says 172.21.15.84:45344) 2024-09-10T06:22:08.751 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facad07c640 1 -- 172.21.15.84:0/2749100337 learned_addr learned my addr 172.21.15.84:0/2749100337 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:08.751 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facad87d640 1 -- 172.21.15.84:0/2749100337 >> v1:172.21.15.84:6789/0 conn(0x7faca8110da0 legacy=0x7faca81111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.751 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facac87b640 1 -- 172.21.15.84:0/2749100337 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476363960 0 0) 0x7faca8073730 con 0x7faca8110da0 2024-09-10T06:22:08.751 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.749+0000 7facad87d640 1 -- 172.21.15.84:0/2749100337 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca812d130 con 0x7faca812d580 2024-09-10T06:22:08.753 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 --2- 172.21.15.84:0/2749100337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca812d580 0x7faca812d960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faca4009740 tx=0x7faca401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be326310c3452633 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:08.753 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facac87b640 1 -- 172.21.15.84:0/2749100337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca40b0070 con 0x7faca812d580 2024-09-10T06:22:08.753 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facac87b640 1 -- 172.21.15.84:0/2749100337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca40ab530 con 0x7faca812d580 2024-09-10T06:22:08.753 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facac87b640 1 -- 172.21.15.84:0/2749100337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca40ab830 con 0x7faca812d580 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2749100337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca812d580 msgr2=0x7faca812d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 --2- 172.21.15.84:0/2749100337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca812d580 0x7faca812d960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faca4009740 tx=0x7faca401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2749100337 shutdown_connections 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 --2- 172.21.15.84:0/2749100337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca812d580 0x7faca812d960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2749100337 >> 172.21.15.84:0/2749100337 conn(0x7faca80709a0 msgr2=0x7faca8072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2749100337 shutdown_connections 2024-09-10T06:22:08.754 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2749100337 wait complete. 2024-09-10T06:22:08.756 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 Processor -- start 2024-09-10T06:22:08.756 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- start start 2024-09-10T06:22:08.756 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faca8135d50 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43674/0 (socket says 172.21.15.84:43674) 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 -- 172.21.15.84:0/2806513988 learned_addr learned my addr 172.21.15.84:0/2806513988 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 -- 172.21.15.84:0/2806513988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca8116d10 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facad87d640 1 --2- 172.21.15.84:0/2806513988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faca4019fa0 tx=0x7faca401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca40b0040 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca40abe40 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca81172a0 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca40041a0 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca81178a0 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faca40039b0 con 0x7faca8110da0 2024-09-10T06:22:08.757 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.753+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7faca40a4e00 con 0x7faca8110da0 2024-09-10T06:22:08.758 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.757+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca8117630 con 0x7faca8110da0 2024-09-10T06:22:08.759 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.757+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7faca8117630 con 0x7faca8110da0 2024-09-10T06:22:08.819 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faca8074f70 con 0x7faca8110da0 2024-09-10T06:22:08.819 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7fac9e7fc640 1 -- 172.21.15.84:0/2806513988 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7faca4015ff0 con 0x7faca8110da0 2024-09-10T06:22:08.820 INFO:teuthology.misc.health.smithi084.stdout: 2024-09-10T06:22:08.820 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":6,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:07.987315+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 msgr2=0x7faca81c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 --2- 172.21.15.84:0/2806513988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faca4019fa0 tx=0x7faca401abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 shutdown_connections 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 --2- 172.21.15.84:0/2806513988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faca8110da0 0x7faca81c7110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.817+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 >> 172.21.15.84:0/2806513988 conn(0x7faca80709a0 msgr2=0x7faca81136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.821+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 shutdown_connections 2024-09-10T06:22:08.821 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:08.821+0000 7facafae1640 1 -- 172.21.15.84:0/2806513988 wait complete. 2024-09-10T06:22:08.835 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T06:22:09.054 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-09-10T06:22:09.053+0000 7f282f95c7c0 -1 Falling back to public interface 2024-09-10T06:22:09.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-10T06:22:09.194+0000 7f7fa42347c0 -1 Falling back to public interface 2024-09-10T06:22:09.384 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-10T06:22:09.382+0000 7ffa4a6317c0 -1 Falling back to public interface 2024-09-10T06:22:09.766 INFO:tasks.ceph.mgr.x.smithi117.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T06:22:09.766 INFO:tasks.ceph.mgr.x.smithi117.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T06:22:09.766 INFO:tasks.ceph.mgr.x.smithi117.stderr: from numpy import show_config as show_numpy_config 2024-09-10T06:22:09.876 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-10T06:22:09.874+0000 7fdad862d7c0 -1 Falling back to public interface 2024-09-10T06:22:12.752 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-09-10T06:22:12.750+0000 7f1137480640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T06:22:12.861 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-09-10T06:22:12.861+0000 7f282f95c7c0 -1 osd.0 0 log_to_monitors true 2024-09-10T06:22:13.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-10T06:22:13.198+0000 7f7fa42347c0 -1 osd.1 0 log_to_monitors true 2024-09-10T06:22:13.906 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-10T06:22:13.906+0000 7ffa4a6317c0 -1 osd.3 0 log_to_monitors true 2024-09-10T06:22:14.153 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-10T06:22:14.149+0000 7fdad862d7c0 -1 osd.2 0 log_to_monitors true 2024-09-10T06:22:15.239 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:15.351 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec7471b640 1 Processor -- start 2024-09-10T06:22:15.351 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec7471b640 1 -- start start 2024-09-10T06:22:15.352 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec7471b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec6c12bfe0 0x7fec6c12c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:15.352 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec7471b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec6c12bc50 con 0x7fec6c12c900 2024-09-10T06:22:15.352 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec7471b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fec6c0691a0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.352 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec724b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec6c12bfe0 0x7fec6c12c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:15.353 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec724b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec6c12bfe0 0x7fec6c12c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43690/0 (socket says 172.21.15.84:43690) 2024-09-10T06:22:15.353 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec724b7640 1 -- 172.21.15.84:0/538916378 learned_addr learned my addr 172.21.15.84:0/538916378 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:15.353 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec71cb6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec6c12c900 0x7fec6c1151b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45346/0 (socket says 172.21.15.84:45346) 2024-09-10T06:22:15.353 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec724b7640 1 -- 172.21.15.84:0/538916378 >> v1:172.21.15.84:6789/0 conn(0x7fec6c12c900 legacy=0x7fec6c1151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:15.353 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.349+0000 7fec724b7640 1 -- 172.21.15.84:0/538916378 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c073870 con 0x7fec6c12bfe0 2024-09-10T06:22:15.355 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec724b7640 1 --2- 172.21.15.84:0/538916378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c12c3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec680097f0 tx=0x7fec6801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76392c73ee47f70b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:15.355 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec714b5640 1 -- 172.21.15.84:0/538916378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec680b0070 con 0x7fec6c12bfe0 2024-09-10T06:22:15.355 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec714b5640 1 -- 172.21.15.84:0/538916378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680ab530 con 0x7fec6c12bfe0 2024-09-10T06:22:15.355 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec714b5640 1 -- 172.21.15.84:0/538916378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec680ab830 con 0x7fec6c12bfe0 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 -- 172.21.15.84:0/538916378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 msgr2=0x7fec6c12c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 --2- 172.21.15.84:0/538916378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c12c3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec680097f0 tx=0x7fec6801c4c0 comp rx=0 tx=0).stop 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 -- 172.21.15.84:0/538916378 shutdown_connections 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 --2- 172.21.15.84:0/538916378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c12c3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 -- 172.21.15.84:0/538916378 >> 172.21.15.84:0/538916378 conn(0x7fec6c070630 msgr2=0x7fec6c072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 -- 172.21.15.84:0/538916378 shutdown_connections 2024-09-10T06:22:15.356 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.353+0000 7fec7471b640 1 -- 172.21.15.84:0/538916378 wait complete. 2024-09-10T06:22:15.357 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 Processor -- start 2024-09-10T06:22:15.357 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 -- start start 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c1378e0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec724b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec724b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43692/0 (socket says 172.21.15.84:43692) 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec724b7640 1 -- 172.21.15.84:0/1839095999 learned_addr learned my addr 172.21.15.84:0/1839095999 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:15.358 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec724b7640 1 -- 172.21.15.84:0/1839095999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c134e50 con 0x7fec6c12bfe0 2024-09-10T06:22:15.359 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec724b7640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec6801a0f0 tx=0x7fec68019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:15.359 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec680b0040 con 0x7fec6c12bfe0 2024-09-10T06:22:15.359 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680abdc0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.359 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c117910 con 0x7fec6c12bfe0 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec680b45b0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c125200 con 0x7fec6c12bfe0 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) ==== 48276+0+0 (secure 0 0 0) 0x7fec680bb020 con 0x7fec6c12bfe0 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c117740 con 0x7fec6c12bfe0 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 0x7fec5003d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:15.360 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1591+0+0 (secure 0 0 0) 0x7fec680b9020 con 0x7fec6c12bfe0 2024-09-10T06:22:15.361 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.357+0000 7fec71cb6640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 0x7fec5003d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:15.361 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.361+0000 7fec71cb6640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 0x7fec5003d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001640 tx=0x7fec5c007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:15.365 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.365+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fec680c2020 con 0x7fec6c12bfe0 2024-09-10T06:22:15.607 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.605+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec6c12c3c0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.607 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.605+0000 7fec62ffd640 1 -- 172.21.15.84:0/1839095999 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fec680160b0 con 0x7fec6c12bfe0 2024-09-10T06:22:15.607 INFO:teuthology.misc.health.smithi084.stdout: 2024-09-10T06:22:15.608 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":8,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:14.800095+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 msgr2=0x7fec5003d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 0x7fec5003d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec5c001640 tx=0x7fec5c007a30 comp rx=0 tx=0).stop 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 msgr2=0x7fec6c124af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec6801a0f0 tx=0x7fec68019260 comp rx=0 tx=0).stop 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 shutdown_connections 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fec5003b140 0x7fec5003d600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 --2- 172.21.15.84:0/1839095999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec6c12bfe0 0x7fec6c124af0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 >> 172.21.15.84:0/1839095999 conn(0x7fec6c070630 msgr2=0x7fec6c1286a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:15.610 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 shutdown_connections 2024-09-10T06:22:15.611 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:15.609+0000 7fec7471b640 1 -- 172.21.15.84:0/1839095999 wait complete. 2024-09-10T06:22:15.626 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T06:22:15.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-10T06:22:15.785+0000 7f7fa01dd640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T06:22:15.813 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-09-10T06:22:15.813+0000 7f282c117640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T06:22:15.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-10T06:22:15.829+0000 7f7f9800f640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:22:15.841 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-09-10T06:22:15.841+0000 7f2823737640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:22:17.203 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-10T06:22:17.201+0000 7fdad45d6640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T06:22:17.209 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-10T06:22:17.205+0000 7ffa465da640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T06:22:17.235 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-10T06:22:17.233+0000 7fdacc408640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:22:17.243 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-10T06:22:17.241+0000 7ffa3e40c640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:22:22.030 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:22.153 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7be06d640 1 Processor -- start 2024-09-10T06:22:22.154 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7be06d640 1 -- start start 2024-09-10T06:22:22.154 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7be06d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7b8129bc0 0x7fc7b8129fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.154 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7be06d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b81149a0 con 0x7fc7b812a4e0 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7be06d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b81142f0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7b8129bc0 0x7fc7b8129fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b6ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc7b812a4e0 0x7fc7b812cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59524/0 (socket says 172.21.15.84:59524) 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b6ffd640 1 -- 172.21.15.84:0/443448846 learned_addr learned my addr 172.21.15.84:0/443448846 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b77fe640 1 -- 172.21.15.84:0/443448846 >> v1:172.21.15.84:6789/0 conn(0x7fc7b812a4e0 legacy=0x7fc7b812cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b77fe640 1 -- 172.21.15.84:0/443448846 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b8113ae0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.155 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.153+0000 7fc7b67fc640 1 -- 172.21.15.84:0/443448846 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504446637 0 0) 0x7fc7b81149a0 con 0x7fc7b812a4e0 2024-09-10T06:22:22.157 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 --2- 172.21.15.84:0/443448846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b8129fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009740 tx=0x7fc7a801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e46c4915731079 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.157 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b67fc640 1 -- 172.21.15.84:0/443448846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a80b0070 con 0x7fc7b8129bc0 2024-09-10T06:22:22.157 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b67fc640 1 -- 172.21.15.84:0/443448846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a80ab530 con 0x7fc7b8129bc0 2024-09-10T06:22:22.157 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b67fc640 1 -- 172.21.15.84:0/443448846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a80ab830 con 0x7fc7b8129bc0 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/443448846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 msgr2=0x7fc7b8129fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 --2- 172.21.15.84:0/443448846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b8129fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009740 tx=0x7fc7a801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/443448846 shutdown_connections 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 --2- 172.21.15.84:0/443448846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b8129fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/443448846 >> 172.21.15.84:0/443448846 conn(0x7fc7b8072020 msgr2=0x7fc7b8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/443448846 shutdown_connections 2024-09-10T06:22:22.158 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/443448846 wait complete. 2024-09-10T06:22:22.159 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 Processor -- start 2024-09-10T06:22:22.159 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- start start 2024-09-10T06:22:22.160 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.160 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81140b0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.160 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.160 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47296/0 (socket says 172.21.15.84:47296) 2024-09-10T06:22:22.160 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 -- 172.21.15.84:0/3490119932 learned_addr learned my addr 172.21.15.84:0/3490119932 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 -- 172.21.15.84:0/3490119932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b8115170 con 0x7fc7b8129bc0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7b77fe640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8019fa0 tx=0x7fc7a801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a80b0050 con 0x7fc7b8129bc0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a80b1040 con 0x7fc7b8129bc0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a80aab40 con 0x7fc7b8129bc0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b81162c0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.161 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.157+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b8131c20 con 0x7fc7b8129bc0 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc7a80be030 con 0x7fc7b8129bc0 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b8132c30 con 0x7fc7b8129bc0 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc79ffff640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 0x7fc7a403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fc7a80bc070 con 0x7fc7b8129bc0 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc7b6ffd640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 0x7fc7a403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.162 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.161+0000 7fc7b6ffd640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 0x7fc7a403d6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac007fd0 tx=0x7fc7ac007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.166 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.165+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc7a80c5020 con 0x7fc7b8129bc0 2024-09-10T06:22:22.327 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.325+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7b81276a0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.328 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.325+0000 7fc79ffff640 1 -- 172.21.15.84:0/3490119932 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8003 (secure 0 0 0) 0x7fc7b81276a0 con 0x7fc7b8129bc0 2024-09-10T06:22:22.328 INFO:teuthology.misc.health.smithi084.stdout: 2024-09-10T06:22:22.328 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":13,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:19.831115+0000","last_up_change":"2024-09-10T06:22:17.828893+0000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:22:17.788831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6801","nonce":3404052370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6803","nonce":3404052370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6807","nonce":3404052370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6805","nonce":3404052370}]},"public_addr":"172.21.15.84:6801/3404052370","cluster_addr":"172.21.15.84:6803/3404052370","heartbeat_back_addr":"172.21.15.84:6807/3404052370","heartbeat_front_addr":"172.21.15.84:6805/3404052370","state":["exists","up"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6801","nonce":2871996333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6803","nonce":2871996333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6807","nonce":2871996333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6805","nonce":2871996333}]},"public_addr":"172.21.15.117:6801/2871996333","cluster_addr":"172.21.15.117:6803/2871996333","heartbeat_back_addr":"172.21.15.117:6807/2871996333","heartbeat_front_addr":"172.21.15.117:6805/2871996333","state":["exists","up"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6817","nonce":4244172515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6819","nonce":4244172515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6823","nonce":4244172515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6821","nonce":4244172515}]},"public_addr":"172.21.15.117:6817/4244172515","cluster_addr":"172.21.15.117:6819/4244172515","heartbeat_back_addr":"172.21.15.117:6823/4244172515","heartbeat_front_addr":"172.21.15.117:6821/4244172515","state":["exists","up"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6809","nonce":266380039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6811","nonce":266380039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6815","nonce":266380039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6813","nonce":266380039}]},"public_addr":"172.21.15.117:6809/266380039","cluster_addr":"172.21.15.117:6811/266380039","heartbeat_back_addr":"172.21.15.117:6815/266380039","heartbeat_front_addr":"172.21.15.117:6813/266380039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:13.858277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.218064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:15.181465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.860325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 msgr2=0x7fc7a403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 0x7fc7a403d6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac007fd0 tx=0x7fc7ac007900 comp rx=0 tx=0).stop 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 msgr2=0x7fc7b81316e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8019fa0 tx=0x7fc7a801abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 shutdown_connections 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc7a403b200 0x7fc7a403d6c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 --2- 172.21.15.84:0/3490119932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7b8129bc0 0x7fc7b81316e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 >> 172.21.15.84:0/3490119932 conn(0x7fc7b8072020 msgr2=0x7fc7b8111da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 shutdown_connections 2024-09-10T06:22:22.331 INFO:teuthology.misc.health.smithi084.stderr:2024-09-10T06:22:22.329+0000 7fc7be06d640 1 -- 172.21.15.84:0/3490119932 wait complete. 2024-09-10T06:22:22.345 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-10T06:22:22.345 INFO:tasks.ceph:Creating RBD pool 2024-09-10T06:22:22.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T06:22:22.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23fbd5640 1 Processor -- start 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23fbd5640 1 -- start start 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23fbd5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc23809a190 0x7fc238131400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23fbd5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23806df00 con 0x7fc23812be20 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23fbd5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc2380981a0 con 0x7fc23809a190 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d971640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc23812be20 0x7fc23812c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59536/0 (socket says 172.21.15.84:59536) 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d971640 1 -- 172.21.15.84:0/3960672054 learned_addr learned my addr 172.21.15.84:0/3960672054 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d170640 1 --2- 172.21.15.84:0/3960672054 >> v2:172.21.15.84:3300/0 conn(0x7fc23809a190 0x7fc238131400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23c96f640 1 -- 172.21.15.84:0/3960672054 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382243249 0 0) 0x7fc23806df00 con 0x7fc23812be20 2024-09-10T06:22:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23c96f640 1 -- 172.21.15.84:0/3960672054 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc224003530 con 0x7fc23812be20 2024-09-10T06:22:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d170640 1 -- 172.21.15.84:0/3960672054 >> v1:172.21.15.84:6789/0 conn(0x7fc23812be20 legacy=0x7fc23812c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d170640 1 -- 172.21.15.84:0/3960672054 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc238099b90 con 0x7fc23809a190 2024-09-10T06:22:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23d170640 1 --2- 172.21.15.84:0/3960672054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc238131400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc234009740 tx=0x7fc23401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e382779806ed1571 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.461+0000 7fc23c96f640 1 -- 172.21.15.84:0/3960672054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2340b0070 con 0x7fc23809a190 2024-09-10T06:22:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23c96f640 1 -- 172.21.15.84:0/3960672054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2340ab530 con 0x7fc23809a190 2024-09-10T06:22:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23c96f640 1 -- 172.21.15.84:0/3960672054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2340ab810 con 0x7fc23809a190 2024-09-10T06:22:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/3960672054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 msgr2=0x7fc238131400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/3960672054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc238131400 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc234009740 tx=0x7fc23401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/3960672054 shutdown_connections 2024-09-10T06:22:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/3960672054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc238131400 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/3960672054 >> 172.21.15.84:0/3960672054 conn(0x7fc23809a930 msgr2=0x7fc23809ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/3960672054 shutdown_connections 2024-09-10T06:22:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/3960672054 wait complete. 2024-09-10T06:22:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 Processor -- start 2024-09-10T06:22:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- start start 2024-09-10T06:22:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2381344f0 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23d971640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23d971640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47310/0 (socket says 172.21.15.84:47310) 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23d971640 1 -- 172.21.15.84:0/2669373747 learned_addr learned my addr 172.21.15.84:0/2669373747 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23d971640 1 -- 172.21.15.84:0/2669373747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc238091210 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23d971640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc22800c450 tx=0x7fc22800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc228017070 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc228005ce0 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23808f7d0 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc228007200 con 0x7fc23809a190 2024-09-10T06:22:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2380914b0 con 0x7fc23809a190 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc22801a070 con 0x7fc23809a190 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23808f200 con 0x7fc23809a190 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 0x7fc21c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.465+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fc22804dec0 con 0x7fc23809a190 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.469+0000 7fc23d170640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 0x7fc21c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.469+0000 7fc23d170640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 0x7fc21c03d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ad000 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:22.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.473+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc238091210 con 0x7fc23809a190 2024-09-10T06:22:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.641+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc238090860 con 0x7fc23809a190 2024-09-10T06:22:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc22e7fc640 1 -- 172.21.15.84:0/2669373747 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7fc228012400 con 0x7fc23809a190 2024-09-10T06:22:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2024-09-10T06:22:22.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 msgr2=0x7fc21c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 0x7fc21c03d6c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ad000 tx=0x7fc234008040 comp rx=0 tx=0).stop 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 msgr2=0x7fc23808e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc22800c450 tx=0x7fc22800c910 comp rx=0 tx=0).stop 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 shutdown_connections 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc21c03b200 0x7fc21c03d6c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 --2- 172.21.15.84:0/2669373747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23809a190 0x7fc23808e090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 >> 172.21.15.84:0/2669373747 conn(0x7fc23809a930 msgr2=0x7fc23806e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 shutdown_connections 2024-09-10T06:22:22.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:22.845+0000 7fc23fbd5640 1 -- 172.21.15.84:0/2669373747 wait complete. 2024-09-10T06:22:22.866 DEBUG:teuthology.orchestra.run.smithi084:> rbd --cluster ceph pool init rbd 2024-09-10T06:22:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:23.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3da071100 1 Processor -- start 2024-09-10T06:22:23.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3da071100 1 -- start start 2024-09-10T06:22:23.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3da071100 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5627b4271fc0 0x5627b4323630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:23.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3da071100 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5627b40ddc50 con 0x5627b431e480 2024-09-10T06:22:23.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3da071100 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5627b415e600 con 0x5627b4271fc0 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d8379640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5627b4271fc0 0x5627b4323630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d8b7a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5627b431e480 0x5627b431e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59546/0 (socket says 172.21.15.84:59546) 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d8b7a640 1 -- 172.21.15.84:0/1232138967 learned_addr learned my addr 172.21.15.84:0/1232138967 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d8379640 1 -- 172.21.15.84:0/1232138967 >> v1:172.21.15.84:6789/0 conn(0x5627b431e480 legacy=0x5627b431e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d7b78640 1 -- 172.21.15.84:0/1232138967 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404643510 0 0) 0x5627b40ddc50 con 0x5627b431e480 2024-09-10T06:22:23.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.221+0000 7fa3d8379640 1 -- 172.21.15.84:0/1232138967 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4288c70 con 0x5627b4271fc0 2024-09-10T06:22:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d8379640 1 --2- 172.21.15.84:0/1232138967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b4323630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a480 tx=0x7fa3c801b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31273eb4ca6f750a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d7b78640 1 -- 172.21.15.84:0/1232138967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c80a55b0 con 0x5627b4271fc0 2024-09-10T06:22:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d7b78640 1 -- 172.21.15.84:0/1232138967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c80a5750 con 0x5627b4271fc0 2024-09-10T06:22:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d7b78640 1 -- 172.21.15.84:0/1232138967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c80a5a50 con 0x5627b4271fc0 2024-09-10T06:22:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- 172.21.15.84:0/1232138967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 msgr2=0x5627b4323630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 --2- 172.21.15.84:0/1232138967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b4323630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a480 tx=0x7fa3c801b6a0 comp rx=0 tx=0).stop 2024-09-10T06:22:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- 172.21.15.84:0/1232138967 shutdown_connections 2024-09-10T06:22:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 --2- 172.21.15.84:0/1232138967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b4323630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- 172.21.15.84:0/1232138967 >> 172.21.15.84:0/1232138967 conn(0x5627b42909c0 msgr2=0x5627b4290dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- 172.21.15.84:0/1232138967 shutdown_connections 2024-09-10T06:22:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- 172.21.15.84:0/1232138967 wait complete. 2024-09-10T06:22:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 Processor -- start 2024-09-10T06:22:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- start start 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3da071100 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5627b41625b0 con 0x5627b4271fc0 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d8b7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d8b7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47330/0 (socket says 172.21.15.84:47330) 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d8b7a640 1 -- 172.21.15.84:0/1798371258 learned_addr learned my addr 172.21.15.84:0/1798371258 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.225+0000 7fa3d8b7a640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b430f4f0 con 0x5627b4271fc0 2024-09-10T06:22:23.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d8b7a640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0001e10 tx=0x7fa3c0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c000f440 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c0008070 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b430e800 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c000f750 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b430ee90 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa3c000f8f0 con 0x5627b4271fc0 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 0x7fa3b803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:23.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7fa3c004db60 con 0x5627b4271fc0 2024-09-10T06:22:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5627b430cce0 con 0x5627b4271fc0 2024-09-10T06:22:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d8379640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 0x7fa3b803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:23.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.229+0000 7fa3d8379640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 0x7fa3b803bf80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a480 tx=0x7fa3c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:23.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.849+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x5627b430f4f0 con 0x5627b4271fc0 2024-09-10T06:22:23.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.849+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3c80a5750 con 0x5627b4271fc0 2024-09-10T06:22:23.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fa3c000d300 con 0x5627b4271fc0 2024-09-10T06:22:23.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3d7377640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fa3bc002af0 con 0x5627b4271fc0 2024-09-10T06:22:23.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7fa3c0017320 con 0x5627b4271fc0 2024-09-10T06:22:23.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 0x5627b4330400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:23.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x5627b4334d80 con 0x5627b431e480 2024-09-10T06:22:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.853+0000 7fa3d9ddc640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 0x5627b4330400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.857+0000 7fa3d9ddc640 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 0x5627b4330400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:23.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.869+0000 7fa3d9ddc640 1 -- 172.21.15.84:0/1798371258 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fa3d000a4d0 con 0x5627b431e480 2024-09-10T06:22:23.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5627b4387360 con 0x5627b431e480 2024-09-10T06:22:23.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.873+0000 7fa3d9ddc640 1 -- 172.21.15.84:0/1798371258 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa3d000a4d0 con 0x5627b431e480 2024-09-10T06:22:23.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5627b4386470 con 0x5627b431e480 2024-09-10T06:22:23.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.873+0000 7fa3d9ddc640 1 -- 172.21.15.84:0/1798371258 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa3d000a4d0 con 0x5627b431e480 2024-09-10T06:22:23.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:23.873+0000 7fa3d6b76640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fa3b0001f10 con 0x5627b4271fc0 2024-09-10T06:22:24.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.853+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7fa3c0048030 con 0x5627b4271fc0 2024-09-10T06:22:24.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.853+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fa3b803f670 con 0x5627b4271fc0 2024-09-10T06:22:24.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.853+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7fa3c001a470 con 0x5627b4271fc0 2024-09-10T06:22:24.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.853+0000 7fa3d7377640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fa3bc0057f0 con 0x5627b431e480 2024-09-10T06:22:24.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.865+0000 7fa3d9ddc640 1 -- 172.21.15.84:0/1798371258 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa3d000a4d0 con 0x5627b431e480 2024-09-10T06:22:24.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:24.865+0000 7fa3d6b76640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7fa3b0003360 con 0x5627b4271fc0 2024-09-10T06:22:25.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.861+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7fa3c004b3b0 con 0x5627b4271fc0 2024-09-10T06:22:25.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.861+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fa3b803f8f0 con 0x5627b4271fc0 2024-09-10T06:22:25.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.865+0000 7fa3d5373640 1 -- 172.21.15.84:0/1798371258 <== mon.0 v2:172.21.15.84:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7fa3c00176a0 con 0x5627b4271fc0 2024-09-10T06:22:25.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.865+0000 7fa3d7377640 1 -- 172.21.15.84:0/1798371258 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fa3bc005b90 con 0x5627b431e480 2024-09-10T06:22:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3d9ddc640 1 -- 172.21.15.84:0/1798371258 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d000a4d0 con 0x5627b431e480 2024-09-10T06:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 msgr2=0x5627b4330400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 0x5627b4330400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 msgr2=0x7fa3b803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 0x7fa3b803bf80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a480 tx=0x7fa3c80a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 msgr2=0x5627b430c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0001e10 tx=0x7fa3c0009570 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 shutdown_connections 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5627b431e480 0x5627b4330400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3b8039ac0 0x7fa3b803bf80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 --2- 172.21.15.84:0/1798371258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627b4271fc0 0x5627b430c470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 >> 172.21.15.84:0/1798371258 conn(0x5627b42909c0 msgr2=0x5627b43221f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 shutdown_connections 2024-09-10T06:22:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:25.873+0000 7fa3da071100 1 -- 172.21.15.84:0/1798371258 wait complete. 2024-09-10T06:22:25.883 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T06:22:25.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T06:22:25.884 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T06:22:26.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4267e13640 1 Processor -- start 2024-09-10T06:22:26.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4267e13640 1 -- start start 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4267e13640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4260114c90 0x7f4260134980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4267e13640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42601156f0 con 0x7f42601141a0 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4267e13640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f42601164c0 con 0x7f4260114c90 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f42653ae640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4260114c90 0x7f4260134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4265baf640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f42601141a0 0x7f4260114580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47216/0 (socket says 172.21.15.84:47216) 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f4265baf640 1 -- 172.21.15.84:0/1945686789 learned_addr learned my addr 172.21.15.84:0/1945686789 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f42653ae640 1 -- 172.21.15.84:0/1945686789 >> v1:172.21.15.84:6789/0 conn(0x7f42601141a0 legacy=0x7f4260114580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.013+0000 7f42653ae640 1 -- 172.21.15.84:0/1945686789 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4260117070 con 0x7f4260114c90 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f42653ae640 1 --2- 172.21.15.84:0/1945686789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4260114c90 0x7f4260134980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4250009740 tx=0x7f425001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e01c65cf5074b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4264bad640 1 -- 172.21.15.84:0/1945686789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42500b0070 con 0x7f4260114c90 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4264bad640 1 -- 172.21.15.84:0/1945686789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42500ab530 con 0x7f4260114c90 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4264bad640 1 -- 172.21.15.84:0/1945686789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42500ab830 con 0x7f4260114c90 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- 172.21.15.84:0/1945686789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4260114c90 msgr2=0x7f4260134980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 --2- 172.21.15.84:0/1945686789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4260114c90 0x7f4260134980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4250009740 tx=0x7f425001c400 comp rx=0 tx=0).stop 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- 172.21.15.84:0/1945686789 shutdown_connections 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 --2- 172.21.15.84:0/1945686789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4260114c90 0x7f4260134980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- 172.21.15.84:0/1945686789 >> 172.21.15.84:0/1945686789 conn(0x7f426006f980 msgr2=0x7f4260071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- 172.21.15.84:0/1945686789 shutdown_connections 2024-09-10T06:22:26.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- 172.21.15.84:0/1945686789 wait complete. 2024-09-10T06:22:26.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 Processor -- start 2024-09-10T06:22:26.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- start start 2024-09-10T06:22:26.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4267e13640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4260137860 con 0x7f42601141a0 2024-09-10T06:22:26.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4265baf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4265baf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58142/0 (socket says 172.21.15.84:58142) 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.017+0000 7f4265baf640 1 -- 172.21.15.84:0/2871957258 learned_addr learned my addr 172.21.15.84:0/2871957258 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f4265baf640 1 -- 172.21.15.84:0/2871957258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4260133120 con 0x7f42601141a0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f4265baf640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f425c00cbd0 tx=0x7f425c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f425c017070 con 0x7f42601141a0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c00abc0 con 0x7f42601141a0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f425c012400 con 0x7f42601141a0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4260072940 con 0x7f42601141a0 2024-09-10T06:22:26.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4260132600 con 0x7f42601141a0 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f425c01a070 con 0x7f42601141a0 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4260132400 con 0x7f42601141a0 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 0x7f424403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f425c04ec30 con 0x7f42601141a0 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42653ae640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 0x7f424403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.021+0000 7f42653ae640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 0x7f424403d690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42500ad000 tx=0x7f42500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.025+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f425c055080 con 0x7f42601141a0 2024-09-10T06:22:26.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.197+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f4260114580 con 0x7f42601141a0 2024-09-10T06:22:26.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.197+0000 7f42567fc640 1 -- 172.21.15.84:0/2871957258 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f4260133120 con 0x7f42601141a0 2024-09-10T06:22:26.199 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 msgr2=0x7f424403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 0x7f424403d690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42500ad000 tx=0x7f42500a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 msgr2=0x7f4260130960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f425c00cbd0 tx=0x7f425c00a430 comp rx=0 tx=0).stop 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 shutdown_connections 2024-09-10T06:22:26.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f424403b1d0 0x7f424403d690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 --2- 172.21.15.84:0/2871957258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42601141a0 0x7f4260130960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 >> 172.21.15.84:0/2871957258 conn(0x7f426006f980 msgr2=0x7f426012bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 shutdown_connections 2024-09-10T06:22:26.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.201+0000 7f4267e13640 1 -- 172.21.15.84:0/2871957258 wait complete. 2024-09-10T06:22:26.218 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":5,"timestamp":"2024-09-10T06:22:17.211785+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"6037.949175"}]}] 2024-09-10T06:22:26.218 INFO:tasks.ceph_manager:config epoch is 5 2024-09-10T06:22:26.218 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T06:22:26.218 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T06:22:26.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T06:22:26.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.333+0000 7f446ff8b640 1 Processor -- start 2024-09-10T06:22:26.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.333+0000 7f446ff8b640 1 -- start start 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f446812aee0 0x7f446812b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44680008e0 con 0x7f446812f110 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4468071e70 con 0x7f446812aee0 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446dd27640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f446812aee0 0x7f446812b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446d526640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f446812f110 0x7f446812f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47230/0 (socket says 172.21.15.84:47230) 2024-09-10T06:22:26.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446d526640 1 -- 172.21.15.84:0/265313743 learned_addr learned my addr 172.21.15.84:0/265313743 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:26.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446dd27640 1 -- 172.21.15.84:0/265313743 >> v1:172.21.15.84:6789/0 conn(0x7f446812f110 legacy=0x7f446812f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446dd27640 1 -- 172.21.15.84:0/265313743 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680a30b0 con 0x7f446812aee0 2024-09-10T06:22:26.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446cd25640 1 -- 172.21.15.84:0/265313743 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830222339 0 0) 0x7f44680008e0 con 0x7f446812f110 2024-09-10T06:22:26.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446dd27640 1 --2- 172.21.15.84:0/265313743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f446812b2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4458009740 tx=0x7f445801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6867d55b5065757 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446cd25640 1 -- 172.21.15.84:0/265313743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44580b1070 con 0x7f446812aee0 2024-09-10T06:22:26.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446cd25640 1 -- 172.21.15.84:0/265313743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44580ac520 con 0x7f446812aee0 2024-09-10T06:22:26.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446cd25640 1 -- 172.21.15.84:0/265313743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44580ac820 con 0x7f446812aee0 2024-09-10T06:22:26.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- 172.21.15.84:0/265313743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 msgr2=0x7f446812b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 --2- 172.21.15.84:0/265313743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f446812b2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4458009740 tx=0x7f445801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:26.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- 172.21.15.84:0/265313743 shutdown_connections 2024-09-10T06:22:26.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 --2- 172.21.15.84:0/265313743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f446812b2c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- 172.21.15.84:0/265313743 >> 172.21.15.84:0/265313743 conn(0x7f44680a0a60 msgr2=0x7f446806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- 172.21.15.84:0/265313743 shutdown_connections 2024-09-10T06:22:26.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.337+0000 7f446ff8b640 1 -- 172.21.15.84:0/265313743 wait complete. 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 Processor -- start 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 -- start start 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f446812b980 con 0x7f446812aee0 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446dd27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446dd27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58166/0 (socket says 172.21.15.84:58166) 2024-09-10T06:22:26.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446dd27640 1 -- 172.21.15.84:0/3712254714 learned_addr learned my addr 172.21.15.84:0/3712254714 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446dd27640 1 -- 172.21.15.84:0/3712254714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446811cc70 con 0x7f446812aee0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446dd27640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f445801aa20 tx=0x7f445801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44580b1050 con 0x7f446812aee0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44580b2040 con 0x7f446812aee0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44580b6870 con 0x7f446812aee0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446811c0d0 con 0x7f446812aee0 2024-09-10T06:22:26.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446811c7b0 con 0x7f446812aee0 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446811b3d0 con 0x7f446812aee0 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f44580bf030 con 0x7f446812aee0 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 0x7f444c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f44580bd070 con 0x7f446812aee0 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.341+0000 7f446d526640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 0x7f444c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.345+0000 7f446d526640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 0x7f444c03d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4464007fd0 tx=0x7f4464007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.345+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f44580c6020 con 0x7f446812aee0 2024-09-10T06:22:26.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.553+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f446812b2c0 con 0x7f446812aee0 2024-09-10T06:22:26.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.553+0000 7f445e7fc640 1 -- 172.21.15.84:0/3712254714 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92916 (secure 0 0 0) 0x7f44580a9070 con 0x7f446812aee0 2024-09-10T06:22:26.556 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 msgr2=0x7f444c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 0x7f444c03d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4464007fd0 tx=0x7f4464007900 comp rx=0 tx=0).stop 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 msgr2=0x7f4468119c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f445801aa20 tx=0x7f445801abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 shutdown_connections 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f444c03b1d0 0x7f444c03d690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 --2- 172.21.15.84:0/3712254714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446812aee0 0x7f4468119c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 >> 172.21.15.84:0/3712254714 conn(0x7f44680a0a60 msgr2=0x7f44680a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 shutdown_connections 2024-09-10T06:22:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.557+0000 7f446ff8b640 1 -- 172.21.15.84:0/3712254714 wait complete. 2024-09-10T06:22:26.572 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1600442043},{"type":"v1","addr":"172.21.15.117:6825","nonce":1600442043}]},"active_addr":"172.21.15.117:6825/1600442043","active_change":"2024-09-10T06:22:11.741558+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3876157796}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3350305615}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3766589197}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":876774932}]}]} 2024-09-10T06:22:26.575 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T06:22:26.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T06:22:26.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.693+0000 7fa91ba25640 1 Processor -- start 2024-09-10T06:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.693+0000 7fa91ba25640 1 -- start start 2024-09-10T06:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.693+0000 7fa91ba25640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa91412bc80 0x7fa914130510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.693+0000 7fa91ba25640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa914112e90 con 0x7fa91412b190 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.693+0000 7fa91ba25640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa914112a90 con 0x7fa91412bc80 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa918fc0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa91412bc80 0x7fa914130510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa9197c1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa91412b190 0x7fa91412b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47244/0 (socket says 172.21.15.84:47244) 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa9197c1640 1 -- 172.21.15.84:0/2588620395 learned_addr learned my addr 172.21.15.84:0/2588620395 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa918fc0640 1 -- 172.21.15.84:0/2588620395 >> v1:172.21.15.84:6789/0 conn(0x7fa91412b190 legacy=0x7fa91412b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa918fc0640 1 -- 172.21.15.84:0/2588620395 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa914131a60 con 0x7fa91412bc80 2024-09-10T06:22:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa913fff640 1 -- 172.21.15.84:0/2588620395 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250559630 0 0) 0x7fa914112e90 con 0x7fa91412b190 2024-09-10T06:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa918fc0640 1 --2- 172.21.15.84:0/2588620395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412bc80 0x7fa914130510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00a8e0 tx=0x7fa8fc01d700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1321537195558895 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa913fff640 1 -- 172.21.15.84:0/2588620395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8fc0b3070 con 0x7fa91412bc80 2024-09-10T06:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa913fff640 1 -- 172.21.15.84:0/2588620395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc0a6650 con 0x7fa91412bc80 2024-09-10T06:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa913fff640 1 -- 172.21.15.84:0/2588620395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8fc00b040 con 0x7fa91412bc80 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 -- 172.21.15.84:0/2588620395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412bc80 msgr2=0x7fa914130510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 --2- 172.21.15.84:0/2588620395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412bc80 0x7fa914130510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00a8e0 tx=0x7fa8fc01d700 comp rx=0 tx=0).stop 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 -- 172.21.15.84:0/2588620395 shutdown_connections 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 --2- 172.21.15.84:0/2588620395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412bc80 0x7fa914130510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 -- 172.21.15.84:0/2588620395 >> 172.21.15.84:0/2588620395 conn(0x7fa914070900 msgr2=0x7fa914072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 -- 172.21.15.84:0/2588620395 shutdown_connections 2024-09-10T06:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.697+0000 7fa91ba25640 1 -- 172.21.15.84:0/2588620395 wait complete. 2024-09-10T06:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 Processor -- start 2024-09-10T06:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 -- start start 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141315f0 con 0x7fa91412b190 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa9197c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa9197c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58174/0 (socket says 172.21.15.84:58174) 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa9197c1640 1 -- 172.21.15.84:0/56123780 learned_addr learned my addr 172.21.15.84:0/56123780 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa9197c1640 1 -- 172.21.15.84:0/56123780 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9141176e0 con 0x7fa91412b190 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa9197c1640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa90400bd60 tx=0x7fa90400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90400ca20 con 0x7fa91412b190 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa904010070 con 0x7fa91412b190 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91412a530 con 0x7fa91412b190 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90400cd70 con 0x7fa91412b190 2024-09-10T06:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91412ae10 con 0x7fa91412b190 2024-09-10T06:22:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa904008030 con 0x7fa91412b190 2024-09-10T06:22:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91412b570 con 0x7fa91412b190 2024-09-10T06:22:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 0x7fa8f403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa90404e990 con 0x7fa91412b190 2024-09-10T06:22:26.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.701+0000 7fa918fc0640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 0x7fa8f403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:26.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.705+0000 7fa918fc0640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 0x7fa8f403d6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0b0000 tx=0x7fa8fc0a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:26.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.705+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa9141176e0 con 0x7fa91412b190 2024-09-10T06:22:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.877+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa914068e50 con 0x7fa91412b190 2024-09-10T06:22:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.877+0000 7fa911ffb640 1 -- 172.21.15.84:0/56123780 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9903 (secure 0 0 0) 0x7fa90401cd00 con 0x7fa91412b190 2024-09-10T06:22:26.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:26.880 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:25.857395+0000","last_up_change":"2024-09-10T06:22:17.828893+0000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:22:17.788831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:22:22.651461+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6801","nonce":3404052370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6803","nonce":3404052370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6807","nonce":3404052370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6805","nonce":3404052370}]},"public_addr":"172.21.15.84:6801/3404052370","cluster_addr":"172.21.15.84:6803/3404052370","heartbeat_back_addr":"172.21.15.84:6807/3404052370","heartbeat_front_addr":"172.21.15.84:6805/3404052370","state":["exists","up"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6801","nonce":2871996333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6803","nonce":2871996333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6807","nonce":2871996333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6805","nonce":2871996333}]},"public_addr":"172.21.15.117:6801/2871996333","cluster_addr":"172.21.15.117:6803/2871996333","heartbeat_back_addr":"172.21.15.117:6807/2871996333","heartbeat_front_addr":"172.21.15.117:6805/2871996333","state":["exists","up"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6817","nonce":4244172515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6819","nonce":4244172515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6823","nonce":4244172515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6821","nonce":4244172515}]},"public_addr":"172.21.15.117:6817/4244172515","cluster_addr":"172.21.15.117:6819/4244172515","heartbeat_back_addr":"172.21.15.117:6823/4244172515","heartbeat_front_addr":"172.21.15.117:6821/4244172515","state":["exists","up"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6809","nonce":266380039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6811","nonce":266380039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6815","nonce":266380039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6813","nonce":266380039}]},"public_addr":"172.21.15.117:6809/266380039","cluster_addr":"172.21.15.117:6811/266380039","heartbeat_back_addr":"172.21.15.117:6815/266380039","heartbeat_front_addr":"172.21.15.117:6813/266380039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:13.858277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.218064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:15.181465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.860325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 msgr2=0x7fa8f403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 0x7fa8f403d6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0b0000 tx=0x7fa8fc0a8070 comp rx=0 tx=0).stop 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 msgr2=0x7fa9141c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa90400bd60 tx=0x7fa90400be50 comp rx=0 tx=0).stop 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 shutdown_connections 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa8f403b200 0x7fa8f403d6c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 --2- 172.21.15.84:0/56123780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa91412b190 0x7fa9141c6c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 >> 172.21.15.84:0/56123780 conn(0x7fa914070900 msgr2=0x7fa914070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 shutdown_connections 2024-09-10T06:22:26.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:26.881+0000 7fa91ba25640 1 -- 172.21.15.84:0/56123780 wait complete. 2024-09-10T06:22:26.897 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T06:22:26.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:22:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f321dccb640 1 Processor -- start 2024-09-10T06:22:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f321dccb640 1 -- start start 2024-09-10T06:22:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f321dccb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3218132420 0x7f3218134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f321dccb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321812b9d0 con 0x7f321812aee0 2024-09-10T06:22:27.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f321dccb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3218071e70 con 0x7f3218132420 2024-09-10T06:22:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32177fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f321812aee0 0x7f321812b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47258/0 (socket says 172.21.15.84:47258) 2024-09-10T06:22:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32177fe640 1 -- 172.21.15.84:0/543879274 learned_addr learned my addr 172.21.15.84:0/543879274 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f3216ffd640 1 --2- 172.21.15.84:0/543879274 >> v2:172.21.15.84:3300/0 conn(0x7f3218132420 0x7f3218134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32167fc640 1 -- 172.21.15.84:0/543879274 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279771938 0 0) 0x7f321812b9d0 con 0x7f321812aee0 2024-09-10T06:22:27.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32167fc640 1 -- 172.21.15.84:0/543879274 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3204003530 con 0x7f321812aee0 2024-09-10T06:22:27.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f3216ffd640 1 -- 172.21.15.84:0/543879274 >> v1:172.21.15.84:6789/0 conn(0x7f321812aee0 legacy=0x7f321812b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f3216ffd640 1 -- 172.21.15.84:0/543879274 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32180008e0 con 0x7f3218132420 2024-09-10T06:22:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f3216ffd640 1 --2- 172.21.15.84:0/543879274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3218132420 0x7f3218134810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c297ebd40074d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32167fc640 1 -- 172.21.15.84:0/543879274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000b1070 con 0x7f3218132420 2024-09-10T06:22:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32167fc640 1 -- 172.21.15.84:0/543879274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32000ac520 con 0x7f3218132420 2024-09-10T06:22:27.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.005+0000 7f32167fc640 1 -- 172.21.15.84:0/543879274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000ac820 con 0x7f3218132420 2024-09-10T06:22:27.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/543879274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3218132420 msgr2=0x7f3218134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 --2- 172.21.15.84:0/543879274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3218132420 0x7f3218134810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/543879274 shutdown_connections 2024-09-10T06:22:27.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 --2- 172.21.15.84:0/543879274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3218132420 0x7f3218134810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/543879274 >> 172.21.15.84:0/543879274 conn(0x7f32180a0a60 msgr2=0x7f321806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/543879274 shutdown_connections 2024-09-10T06:22:27.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/543879274 wait complete. 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 Processor -- start 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- start start 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3218137570 con 0x7f321812aee0 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f32177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f32177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58202/0 (socket says 172.21.15.84:58202) 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f32177fe640 1 -- 172.21.15.84:0/3242523223 learned_addr learned my addr 172.21.15.84:0/3242523223 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f32177fe640 1 -- 172.21.15.84:0/3242523223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3218073a80 con 0x7f321812aee0 2024-09-10T06:22:27.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f32177fe640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f320800c450 tx=0x7f320800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3208017070 con 0x7f321812aee0 2024-09-10T06:22:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3208005ce0 con 0x7f321812aee0 2024-09-10T06:22:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3208007200 con 0x7f321812aee0 2024-09-10T06:22:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321811b850 con 0x7f321812aee0 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321811c470 con 0x7f321812aee0 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.009+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321812b2c0 con 0x7f321812aee0 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.013+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f320801a070 con 0x7f321812aee0 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.013+0000 7f320ffff640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 0x7f31f803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.013+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f320804dff0 con 0x7f321812aee0 2024-09-10T06:22:27.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.013+0000 7f3216ffd640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 0x7f31f803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.013+0000 7f3216ffd640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 0x7f31f803d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae000 tx=0x7f3200008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.017+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3218073a80 con 0x7f321812aee0 2024-09-10T06:22:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.173+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f321811be00 con 0x7f321812aee0 2024-09-10T06:22:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.173+0000 7f320ffff640 1 -- 172.21.15.84:0/3242523223 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9903 (secure 0 0 0) 0x7f3208012400 con 0x7f321812aee0 2024-09-10T06:22:27.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:27.177 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:22:25.857395+0000","last_up_change":"2024-09-10T06:22:17.828893+0000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:22:17.788831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:22:22.651461+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6801","nonce":3404052370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6803","nonce":3404052370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6807","nonce":3404052370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6805","nonce":3404052370}]},"public_addr":"172.21.15.84:6801/3404052370","cluster_addr":"172.21.15.84:6803/3404052370","heartbeat_back_addr":"172.21.15.84:6807/3404052370","heartbeat_front_addr":"172.21.15.84:6805/3404052370","state":["exists","up"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6801","nonce":2871996333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6803","nonce":2871996333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6807","nonce":2871996333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6805","nonce":2871996333}]},"public_addr":"172.21.15.117:6801/2871996333","cluster_addr":"172.21.15.117:6803/2871996333","heartbeat_back_addr":"172.21.15.117:6807/2871996333","heartbeat_front_addr":"172.21.15.117:6805/2871996333","state":["exists","up"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6817","nonce":4244172515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6819","nonce":4244172515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6823","nonce":4244172515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6821","nonce":4244172515}]},"public_addr":"172.21.15.117:6817/4244172515","cluster_addr":"172.21.15.117:6819/4244172515","heartbeat_back_addr":"172.21.15.117:6823/4244172515","heartbeat_front_addr":"172.21.15.117:6821/4244172515","state":["exists","up"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6809","nonce":266380039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6811","nonce":266380039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6815","nonce":266380039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6813","nonce":266380039}]},"public_addr":"172.21.15.117:6809/266380039","cluster_addr":"172.21.15.117:6811/266380039","heartbeat_back_addr":"172.21.15.117:6815/266380039","heartbeat_front_addr":"172.21.15.117:6813/266380039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:13.858277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.218064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:15.181465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.860325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 msgr2=0x7f31f803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 0x7f31f803d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae000 tx=0x7f3200008040 comp rx=0 tx=0).stop 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 msgr2=0x7f3218129680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f320800c450 tx=0x7f320800c910 comp rx=0 tx=0).stop 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 shutdown_connections 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f803b1d0 0x7f31f803d690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 --2- 172.21.15.84:0/3242523223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f321812aee0 0x7f3218129680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 >> 172.21.15.84:0/3242523223 conn(0x7f32180a0a60 msgr2=0x7f32180a1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 shutdown_connections 2024-09-10T06:22:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.177+0000 7f321dccb640 1 -- 172.21.15.84:0/3242523223 wait complete. 2024-09-10T06:22:27.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T06:22:27.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T06:22:27.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T06:22:27.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T06:22:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86ff3a5640 1 Processor -- start 2024-09-10T06:22:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8d15e640 1 Processor -- start 2024-09-10T06:22:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8d15e640 1 -- start start 2024-09-10T06:22:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86ff3a5640 1 -- start start 2024-09-10T06:22:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8d15e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae8812d000 0x7fae8812d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86ff3a5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86f806dce0 0x7f86f806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8d15e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8809f7f0 con 0x7fae8812d920 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8d15e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fae8809ebb0 con 0x7fae8812d000 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86ff3a5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f8073bf0 con 0x7f86f806e600 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86ff3a5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f86f8112840 con 0x7f86f806dce0 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86fc940640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86f806e600 0x7f86f8125530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47284/0 (socket says 172.21.15.84:47284) 2024-09-10T06:22:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86fc940640 1 -- 172.21.15.84:0/584892900 learned_addr learned my addr 172.21.15.84:0/584892900 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fae8812d920 0x7fae88126780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47268/0 (socket says 172.21.15.84:47268) 2024-09-10T06:22:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae86d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fae8812d000 0x7fae8812d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae8659c640 1 -- 172.21.15.84:0/2625085858 learned_addr learned my addr 172.21.15.84:0/2625085858 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86fd141640 1 --2- 172.21.15.84:0/584892900 >> v2:172.21.15.84:3300/0 conn(0x7f86f806dce0 0x7f86f806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae85d9b640 1 -- 172.21.15.84:0/2625085858 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23058386 0 0) 0x7fae7c001120 con 0x7fae8812d920 2024-09-10T06:22:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae85d9b640 1 -- 172.21.15.84:0/2625085858 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae70003530 con 0x7fae8812d920 2024-09-10T06:22:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86fd141640 1 -- 172.21.15.84:0/584892900 >> v1:172.21.15.84:6789/0 conn(0x7f86f806e600 legacy=0x7f86f8125530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86fd141640 1 -- 172.21.15.84:0/584892900 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f8112b70 con 0x7f86f806dce0 2024-09-10T06:22:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f86effff640 1 -- 172.21.15.84:0/584892900 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273346367 0 0) 0x7f86f8073bf0 con 0x7f86f806e600 2024-09-10T06:22:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cf2263640 1 Processor -- start 2024-09-10T06:22:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cf2263640 1 -- start start 2024-09-10T06:22:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cf2263640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cec09ee60 0x7f5cec132870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae86d9d640 1 -- 172.21.15.84:0/2625085858 >> v1:172.21.15.84:6789/0 conn(0x7fae8812d920 legacy=0x7fae88126780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae86d9d640 1 -- 172.21.15.84:0/2625085858 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8809f430 con 0x7fae8812d000 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cf2263640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec06df20 con 0x7f5cec09e370 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cf2263640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec06e340 con 0x7f5cec09ee60 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5ceb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cec09ee60 0x7f5cec132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5ceb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cec09ee60 0x7f5cec132870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58234/0 (socket says 172.21.15.84:58234) 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5cebfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5cec09e370 0x7f5cec09e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47286/0 (socket says 172.21.15.84:47286) 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7f5ceb7fe640 1 -- 172.21.15.84:0/3635213447 learned_addr learned my addr 172.21.15.84:0/3635213447 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.301+0000 7fae86d9d640 1 --2- 172.21.15.84:0/2625085858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae78009740 tx=0x7fae7801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b705f48af3de9a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceb7fe640 1 -- 172.21.15.84:0/3635213447 >> v1:172.21.15.84:6789/0 conn(0x7f5cec09e370 legacy=0x7f5cec09e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceb7fe640 1 -- 172.21.15.84:0/3635213447 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec073b20 con 0x7f5cec09ee60 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae85d9b640 1 -- 172.21.15.84:0/2625085858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae780b0070 con 0x7fae8812d000 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae85d9b640 1 -- 172.21.15.84:0/2625085858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780ab530 con 0x7fae8812d000 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae85d9b640 1 -- 172.21.15.84:0/2625085858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae780ab830 con 0x7fae8812d000 2024-09-10T06:22:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86fd141640 1 --2- 172.21.15.84:0/584892900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f806e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009740 tx=0x7f86f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0627cb8424ce6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- 172.21.15.84:0/2625085858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 msgr2=0x7fae8812d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 --2- 172.21.15.84:0/2625085858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae78009740 tx=0x7fae7801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- 172.21.15.84:0/2625085858 shutdown_connections 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 --2- 172.21.15.84:0/2625085858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812d3e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- 172.21.15.84:0/2625085858 >> 172.21.15.84:0/2625085858 conn(0x7fae88071e50 msgr2=0x7fae88072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86effff640 1 -- 172.21.15.84:0/584892900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f40b1070 con 0x7f86f806dce0 2024-09-10T06:22:27.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86effff640 1 -- 172.21.15.84:0/584892900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f40ac570 con 0x7f86f806dce0 2024-09-10T06:22:27.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- 172.21.15.84:0/2625085858 shutdown_connections 2024-09-10T06:22:27.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86effff640 1 -- 172.21.15.84:0/584892900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f40ac870 con 0x7f86f806dce0 2024-09-10T06:22:27.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- 172.21.15.84:0/2625085858 wait complete. 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- 172.21.15.84:0/584892900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 msgr2=0x7f86f806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/584892900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f806e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009740 tx=0x7f86f401c400 comp rx=0 tx=0).stop 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- 172.21.15.84:0/584892900 shutdown_connections 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/584892900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f806e0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- 172.21.15.84:0/584892900 >> 172.21.15.84:0/584892900 conn(0x7f86f80709b0 msgr2=0x7f86f8072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- 172.21.15.84:0/584892900 shutdown_connections 2024-09-10T06:22:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- 172.21.15.84:0/584892900 wait complete. 2024-09-10T06:22:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 Processor -- start 2024-09-10T06:22:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- start start 2024-09-10T06:22:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 Processor -- start 2024-09-10T06:22:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae8d15e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae8806edf0 con 0x7fae8812d000 2024-09-10T06:22:27.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceb7fe640 1 --2- 172.21.15.84:0/3635213447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09ee60 0x7f5cec132870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097f0 tx=0x7f5ce001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b0649c567cf3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- start start 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae86d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae86d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58242/0 (socket says 172.21.15.84:58242) 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae86d9d640 1 -- 172.21.15.84:0/407238943 learned_addr learned my addr 172.21.15.84:0/407238943 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceaffd640 1 -- 172.21.15.84:0/3635213447 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00b0070 con 0x7f5cec09ee60 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceaffd640 1 -- 172.21.15.84:0/3635213447 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00ab530 con 0x7f5cec09ee60 2024-09-10T06:22:27.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f5ceaffd640 1 -- 172.21.15.84:0/3635213447 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00ab830 con 0x7f5cec09ee60 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86ff3a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8137940 con 0x7f86f806dce0 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae86d9d640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88117050 con 0x7fae8812d000 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86fd141640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86fd141640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58254/0 (socket says 172.21.15.84:58254) 2024-09-10T06:22:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7f86fd141640 1 -- 172.21.15.84:0/2549749814 learned_addr learned my addr 172.21.15.84:0/2549749814 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.305+0000 7fae86d9d640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae78019fa0 tx=0x7fae7801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae780b0050 con 0x7fae8812d000 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780b1040 con 0x7fae8812d000 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae88117380 con 0x7fae8812d000 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3635213447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09ee60 msgr2=0x7f5cec132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3635213447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09ee60 0x7f5cec132870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097f0 tx=0x7f5ce001c3d0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86fd141640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f81354c0 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86fd141640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86f401a030 tx=0x7f86f401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f40b1050 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f8134dc0 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f40b2040 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f8133230 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86f40b1050 con 0x7f86f806dce0 2024-09-10T06:22:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3635213447 shutdown_connections 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3635213447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09ee60 0x7f5cec132870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3635213447 >> 172.21.15.84:0/3635213447 conn(0x7f5cec071650 msgr2=0x7f5cec09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae780b5740 con 0x7fae8812d000 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae88116a10 con 0x7fae8812d000 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae881316d0 con 0x7fae8812d000 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3635213447 shutdown_connections 2024-09-10T06:22:27.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3635213447 wait complete. 2024-09-10T06:22:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86d8000f90 con 0x7f86f806dce0 2024-09-10T06:22:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 Processor -- start 2024-09-10T06:22:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- start start 2024-09-10T06:22:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f86f40bf030 con 0x7f86f806dce0 2024-09-10T06:22:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fae780be030 con 0x7fae8812d000 2024-09-10T06:22:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 0x7fae7403d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fae780bc070 con 0x7fae8812d000 2024-09-10T06:22:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 0x7f86dc03da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f86f40bd070 con 0x7f86f806dce0 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 0x7fae74042e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae780c0e50 con 0x7fae740409a0 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fae780eb3b0 con 0x7fae8812d000 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1357e0 con 0x7f5cec09e370 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 0x7f86dc043160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86f40ac570 con 0x7f86dc040ce0 2024-09-10T06:22:27.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f86f40ed2a0 con 0x7f86f806dce0 2024-09-10T06:22:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86fd942640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 0x7f86dc043160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58270/0 (socket says 172.21.15.84:58270) 2024-09-10T06:22:27.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cebfff640 1 -- 172.21.15.84:0/3342544989 learned_addr learned my addr 172.21.15.84:0/3342544989 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8759e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 0x7fae74042e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86fc940640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 0x7f86dc03da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8659c640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 0x7fae7403d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cebfff640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec116b40 con 0x7f5cec09e370 2024-09-10T06:22:27.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f86fd942640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 0x7f86dc043160 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cebfff640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c480 tx=0x7f5cdc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cdc007410 con 0x7f5cec09e370 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0075b0 con 0x7f5cec09e370 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec127a30 con 0x7f5cec09e370 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cdc004920 con 0x7f5cec09e370 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec116e70 con 0x7f5cec09e370 2024-09-10T06:22:27.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f86fc940640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 0x7f86dc03da20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.309+0000 7fae8759e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 0x7fae74042e20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5cec09e750 con 0x7f5cec09e370 2024-09-10T06:22:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7fae8659c640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 0x7fae7403d6e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae7c001690 tx=0x7fae7c001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86f40ac570 con 0x7f86dc040ce0 2024-09-10T06:22:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5cdc01a020 con 0x7f5cec09e370 2024-09-10T06:22:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 0x7f5cd803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f5cdc04e550 con 0x7f5cec09e370 2024-09-10T06:22:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 0x7f5cd8042e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cd80434d0 con 0x7f5cd8040980 2024-09-10T06:22:27.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc055050 con 0x7f5cec09e370 2024-09-10T06:22:27.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ceb7fe640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 0x7f5cd803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5cf0800640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 0x7f5cd8042e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae780c0e50 con 0x7fae740409a0 2024-09-10T06:22:27.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5cf0800640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 0x7f5cd8042e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.313+0000 7f5ceb7fe640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 0x7f5cd803d6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ad000 tx=0x7f5ce00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.317+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5cd80434d0 con 0x7f5cd8040980 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.321+0000 7f99fb66c640 1 Processor -- start 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.321+0000 7f99fb66c640 1 -- start start 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99fb66c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99f406dce0 0x7f99f406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99fb66c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f4073b10 con 0x7f99f4113620 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99fb66c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f99f4114a30 con 0x7f99f406dce0 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99f8c07640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99f4113620 0x7f99f4123350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47294/0 (socket says 172.21.15.84:47294) 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99f8c07640 1 -- 172.21.15.84:0/865203338 learned_addr learned my addr 172.21.15.84:0/865203338 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99f9408640 1 --2- 172.21.15.84:0/865203338 >> v2:172.21.15.84:3300/0 conn(0x7f99f406dce0 0x7f99f406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477464080 0 0) 0x7f99f4073b10 con 0x7f99f4113620 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99e0003530 con 0x7f99f4113620 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99f9408640 1 -- 172.21.15.84:0/865203338 >> v1:172.21.15.84:6789/0 conn(0x7f99f4113620 legacy=0x7f99f4123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99f9408640 1 -- 172.21.15.84:0/865203338 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f4114d60 con 0x7f99f406dce0 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781652757 0 0) 0x7f99e0003530 con 0x7f99f4113620 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.325+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae8812d3e0 con 0x7fae740409a0 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae6f7fe640 1 -- 172.21.15.84:0/407238943 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae8812d3e0 con 0x7fae740409a0 2024-09-10T06:22:27.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86d8002c80 con 0x7f86dc040ce0 2024-09-10T06:22:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99f9408640 1 --2- 172.21.15.84:0/865203338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f406dce0 0x7f99f406e0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099a0 tx=0x7f99f001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eb953bb77aa7c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 msgr2=0x7fae74042e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 0x7fae74042e20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86edffb640 1 -- 172.21.15.84:0/2549749814 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86d8002c80 con 0x7f86dc040ce0 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 msgr2=0x7fae7403d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 0x7fae7403d6e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae7c001690 tx=0x7fae7c001260 comp rx=0 tx=0).stop 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 msgr2=0x7fae8812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae78019fa0 tx=0x7fae7801abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 shutdown_connections 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fae740409a0 0x7fae74042e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae7403b220 0x7fae7403d6e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 --2- 172.21.15.84:0/407238943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae8812d000 0x7fae8812ff90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e4001630 con 0x7f99f406dce0 2024-09-10T06:22:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 >> 172.21.15.84:0/407238943 conn(0x7fae88071e50 msgr2=0x7fae88132c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 shutdown_connections 2024-09-10T06:22:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7fae8d15e640 1 -- 172.21.15.84:0/407238943 wait complete. 2024-09-10T06:22:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f00af070 con 0x7f99f406dce0 2024-09-10T06:22:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99ebfff640 1 -- 172.21.15.84:0/865203338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e4001630 con 0x7f99f406dce0 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 msgr2=0x7f86dc043160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 0x7f86dc043160 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 msgr2=0x7f86dc03da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 0x7f86dc03da20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007fd0 tx=0x7f86e8007900 comp rx=0 tx=0).stop 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 msgr2=0x7f86f8132b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86f401a030 tx=0x7f86f401ac40 comp rx=0 tx=0).stop 2024-09-10T06:22:27.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 shutdown_connections 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f86dc040ce0 0x7f86dc043160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f86dc03b560 0x7f86dc03da20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 --2- 172.21.15.84:0/2549749814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f806dce0 0x7f86f8132b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 >> 172.21.15.84:0/2549749814 conn(0x7f86f80709b0 msgr2=0x7f86f812a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 shutdown_connections 2024-09-10T06:22:27.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f86ff3a5640 1 -- 172.21.15.84:0/2549749814 wait complete. 2024-09-10T06:22:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- 172.21.15.84:0/865203338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f406dce0 msgr2=0x7f99f406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 --2- 172.21.15.84:0/865203338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f406dce0 0x7f99f406e0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099a0 tx=0x7f99f001c580 comp rx=0 tx=0).stop 2024-09-10T06:22:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- 172.21.15.84:0/865203338 shutdown_connections 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 --2- 172.21.15.84:0/865203338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f406dce0 0x7f99f406e0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- 172.21.15.84:0/865203338 >> 172.21.15.84:0/865203338 conn(0x7f99f40709b0 msgr2=0x7f99f4072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- 172.21.15.84:0/865203338 shutdown_connections 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- 172.21.15.84:0/865203338 wait complete. 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 Processor -- start 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.329+0000 7f99fb66c640 1 -- start start 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99fb66c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99fb66c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99f4135a60 con 0x7f99f4113620 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58298/0 (socket says 172.21.15.84:58298) 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9408640 1 -- 172.21.15.84:0/668060379 learned_addr learned my addr 172.21.15.84:0/668060379 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9408640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f4132040 con 0x7f99f4113620 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9408640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99f00ac040 tx=0x7f99f001adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e4001630 con 0x7f99f4113620 2024-09-10T06:22:27.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f00aabc0 con 0x7f99f4113620 2024-09-10T06:22:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99f0006e20 con 0x7f99f4113620 2024-09-10T06:22:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99fb66c640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f4115110 con 0x7f99f4113620 2024-09-10T06:22:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5cec0759e0 con 0x7f5cd8040980 2024-09-10T06:22:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99fb66c640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f4132a20 con 0x7f99f4113620 2024-09-10T06:22:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5ce8ff9640 1 -- 172.21.15.84:0/3342544989 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5cec0759e0 con 0x7f5cd8040980 2024-09-10T06:22:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99d0000f90 con 0x7f99f4113620 2024-09-10T06:22:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99f00bc020 con 0x7f99f4113620 2024-09-10T06:22:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 0x7f99d803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f99f00e9260 con 0x7f99f4113620 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 msgr2=0x7f5cd8042e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 0x7f5cd8042e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 msgr2=0x7f5cd803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 0x7f5cd803d6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ad000 tx=0x7f5ce00a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 msgr2=0x7f5cec1237e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c480 tx=0x7f5cdc00c940 comp rx=0 tx=0).stop 2024-09-10T06:22:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 0x7f99d8042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99f00af070 con 0x7f99d8040950 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f99f00f0050 con 0x7f99f4113620 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 shutdown_connections 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f5cd8040980 0x7f5cd8042e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd803b200 0x7f5cd803d6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 --2- 172.21.15.84:0/3342544989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cec09e370 0x7f5cec1237e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 >> 172.21.15.84:0/3342544989 conn(0x7f5cec071650 msgr2=0x7f5cec124970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 shutdown_connections 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f5cf2263640 1 -- 172.21.15.84:0/3342544989 wait complete. 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f8c07640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 0x7f99d803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.333+0000 7f99f9c09640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 0x7f99d8042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.337+0000 7f99f8c07640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 0x7f99d803d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99e4005890 tx=0x7f99e4001010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.337+0000 7f99f9c09640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 0x7f99d8042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.337+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99f00af070 con 0x7f99d8040950 2024-09-10T06:22:27.350 INFO:teuthology.orchestra.run.smithi084.stdout:42949672966 2024-09-10T06:22:27.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T06:22:27.354 INFO:teuthology.orchestra.run.smithi084.stdout:42949672965 2024-09-10T06:22:27.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T06:22:27.355 INFO:teuthology.orchestra.run.smithi084.stdout:47244640262 2024-09-10T06:22:27.355 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T06:22:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99d0002c80 con 0x7f99d8040950 2024-09-10T06:22:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99e9ffb640 1 -- 172.21.15.84:0/668060379 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99d0002c80 con 0x7f99d8040950 2024-09-10T06:22:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 msgr2=0x7f99d8042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 0x7f99d8042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 msgr2=0x7f99d803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 0x7f99d803d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99e4005890 tx=0x7f99e4001010 comp rx=0 tx=0).stop 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 msgr2=0x7f99f41218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99f00ac040 tx=0x7f99f001adc0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 shutdown_connections 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7f99d8040950 0x7f99d8042dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99d803b1d0 0x7f99d803d690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 --2- 172.21.15.84:0/668060379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99f4113620 0x7f99f41218f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 >> 172.21.15.84:0/668060379 conn(0x7f99f40709b0 msgr2=0x7f99f4072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 shutdown_connections 2024-09-10T06:22:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.361+0000 7f99d77fe640 1 -- 172.21.15.84:0/668060379 wait complete. 2024-09-10T06:22:27.386 INFO:teuthology.orchestra.run.smithi084.stdout:47244640260 2024-09-10T06:22:27.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T06:22:27.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7f4e5f3b0640 1 Processor -- start 2024-09-10T06:22:27.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7fbb4957a640 1 Processor -- start 2024-09-10T06:22:27.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7f4e5f3b0640 1 -- start start 2024-09-10T06:22:27.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7fbb4957a640 1 -- start start 2024-09-10T06:22:27.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7f4e5f3b0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e5809c160 0x7f4e5809c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7fbb4957a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb4406f8e0 0x7fbb44134770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.461+0000 7fbb4957a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb44116c10 con 0x7fbb4406edf0 2024-09-10T06:22:27.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4406ff20 con 0x7fbb4406f8e0 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5809d690 con 0x7f4e5806e760 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4e58073a20 con 0x7f4e5809c160 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5c94b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4e5806e760 0x7f4e58128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47304/0 (socket says 172.21.15.84:47304) 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5c94b640 1 -- 172.21.15.84:0/4064648580 learned_addr learned my addr 172.21.15.84:0/4064648580 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb42ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbb4406edf0 0x7fbb4406f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47318/0 (socket says 172.21.15.84:47318) 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb42ffd640 1 -- 172.21.15.84:0/1259372735 learned_addr learned my addr 172.21.15.84:0/1259372735 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92df3db640 1 Processor -- start 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92df3db640 1 -- start start 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92df3db640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92d806f3d0 0x7f92d806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92df3db640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d80731e0 con 0x7f92d80738b0 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92df3db640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f92d8114d90 con 0x7f92d806f3d0 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5d14c640 1 --2- 172.21.15.84:0/4064648580 >> v2:172.21.15.84:3300/0 conn(0x7f4e5809c160 0x7f4e5809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e4ffff640 1 -- 172.21.15.84:0/4064648580 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799213377 0 0) 0x7f4e5809d690 con 0x7f4e5806e760 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e4ffff640 1 -- 172.21.15.84:0/4064648580 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e44003530 con 0x7f4e5806e760 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5d14c640 1 -- 172.21.15.84:0/4064648580 >> v1:172.21.15.84:6789/0 conn(0x7f4e5806e760 legacy=0x7f4e58128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5d14c640 1 -- 172.21.15.84:0/4064648580 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5806deb0 con 0x7f4e5809c160 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb427fc640 1 --2- 172.21.15.84:0/1259372735 >> v2:172.21.15.84:3300/0 conn(0x7fbb4406f8e0 0x7fbb44134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb427fc640 1 -- 172.21.15.84:0/1259372735 >> v1:172.21.15.84:6789/0 conn(0x7fbb4406edf0 legacy=0x7fbb4406f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb41ffb640 1 -- 172.21.15.84:0/1259372735 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092053366 0 0) 0x7fbb44116c10 con 0x7fbb4406edf0 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb427fc640 1 -- 172.21.15.84:0/1259372735 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb44073bb0 con 0x7fbb4406f8e0 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92dd177640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92d806f3d0 0x7f92d806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92dc976640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f92d80738b0 0x7f92d8123130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47332/0 (socket says 172.21.15.84:47332) 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92dc976640 1 -- 172.21.15.84:0/1732047294 learned_addr learned my addr 172.21.15.84:0/1732047294 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92dd177640 1 -- 172.21.15.84:0/1732047294 >> v1:172.21.15.84:6789/0 conn(0x7f92d80738b0 legacy=0x7f92d8123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f92dd177640 1 -- 172.21.15.84:0/1732047294 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d80706d0 con 0x7f92d806f3d0 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5d14c640 1 --2- 172.21.15.84:0/4064648580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5809c160 0x7f4e5809c540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009740 tx=0x7f4e5401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e124e5fef671e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e4ffff640 1 -- 172.21.15.84:0/4064648580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e540b1070 con 0x7f4e5809c160 2024-09-10T06:22:27.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb427fc640 1 --2- 172.21.15.84:0/1259372735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406f8e0 0x7fbb44134770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009740 tx=0x7fbb3801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef99fc2a8e906bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e4ffff640 1 -- 172.21.15.84:0/4064648580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e540ac520 con 0x7f4e5809c160 2024-09-10T06:22:27.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e4ffff640 1 -- 172.21.15.84:0/4064648580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e540ac800 con 0x7f4e5809c160 2024-09-10T06:22:27.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb41ffb640 1 -- 172.21.15.84:0/1259372735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb380b0070 con 0x7fbb4406f8e0 2024-09-10T06:22:27.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb41ffb640 1 -- 172.21.15.84:0/1259372735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb380ab530 con 0x7fbb4406f8e0 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb41ffb640 1 -- 172.21.15.84:0/1259372735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb380ab830 con 0x7fbb4406f8e0 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/4064648580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5809c160 msgr2=0x7f4e5809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/4064648580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5809c160 0x7f4e5809c540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009740 tx=0x7f4e5401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/4064648580 shutdown_connections 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/4064648580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5809c160 0x7f4e5809c540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/4064648580 >> 172.21.15.84:0/4064648580 conn(0x7f4e58071630 msgr2=0x7f4e5809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- 172.21.15.84:0/1259372735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406f8e0 msgr2=0x7fbb44134770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1259372735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406f8e0 0x7fbb44134770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009740 tx=0x7fbb3801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- 172.21.15.84:0/1259372735 shutdown_connections 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1259372735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406f8e0 0x7fbb44134770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- 172.21.15.84:0/1259372735 >> 172.21.15.84:0/1259372735 conn(0x7fbb44071e50 msgr2=0x7fbb44072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- 172.21.15.84:0/1259372735 shutdown_connections 2024-09-10T06:22:27.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/4064648580 shutdown_connections 2024-09-10T06:22:27.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7fbb4957a640 1 -- 172.21.15.84:0/1259372735 wait complete. 2024-09-10T06:22:27.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.465+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/4064648580 wait complete. 2024-09-10T06:22:27.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92dd177640 1 --2- 172.21.15.84:0/1732047294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d806f7b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009740 tx=0x7f92d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f43d83b44ed22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 Processor -- start 2024-09-10T06:22:27.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 Processor -- start 2024-09-10T06:22:27.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 -- start start 2024-09-10T06:22:27.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 -- start start 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92cffff640 1 -- 172.21.15.84:0/1732047294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40b0070 con 0x7f92d806f3d0 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92cffff640 1 -- 172.21.15.84:0/1732047294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d40ab530 con 0x7f92d806f3d0 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92cffff640 1 -- 172.21.15.84:0/1732047294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40ab830 con 0x7f92d806f3d0 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58137b80 con 0x7f4e5806e760 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44137860 con 0x7fbb4406edf0 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb42ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb42ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58328/0 (socket says 172.21.15.84:58328) 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb42ffd640 1 -- 172.21.15.84:0/1989641960 learned_addr learned my addr 172.21.15.84:0/1989641960 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5d14c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5d14c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58340/0 (socket says 172.21.15.84:58340) 2024-09-10T06:22:27.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5d14c640 1 -- 172.21.15.84:0/3508276017 learned_addr learned my addr 172.21.15.84:0/3508276017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb42ffd640 1 -- 172.21.15.84:0/1989641960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb441177c0 con 0x7fbb4406edf0 2024-09-10T06:22:27.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5d14c640 1 -- 172.21.15.84:0/3508276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e58129b80 con 0x7f4e5806e760 2024-09-10T06:22:27.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb42ffd640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c3b0 tx=0x7fbb3400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- 172.21.15.84:0/1732047294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 msgr2=0x7f92d806f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 --2- 172.21.15.84:0/1732047294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d806f7b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009740 tx=0x7f92d401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- 172.21.15.84:0/1732047294 shutdown_connections 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 --2- 172.21.15.84:0/1732047294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d806f7b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- 172.21.15.84:0/1732047294 >> 172.21.15.84:0/1732047294 conn(0x7f92d809b890 msgr2=0x7f92d806dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- 172.21.15.84:0/1732047294 shutdown_connections 2024-09-10T06:22:27.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34007410 con 0x7fbb4406edf0 2024-09-10T06:22:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- 172.21.15.84:0/1732047294 wait complete. 2024-09-10T06:22:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340075b0 con 0x7fbb4406edf0 2024-09-10T06:22:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb441187c0 con 0x7fbb4406edf0 2024-09-10T06:22:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb34004960 con 0x7fbb4406edf0 2024-09-10T06:22:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb44133020 con 0x7fbb4406edf0 2024-09-10T06:22:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5d14c640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e5401c3b0 tx=0x7f4e5401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 Processor -- start 2024-09-10T06:22:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e540ba020 con 0x7f4e5806e760 2024-09-10T06:22:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e540b2040 con 0x7f4e5806e760 2024-09-10T06:22:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e540b1070 con 0x7f4e5806e760 2024-09-10T06:22:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- start start 2024-09-10T06:22:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbb34011070 con 0x7fbb4406edf0 2024-09-10T06:22:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5811aef0 con 0x7f4e5806e760 2024-09-10T06:22:27.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e58127dc0 con 0x7f4e5806e760 2024-09-10T06:22:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7f92df3db640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8135890 con 0x7f92d806f3d0 2024-09-10T06:22:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.469+0000 7fbb2b7fe640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 0x7fbb3003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbb3404e7f0 con 0x7fbb4406edf0 2024-09-10T06:22:27.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f92dd177640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f92dd177640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58352/0 (socket says 172.21.15.84:58352) 2024-09-10T06:22:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f92dd177640 1 -- 172.21.15.84:0/2852388497 learned_addr learned my addr 172.21.15.84:0/2852388497 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4406f1d0 con 0x7fbb4406edf0 2024-09-10T06:22:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f92dd177640 1 -- 172.21.15.84:0/2852388497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d8122a80 con 0x7f92d806f3d0 2024-09-10T06:22:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7fbb427fc640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 0x7fbb3003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5811a2a0 con 0x7f4e5806e760 2024-09-10T06:22:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f92dd177640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92d4019fa0 tx=0x7f92d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7fbb427fc640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 0x7fbb3003d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ad000 tx=0x7fbb380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4e540bd020 con 0x7f4e5806e760 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e4dffb640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 0x7f4e3c03d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4e540e8a90 con 0x7f4e5806e760 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e5c94b640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 0x7f4e3c03d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.473+0000 7f4e5c94b640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 0x7f4e3c03d6e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007fd0 tx=0x7f4e48007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.477+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40b0050 con 0x7f92d806f3d0 2024-09-10T06:22:27.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.477+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d81309b0 con 0x7f92d806f3d0 2024-09-10T06:22:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.477+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbb3401ad60 con 0x7fbb4406edf0 2024-09-10T06:22:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.477+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81310b0 con 0x7f92d806f3d0 2024-09-10T06:22:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.477+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d806f7b0 con 0x7f92d806f3d0 2024-09-10T06:22:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d40b1040 con 0x7f92d806f3d0 2024-09-10T06:22:27.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40ab530 con 0x7f92d806f3d0 2024-09-10T06:22:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4e540c4030 con 0x7f4e5806e760 2024-09-10T06:22:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f92d40be030 con 0x7f92d806f3d0 2024-09-10T06:22:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92cdffb640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 0x7f92bc03d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f92d40bc070 con 0x7f92d806f3d0 2024-09-10T06:22:27.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.481+0000 7f92dc976640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 0x7f92bc03d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.485+0000 7f92dc976640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 0x7f92bc03d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d8070d10 tx=0x7f92c8007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.489+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f92d40c5020 con 0x7f92d806f3d0 2024-09-10T06:22:27.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74f829640 1 Processor -- start 2024-09-10T06:22:27.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74f829640 1 -- start start 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74f829640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa74812bc10 0x7fa74812bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74f829640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa748073830 con 0x7fa74812c530 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74f829640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa748071eb0 con 0x7fa74812bc10 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74d5c5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa74812bc10 0x7fa74812bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74cdc4640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa74812c530 0x7fa74812ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47340/0 (socket says 172.21.15.84:47340) 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74cdc4640 1 -- 172.21.15.84:0/2864998352 learned_addr learned my addr 172.21.15.84:0/2864998352 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa73ffff640 1 -- 172.21.15.84:0/2864998352 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190483598 0 0) 0x7fa748073830 con 0x7fa74812c530 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa73ffff640 1 -- 172.21.15.84:0/2864998352 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa734003530 con 0x7fa74812c530 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74d5c5640 1 -- 172.21.15.84:0/2864998352 >> v1:172.21.15.84:6789/0 conn(0x7fa74812c530 legacy=0x7fa74812ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.569+0000 7fa74d5c5640 1 -- 172.21.15.84:0/2864998352 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7480a30b0 con 0x7fa74812bc10 2024-09-10T06:22:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74d5c5640 1 --2- 172.21.15.84:0/2864998352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa74812bff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa744009740 tx=0x7fa74401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68ee43e441d728d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa73ffff640 1 -- 172.21.15.84:0/2864998352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440b0070 con 0x7fa74812bc10 2024-09-10T06:22:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa73ffff640 1 -- 172.21.15.84:0/2864998352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440ab530 con 0x7fa74812bc10 2024-09-10T06:22:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa73ffff640 1 -- 172.21.15.84:0/2864998352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440ab830 con 0x7fa74812bc10 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 -- 172.21.15.84:0/2864998352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 msgr2=0x7fa74812bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 --2- 172.21.15.84:0/2864998352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa74812bff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa744009740 tx=0x7fa74401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 -- 172.21.15.84:0/2864998352 shutdown_connections 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 --2- 172.21.15.84:0/2864998352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa74812bff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 -- 172.21.15.84:0/2864998352 >> 172.21.15.84:0/2864998352 conn(0x7fa7480a0a60 msgr2=0x7fa74806e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.573+0000 7fa74f829640 1 -- 172.21.15.84:0/2864998352 shutdown_connections 2024-09-10T06:22:27.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 -- 172.21.15.84:0/2864998352 wait complete. 2024-09-10T06:22:27.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 Processor -- start 2024-09-10T06:22:27.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 -- start start 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa748137a50 con 0x7fa74812bc10 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74d5c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74d5c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58368/0 (socket says 172.21.15.84:58368) 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74d5c5640 1 -- 172.21.15.84:0/2733155505 learned_addr learned my addr 172.21.15.84:0/2733155505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74d5c5640 1 -- 172.21.15.84:0/2733155505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74811ccd0 con 0x7fa74812bc10 2024-09-10T06:22:27.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74d5c5640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa744019fa0 tx=0x7fa74401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440b0050 con 0x7fa74812bc10 2024-09-10T06:22:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440b1040 con 0x7fa74812bc10 2024-09-10T06:22:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 -- 172.21.15.84:0/2733155505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74811b6d0 con 0x7fa74812bc10 2024-09-10T06:22:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440b7580 con 0x7fa74812bc10 2024-09-10T06:22:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa74f829640 1 -- 172.21.15.84:0/2733155505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa748129ba0 con 0x7fa74812bc10 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7440be030 con 0x7fa74812bc10 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 0x7fa72c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.577+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa7440bc070 con 0x7fa74812bc10 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.581+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa720005090 con 0x7fa74812bc10 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.581+0000 7fa74cdc4640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 0x7fa72c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.581+0000 7fa74cdc4640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 0x7fa72c03d6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa738007fd0 tx=0x7fa738007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:27.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.585+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa7440e9030 con 0x7fa74812bc10 2024-09-10T06:22:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.653+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4e58068e50 con 0x7f4e5806e760 2024-09-10T06:22:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.653+0000 7f4e4dffb640 1 -- 172.21.15.84:0/3508276017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e58129b80 con 0x7f4e5806e760 2024-09-10T06:22:27.654 INFO:teuthology.orchestra.run.smithi084.stdout:42949672964 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 msgr2=0x7f4e3c03d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 0x7f4e3c03d6e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4e48007fd0 tx=0x7f4e48007900 comp rx=0 tx=0).stop 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 msgr2=0x7f4e581276b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e5401c3b0 tx=0x7f4e5401abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 shutdown_connections 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e3c03b220 0x7f4e3c03d6e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 --2- 172.21.15.84:0/3508276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e5806e760 0x7f4e581276b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 >> 172.21.15.84:0/3508276017 conn(0x7f4e58071630 msgr2=0x7f4e5812bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 shutdown_connections 2024-09-10T06:22:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f4e5f3b0640 1 -- 172.21.15.84:0/3508276017 wait complete. 2024-09-10T06:22:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f92d8068e50 con 0x7f92d806f3d0 2024-09-10T06:22:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.657+0000 7f92cdffb640 1 -- 172.21.15.84:0/2852388497 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92d4015ff0 con 0x7f92d806f3d0 2024-09-10T06:22:27.659 INFO:teuthology.orchestra.run.smithi084.stdout:42949672965 2024-09-10T06:22:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 msgr2=0x7f92bc03d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 0x7f92bc03d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d8070d10 tx=0x7f92c8007ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 msgr2=0x7f92d8071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92d4019fa0 tx=0x7f92d401abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 shutdown_connections 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f92bc03b300 0x7f92bc03d7c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 --2- 172.21.15.84:0/2852388497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92d806f3d0 0x7f92d8071db0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 >> 172.21.15.84:0/2852388497 conn(0x7f92d809b890 msgr2=0x7f92d81298c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 shutdown_connections 2024-09-10T06:22:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.661+0000 7f92df3db640 1 -- 172.21.15.84:0/2852388497 wait complete. 2024-09-10T06:22:27.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.0 2024-09-10T06:22:27.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-10T06:22:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbb44134090 con 0x7fbb4406edf0 2024-09-10T06:22:27.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb2b7fe640 1 -- 172.21.15.84:0/1989641960 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb34012d70 con 0x7fbb4406edf0 2024-09-10T06:22:27.690 INFO:teuthology.orchestra.run.smithi084.stdout:47244640261 2024-09-10T06:22:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 msgr2=0x7fbb3003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 0x7fbb3003d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ad000 tx=0x7fbb380a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 msgr2=0x7fbb44132ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c3b0 tx=0x7fbb3400c870 comp rx=0 tx=0).stop 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 shutdown_connections 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbb3003b1d0 0x7fbb3003d690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 --2- 172.21.15.84:0/1989641960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb4406edf0 0x7fbb44132ae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 >> 172.21.15.84:0/1989641960 conn(0x7fbb44071e50 msgr2=0x7fbb4412efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 shutdown_connections 2024-09-10T06:22:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.689+0000 7fbb4957a640 1 -- 172.21.15.84:0/1989641960 wait complete. 2024-09-10T06:22:27.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-10T06:22:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.757+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa720005380 con 0x7fa74812bc10 2024-09-10T06:22:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.757+0000 7fa73dffb640 1 -- 172.21.15.84:0/2733155505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7440c5020 con 0x7fa74812bc10 2024-09-10T06:22:27.760 INFO:teuthology.orchestra.run.smithi084.stdout:47244640259 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 msgr2=0x7fa72c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 0x7fa72c03d6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa738007fd0 tx=0x7fa738007900 comp rx=0 tx=0).stop 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 msgr2=0x7fa748129490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa744019fa0 tx=0x7fa74401abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 shutdown_connections 2024-09-10T06:22:27.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa72c03b200 0x7fa72c03d6c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 --2- 172.21.15.84:0/2733155505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa74812bc10 0x7fa748129490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:27.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 >> 172.21.15.84:0/2733155505 conn(0x7fa7480a0a60 msgr2=0x7fa7480a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:27.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 shutdown_connections 2024-09-10T06:22:27.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:27.761+0000 7fa7337fe640 1 -- 172.21.15.84:0/2733155505 wait complete. 2024-09-10T06:22:27.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-09-10T06:22:28.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T06:22:28.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T06:22:28.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T06:22:28.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T06:22:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa6081d7640 1 Processor -- start 2024-09-10T06:22:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17fa06640 1 Processor -- start 2024-09-10T06:22:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa6081d7640 1 -- start start 2024-09-10T06:22:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17fa06640 1 -- start start 2024-09-10T06:22:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa6081d7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa60012ff60 0x7fa6001349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa6081d7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa600070550 con 0x7fa60012f470 2024-09-10T06:22:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa6081d7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa600070aa0 con 0x7fa60012ff60 2024-09-10T06:22:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fc18ce3f640 1 Processor -- start 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa605772640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa60012ff60 0x7fa6001349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa605f73640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa60012f470 0x7fa60012f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47352/0 (socket says 172.21.15.84:47352) 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7fa605f73640 1 -- 172.21.15.84:0/3005010559 learned_addr learned my addr 172.21.15.84:0/3005010559 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17fa06640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff17812daf0 0x7ff178132590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17fa06640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17809f7f0 con 0x7ff17812d000 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17fa06640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff17809ebb0 con 0x7ff17812daf0 2024-09-10T06:22:28.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.837+0000 7ff17cfa1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff17812daf0 0x7ff178132590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17d7a2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff17812d000 0x7ff17812d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47358/0 (socket says 172.21.15.84:47358) 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17d7a2640 1 -- 172.21.15.84:0/1870996823 learned_addr learned my addr 172.21.15.84:0/1870996823 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa604f71640 1 -- 172.21.15.84:0/3005010559 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415157042 0 0) 0x7fa600070550 con 0x7fa60012f470 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa604f71640 1 -- 172.21.15.84:0/3005010559 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ec003530 con 0x7fa60012f470 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa605772640 1 -- 172.21.15.84:0/3005010559 >> v1:172.21.15.84:6789/0 conn(0x7fa60012f470 legacy=0x7fa60012f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa605772640 1 -- 172.21.15.84:0/3005010559 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa600073d90 con 0x7fa60012ff60 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18ce3f640 1 -- start start 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18ce3f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc188132800 0x7fc188134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc185d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc188132800 0x7fc188134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc18812c210 0x7fc18812c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47362/0 (socket says 172.21.15.84:47362) 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18659c640 1 -- 172.21.15.84:0/184162304 learned_addr learned my addr 172.21.15.84:0/184162304 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18812c010 con 0x7fc18812c210 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc18809d9e0 con 0x7fc188132800 2024-09-10T06:22:28.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc185d9b640 1 -- 172.21.15.84:0/184162304 >> v1:172.21.15.84:6789/0 conn(0x7fc18812c210 legacy=0x7fc18812c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc185d9b640 1 -- 172.21.15.84:0/184162304 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18806df40 con 0x7fc188132800 2024-09-10T06:22:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17cfa1640 1 -- 172.21.15.84:0/1870996823 >> v1:172.21.15.84:6789/0 conn(0x7ff17812d000 legacy=0x7ff17812d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17cfa1640 1 -- 172.21.15.84:0/1870996823 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17809f430 con 0x7ff17812daf0 2024-09-10T06:22:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa605772640 1 --2- 172.21.15.84:0/3005010559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012ff60 0x7fa6001349a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009740 tx=0x7fa5f001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b217bf35a45ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17cfa1640 1 --2- 172.21.15.84:0/1870996823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812daf0 0x7ff178132590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff168009740 tx=0x7ff16801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1b2bfc515f592f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa604f71640 1 -- 172.21.15.84:0/3005010559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f00b0070 con 0x7fa60012ff60 2024-09-10T06:22:28.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa604f71640 1 -- 172.21.15.84:0/3005010559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f00ab530 con 0x7fa60012ff60 2024-09-10T06:22:28.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa604f71640 1 -- 172.21.15.84:0/3005010559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f00ab830 con 0x7fa60012ff60 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff16ffff640 1 -- 172.21.15.84:0/1870996823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1680b1070 con 0x7ff17812daf0 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff16ffff640 1 -- 172.21.15.84:0/1870996823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1680ac520 con 0x7ff17812daf0 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff16ffff640 1 -- 172.21.15.84:0/1870996823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1680ac820 con 0x7ff17812daf0 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc185d9b640 1 --2- 172.21.15.84:0/184162304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc188132800 0x7fc188134bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009740 tx=0x7fc17c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7bf68fa90167fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 -- 172.21.15.84:0/3005010559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012ff60 msgr2=0x7fa6001349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 --2- 172.21.15.84:0/3005010559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012ff60 0x7fa6001349a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009740 tx=0x7fa5f001c370 comp rx=0 tx=0).stop 2024-09-10T06:22:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18559a640 1 -- 172.21.15.84:0/184162304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c0b0070 con 0x7fc188132800 2024-09-10T06:22:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 -- 172.21.15.84:0/1870996823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812daf0 msgr2=0x7ff178132590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 --2- 172.21.15.84:0/1870996823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812daf0 0x7ff178132590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff168009740 tx=0x7ff16801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18559a640 1 -- 172.21.15.84:0/184162304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c0ab530 con 0x7fc188132800 2024-09-10T06:22:28.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fc18559a640 1 -- 172.21.15.84:0/184162304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c0ab830 con 0x7fc188132800 2024-09-10T06:22:28.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 -- 172.21.15.84:0/1870996823 shutdown_connections 2024-09-10T06:22:28.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 --2- 172.21.15.84:0/1870996823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812daf0 0x7ff178132590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:28.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 -- 172.21.15.84:0/1870996823 >> 172.21.15.84:0/1870996823 conn(0x7ff178071e50 msgr2=0x7ff178072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:28.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 -- 172.21.15.84:0/3005010559 shutdown_connections 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 --2- 172.21.15.84:0/3005010559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012ff60 0x7fa6001349a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 -- 172.21.15.84:0/3005010559 >> 172.21.15.84:0/3005010559 conn(0x7fa600072b80 msgr2=0x7fa600072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 -- 172.21.15.84:0/3005010559 shutdown_connections 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7fa6081d7640 1 -- 172.21.15.84:0/3005010559 wait complete. 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 -- 172.21.15.84:0/1870996823 shutdown_connections 2024-09-10T06:22:28.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.841+0000 7ff17fa06640 1 -- 172.21.15.84:0/1870996823 wait complete. 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc188132800 msgr2=0x7fc188134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 --2- 172.21.15.84:0/184162304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc188132800 0x7fc188134bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009740 tx=0x7fc17c01c370 comp rx=0 tx=0).stop 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 shutdown_connections 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 --2- 172.21.15.84:0/184162304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc188132800 0x7fc188134bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 >> 172.21.15.84:0/184162304 conn(0x7fc188071650 msgr2=0x7fc18809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 shutdown_connections 2024-09-10T06:22:28.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/184162304 wait complete. 2024-09-10T06:22:28.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 Processor -- start 2024-09-10T06:22:28.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa6081d7640 1 Processor -- start 2024-09-10T06:22:28.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 -- start start 2024-09-10T06:22:28.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa6081d7640 1 -- start start 2024-09-10T06:22:28.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 Processor -- start 2024-09-10T06:22:28.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- start start 2024-09-10T06:22:28.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff178135470 con 0x7ff17812d000 2024-09-10T06:22:28.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa6081d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa6081d7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa600137880 con 0x7fa60012f470 2024-09-10T06:22:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17d7a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa605f73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17d7a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58392/0 (socket says 172.21.15.84:58392) 2024-09-10T06:22:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17d7a2640 1 -- 172.21.15.84:0/2284682341 learned_addr learned my addr 172.21.15.84:0/2284682341 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa605f73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58406/0 (socket says 172.21.15.84:58406) 2024-09-10T06:22:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa605f73640 1 -- 172.21.15.84:0/2446673445 learned_addr learned my addr 172.21.15.84:0/2446673445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc188137ad0 con 0x7fc18812c210 2024-09-10T06:22:28.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17d7a2640 1 -- 172.21.15.84:0/2284682341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff178117f50 con 0x7ff17812d000 2024-09-10T06:22:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58418/0 (socket says 172.21.15.84:58418) 2024-09-10T06:22:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18659c640 1 -- 172.21.15.84:0/1309680930 learned_addr learned my addr 172.21.15.84:0/1309680930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa605f73640 1 -- 172.21.15.84:0/2446673445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60011baf0 con 0x7fa60012f470 2024-09-10T06:22:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17d7a2640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c450 tx=0x7ff17400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa605f73640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c450 tx=0x7fa5fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18659c640 1 -- 172.21.15.84:0/1309680930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18811bca0 con 0x7fc18812c210 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174017070 con 0x7ff17812d000 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174005c20 con 0x7ff17812d000 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1740070d0 con 0x7ff17812d000 2024-09-10T06:22:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff178131af0 con 0x7ff17812d000 2024-09-10T06:22:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc017070 con 0x7fa60012f470 2024-09-10T06:22:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1781c4e90 con 0x7ff17812d000 2024-09-10T06:22:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc005ce0 con 0x7fa60012f470 2024-09-10T06:22:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa600129ba0 con 0x7fa60012f470 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18659c640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c450 tx=0x7fc17800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc178017070 con 0x7fc18812c210 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc178005c20 con 0x7fc18812c210 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1780070d0 con 0x7fc18812c210 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17812d3e0 con 0x7ff17812d000 2024-09-10T06:22:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.845+0000 7fc18ce3f640 1 -- 172.21.15.84:0/1309680930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc188129c60 con 0x7fc18812c210 2024-09-10T06:22:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc18ce3f640 1 -- 172.21.15.84:0/1309680930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18811c070 con 0x7fc18812c210 2024-09-10T06:22:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc160005090 con 0x7fc18812c210 2024-09-10T06:22:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60011bec0 con 0x7fa60012f470 2024-09-10T06:22:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc17801a070 con 0x7fc18812c210 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5fc007200 con 0x7fa60012f470 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60012f850 con 0x7fa60012f470 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa5fc01a070 con 0x7fa60012f470 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc176ffd640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 0x7fc16803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa5f67fc640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 0x7fa5e403d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff17401a070 con 0x7ff17812d000 2024-09-10T06:22:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7ff16dffb640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 0x7ff15c03d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff17404e480 con 0x7ff17812d000 2024-09-10T06:22:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc185d9b640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 0x7fc16803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7ff17cfa1640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 0x7ff15c03d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa605772640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 0x7fa5e403d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fc185d9b640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 0x7fc16803d690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ad000 tx=0x7fc17c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7fa605772640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 0x7fa5e403d620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009740 tx=0x7fa5f00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.849+0000 7ff17cfa1640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 0x7ff15c03d710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1680ae000 tx=0x7ff168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.853+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fc17804cf20 con 0x7fc18812c210 2024-09-10T06:22:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.853+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa5fc01bd70 con 0x7fa60012f470 2024-09-10T06:22:28.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.853+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff17809f7f0 con 0x7ff17812d000 2024-09-10T06:22:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.857+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc178019cd0 con 0x7fc18812c210 2024-09-10T06:22:28.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.861+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa5fc011360 con 0x7fa60012f470 2024-09-10T06:22:28.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaad815640 1 Processor -- start 2024-09-10T06:22:28.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaad815640 1 -- start start 2024-09-10T06:22:28.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaad815640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbaa812bc10 0x7fbaa812bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaad815640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa8073830 con 0x7fbaa812c530 2024-09-10T06:22:28.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaad815640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa8071eb0 con 0x7fbaa812bc10 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbaa812bc10 0x7fbaa812bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa67fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbaa812c530 0x7fbaa812ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47378/0 (socket says 172.21.15.84:47378) 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa67fc640 1 -- 172.21.15.84:0/3175252660 learned_addr learned my addr 172.21.15.84:0/3175252660 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa6ffd640 1 -- 172.21.15.84:0/3175252660 >> v1:172.21.15.84:6789/0 conn(0x7fbaa812c530 legacy=0x7fbaa812ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa6ffd640 1 -- 172.21.15.84:0/3175252660 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa80a30b0 con 0x7fbaa812bc10 2024-09-10T06:22:28.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.889+0000 7fbaa5ffb640 1 -- 172.21.15.84:0/3175252660 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069265112 0 0) 0x7fbaa8073830 con 0x7fbaa812c530 2024-09-10T06:22:28.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa6ffd640 1 --2- 172.21.15.84:0/3175252660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa812bff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba98009740 tx=0x7fba9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10437d8c3cc140cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa5ffb640 1 -- 172.21.15.84:0/3175252660 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba980b0070 con 0x7fbaa812bc10 2024-09-10T06:22:28.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa5ffb640 1 -- 172.21.15.84:0/3175252660 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba980ab530 con 0x7fbaa812bc10 2024-09-10T06:22:28.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa5ffb640 1 -- 172.21.15.84:0/3175252660 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba980ab830 con 0x7fbaa812bc10 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- 172.21.15.84:0/3175252660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 msgr2=0x7fbaa812bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 --2- 172.21.15.84:0/3175252660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa812bff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba98009740 tx=0x7fba9801c370 comp rx=0 tx=0).stop 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- 172.21.15.84:0/3175252660 shutdown_connections 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 --2- 172.21.15.84:0/3175252660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa812bff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- 172.21.15.84:0/3175252660 >> 172.21.15.84:0/3175252660 conn(0x7fbaa80a0a60 msgr2=0x7fbaa806e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- 172.21.15.84:0/3175252660 shutdown_connections 2024-09-10T06:22:28.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- 172.21.15.84:0/3175252660 wait complete. 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 Processor -- start 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- start start 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaad815640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8137a50 con 0x7fbaa812bc10 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58428/0 (socket says 172.21.15.84:58428) 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.893+0000 7fbaa6ffd640 1 -- 172.21.15.84:0/4124669787 learned_addr learned my addr 172.21.15.84:0/4124669787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:28.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaa6ffd640 1 -- 172.21.15.84:0/4124669787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa812d810 con 0x7fbaa812bc10 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaa6ffd640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba98019fa0 tx=0x7fba9801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba980b0050 con 0x7fbaa812bc10 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba980b1040 con 0x7fbaa812bc10 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa811c100 con 0x7fbaa812bc10 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba980b5740 con 0x7fbaa812bc10 2024-09-10T06:22:28.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa811c790 con 0x7fbaa812bc10 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fba980be030 con 0x7fbaa812bc10 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa812bff0 con 0x7fbaa812bc10 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 0x7fba9403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fba980bc070 con 0x7fbaa812bc10 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaa67fc640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 0x7fba9403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:28.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.897+0000 7fbaa67fc640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 0x7fba9403d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba9c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:28.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:28.901+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fba980c5020 con 0x7fbaa812bc10 2024-09-10T06:22:29.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff1781328b0 con 0x7ff17812d000 2024-09-10T06:22:29.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff16dffb640 1 -- 172.21.15.84:0/2284682341 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff17404c420 con 0x7ff17812d000 2024-09-10T06:22:29.022 INFO:teuthology.orchestra.run.smithi084.stdout:42949672965 2024-09-10T06:22:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 msgr2=0x7ff15c03d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff17fa06640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 0x7ff15c03d710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1680ae000 tx=0x7ff168008040 comp rx=0 tx=0).stop 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 msgr2=0x7ff1781c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.021+0000 7ff17fa06640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c450 tx=0x7ff17400c910 comp rx=0 tx=0).stop 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 shutdown_connections 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c03b250 0x7ff15c03d710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 --2- 172.21.15.84:0/2284682341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff17812d000 0x7ff1781c4950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 >> 172.21.15.84:0/2284682341 conn(0x7ff178071e50 msgr2=0x7ff178126990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 shutdown_connections 2024-09-10T06:22:29.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.025+0000 7ff17fa06640 1 -- 172.21.15.84:0/2284682341 wait complete. 2024-09-10T06:22:29.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2024-09-10T06:22:29.040 DEBUG:teuthology.parallel:result is None 2024-09-10T06:22:29.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbaa811c4b0 con 0x7fbaa812bc10 2024-09-10T06:22:29.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc160005380 con 0x7fc18812c210 2024-09-10T06:22:29.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fba8ffff640 1 -- 172.21.15.84:0/4124669787 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba98015ff0 con 0x7fbaa812bc10 2024-09-10T06:22:29.070 INFO:teuthology.orchestra.run.smithi084.stdout:47244640260 2024-09-10T06:22:29.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc176ffd640 1 -- 172.21.15.84:0/1309680930 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc17801b400 con 0x7fc18812c210 2024-09-10T06:22:29.070 INFO:teuthology.orchestra.run.smithi084.stdout:42949672966 2024-09-10T06:22:29.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 msgr2=0x7fc16803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 0x7fc16803d690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ad000 tx=0x7fc17c008040 comp rx=0 tx=0).stop 2024-09-10T06:22:29.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 msgr2=0x7fc188119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c450 tx=0x7fc17800c910 comp rx=0 tx=0).stop 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 msgr2=0x7fba9403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 0x7fba9403d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007fd0 tx=0x7fba9c007900 comp rx=0 tx=0).stop 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 shutdown_connections 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16803b1d0 0x7fc16803d690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 --2- 172.21.15.84:0/1309680930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc18812c210 0x7fc188119a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 msgr2=0x7fbaa8129950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba98019fa0 tx=0x7fba9801abb0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 >> 172.21.15.84:0/1309680930 conn(0x7fc188071650 msgr2=0x7fc188072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 shutdown_connections 2024-09-10T06:22:29.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fba9403b1d0 0x7fba9403d690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 --2- 172.21.15.84:0/4124669787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaa812bc10 0x7fbaa8129950 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 >> 172.21.15.84:0/4124669787 conn(0x7fbaa80a0a60 msgr2=0x7fbaa80a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 shutdown_connections 2024-09-10T06:22:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fc174ff9640 1 -- 172.21.15.84:0/1309680930 wait complete. 2024-09-10T06:22:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 shutdown_connections 2024-09-10T06:22:29.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.069+0000 7fbaad815640 1 -- 172.21.15.84:0/4124669787 wait complete. 2024-09-10T06:22:29.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.073+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa600068e50 con 0x7fa60012f470 2024-09-10T06:22:29.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.073+0000 7fa5f67fc640 1 -- 172.21.15.84:0/2446673445 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5fc0073a0 con 0x7fa60012f470 2024-09-10T06:22:29.075 INFO:teuthology.orchestra.run.smithi084.stdout:47244640262 2024-09-10T06:22:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 msgr2=0x7fa5e403d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 0x7fa5e403d620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009740 tx=0x7fa5f00a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 msgr2=0x7fa6001284f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c450 tx=0x7fa5fc00c910 comp rx=0 tx=0).stop 2024-09-10T06:22:29.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 shutdown_connections 2024-09-10T06:22:29.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa5e403b160 0x7fa5e403d620 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 --2- 172.21.15.84:0/2446673445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa60012f470 0x7fa6001284f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 >> 172.21.15.84:0/2446673445 conn(0x7fa600072b80 msgr2=0x7fa60009c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 shutdown_connections 2024-09-10T06:22:29.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.077+0000 7fa6081d7640 1 -- 172.21.15.84:0/2446673445 wait complete. 2024-09-10T06:22:29.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.2 2024-09-10T06:22:29.095 DEBUG:teuthology.parallel:result is None 2024-09-10T06:22:29.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2024-09-10T06:22:29.098 DEBUG:teuthology.parallel:result is None 2024-09-10T06:22:29.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2024-09-10T06:22:29.099 DEBUG:teuthology.parallel:result is None 2024-09-10T06:22:29.099 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T06:22:29.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:22:29.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fccb73640 1 Processor -- start 2024-09-10T06:22:29.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fccb73640 1 -- start start 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fccb73640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9fc81326b0 0x7f9fc8134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fccb73640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc81170c0 con 0x7f9fc812bf90 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fccb73640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc8116d00 con 0x7f9fc81326b0 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fc5d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9fc81326b0 0x7f9fc8134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fc659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9fc812bf90 0x7f9fc812c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47382/0 (socket says 172.21.15.84:47382) 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.237+0000 7f9fc659c640 1 -- 172.21.15.84:0/838728983 learned_addr learned my addr 172.21.15.84:0/838728983 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc5d9b640 1 -- 172.21.15.84:0/838728983 >> v1:172.21.15.84:6789/0 conn(0x7f9fc812bf90 legacy=0x7f9fc812c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc559a640 1 -- 172.21.15.84:0/838728983 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477784216 0 0) 0x7f9fc0001120 con 0x7f9fc812bf90 2024-09-10T06:22:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc5d9b640 1 -- 172.21.15.84:0/838728983 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc8115eb0 con 0x7f9fc81326b0 2024-09-10T06:22:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc5d9b640 1 --2- 172.21.15.84:0/838728983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc81326b0 0x7f9fc8134aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009740 tx=0x7f9fb001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d7de6cf139e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc559a640 1 -- 172.21.15.84:0/838728983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb00b1070 con 0x7f9fc81326b0 2024-09-10T06:22:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc559a640 1 -- 172.21.15.84:0/838728983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb00ac520 con 0x7f9fc81326b0 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fc559a640 1 -- 172.21.15.84:0/838728983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fb00ac820 con 0x7f9fc81326b0 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- 172.21.15.84:0/838728983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc81326b0 msgr2=0x7f9fc8134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 --2- 172.21.15.84:0/838728983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc81326b0 0x7f9fc8134aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009740 tx=0x7f9fb001c370 comp rx=0 tx=0).stop 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- 172.21.15.84:0/838728983 shutdown_connections 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 --2- 172.21.15.84:0/838728983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc81326b0 0x7f9fc8134aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- 172.21.15.84:0/838728983 >> 172.21.15.84:0/838728983 conn(0x7f9fc806fce0 msgr2=0x7f9fc8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- 172.21.15.84:0/838728983 shutdown_connections 2024-09-10T06:22:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- 172.21.15.84:0/838728983 wait complete. 2024-09-10T06:22:29.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 Processor -- start 2024-09-10T06:22:29.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- start start 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.241+0000 7f9fccb73640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc8137980 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58444/0 (socket says 172.21.15.84:58444) 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc659c640 1 -- 172.21.15.84:0/3984769811 learned_addr learned my addr 172.21.15.84:0/3984769811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc659c640 1 -- 172.21.15.84:0/3984769811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc8117980 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc659c640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c6b0 tx=0x7f9fc000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc0018070 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc0007e30 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc8118980 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc0007200 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc8127ed0 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc812c370 con 0x7f9fc812bf90 2024-09-10T06:22:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9fc001b070 con 0x7f9fc812bf90 2024-09-10T06:22:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 0x7f9fa803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9fc004dfd0 con 0x7f9fc812bf90 2024-09-10T06:22:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc5d9b640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 0x7f9fa803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.245+0000 7f9fc5d9b640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 0x7f9fa803d6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00ae000 tx=0x7f9fb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.249+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9fc81170c0 con 0x7f9fc812bf90 2024-09-10T06:22:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.405+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fc8117d30 con 0x7f9fa803b200 2024-09-10T06:22:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.409+0000 7f9fbeffd640 1 -- 172.21.15.84:0/3984769811 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32238 (secure 0 0 0) 0x7f9fb00093e0 con 0x7f9fa803b200 2024-09-10T06:22:29.411 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 msgr2=0x7f9fa803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 0x7f9fa803d6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00ae000 tx=0x7f9fb00a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 msgr2=0x7f9fc8127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c6b0 tx=0x7f9fc000cb70 comp rx=0 tx=0).stop 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 shutdown_connections 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9fa803b200 0x7f9fa803d6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 --2- 172.21.15.84:0/3984769811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fc812bf90 0x7f9fc8127990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 >> 172.21.15.84:0/3984769811 conn(0x7f9fc806fce0 msgr2=0x7f9fc812f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 shutdown_connections 2024-09-10T06:22:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.413+0000 7f9fccb73640 1 -- 172.21.15.84:0/3984769811 wait complete. 2024-09-10T06:22:29.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T06:22:27.750640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1368994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903742"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872457+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:22:25.872457+0000","last_peered":"2024-09-10T06:22:25.872457+0000","last_clean":"2024-09-10T06:22:25.872457+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:22:25.872457+0000","last_undegraded":"2024-09-10T06:22:25.872457+0000","last_fullsized":"2024-09-10T06:22:25.872457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.866236+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:22:25.866236+0000","last_peered":"2024-09-10T06:22:25.866236+0000","last_clean":"2024-09-10T06:22:25.866236+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:22:25.866236+0000","last_undegraded":"2024-09-10T06:22:25.866236+0000","last_fullsized":"2024-09-10T06:22:25.866236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872125+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:22:25.872125+0000","last_peered":"2024-09-10T06:22:25.872125+0000","last_clean":"2024-09-10T06:22:25.872125+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:22:25.872125+0000","last_undegraded":"2024-09-10T06:22:25.872125+0000","last_fullsized":"2024-09-10T06:22:25.872125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.866472+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:22:25.866472+0000","last_peered":"2024-09-10T06:22:25.866472+0000","last_clean":"2024-09-10T06:22:25.866472+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:22:25.866472+0000","last_undegraded":"2024-09-10T06:22:25.866472+0000","last_fullsized":"2024-09-10T06:22:25.866472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872304+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:22:25.872304+0000","last_peered":"2024-09-10T06:22:25.872304+0000","last_clean":"2024-09-10T06:22:25.872304+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:22:25.872304+0000","last_undegraded":"2024-09-10T06:22:25.872304+0000","last_fullsized":"2024-09-10T06:22:25.872304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:26.162277+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:22:26.162277+0000","last_peered":"2024-09-10T06:22:26.162277+0000","last_clean":"2024-09-10T06:22:26.162277+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:22:26.162277+0000","last_undegraded":"2024-09-10T06:22:26.162277+0000","last_fullsized":"2024-09-10T06:22:26.162277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.870987+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:22:25.870987+0000","last_peered":"2024-09-10T06:22:25.870987+0000","last_clean":"2024-09-10T06:22:25.870987+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:22:25.870987+0000","last_undegraded":"2024-09-10T06:22:25.870987+0000","last_fullsized":"2024-09-10T06:22:25.870987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.871569+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:22:25.871569+0000","last_peered":"2024-09-10T06:22:25.871569+0000","last_clean":"2024-09-10T06:22:25.871569+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:22:25.871569+0000","last_undegraded":"2024-09-10T06:22:25.871569+0000","last_fullsized":"2024-09-10T06:22:25.871569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:26.229600+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:22:26.229600+0000","last_peered":"2024-09-10T06:22:26.229600+0000","last_clean":"2024-09-10T06:22:26.229600+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:22:26.229600+0000","last_undegraded":"2024-09-10T06:22:26.229600+0000","last_fullsized":"2024-09-10T06:22:26.229600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:22:29.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:22:29.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f1586615640 1 Processor -- start 2024-09-10T06:22:29.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f1586615640 1 -- start start 2024-09-10T06:22:29.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f1586615640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1580132420 0x7f1580134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f1586615640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158012b9d0 con 0x7f158012aee0 2024-09-10T06:22:29.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f1586615640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1580071e70 con 0x7f1580132420 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.533+0000 7f157ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f158012aee0 0x7f158012b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47384/0 (socket says 172.21.15.84:47384) 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157ffff640 1 -- 172.21.15.84:0/1444874733 learned_addr learned my addr 172.21.15.84:0/1444874733 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157f7fe640 1 --2- 172.21.15.84:0/1444874733 >> v2:172.21.15.84:3300/0 conn(0x7f1580132420 0x7f1580134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157effd640 1 -- 172.21.15.84:0/1444874733 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661602285 0 0) 0x7f158012b9d0 con 0x7f158012aee0 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157effd640 1 -- 172.21.15.84:0/1444874733 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1568003530 con 0x7f158012aee0 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157f7fe640 1 -- 172.21.15.84:0/1444874733 >> v1:172.21.15.84:6789/0 conn(0x7f158012aee0 legacy=0x7f158012b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157f7fe640 1 -- 172.21.15.84:0/1444874733 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800008e0 con 0x7f1580132420 2024-09-10T06:22:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157f7fe640 1 --2- 172.21.15.84:0/1444874733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580132420 0x7f1580134810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1574009740 tx=0x7f157401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b432bac80f72a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157effd640 1 -- 172.21.15.84:0/1444874733 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15740b1070 con 0x7f1580132420 2024-09-10T06:22:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157effd640 1 -- 172.21.15.84:0/1444874733 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15740ac520 con 0x7f1580132420 2024-09-10T06:22:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f157effd640 1 -- 172.21.15.84:0/1444874733 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15740ac820 con 0x7f1580132420 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 -- 172.21.15.84:0/1444874733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580132420 msgr2=0x7f1580134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 --2- 172.21.15.84:0/1444874733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580132420 0x7f1580134810 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1574009740 tx=0x7f157401c370 comp rx=0 tx=0).stop 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 -- 172.21.15.84:0/1444874733 shutdown_connections 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 --2- 172.21.15.84:0/1444874733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1580132420 0x7f1580134810 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 -- 172.21.15.84:0/1444874733 >> 172.21.15.84:0/1444874733 conn(0x7f15800a0a60 msgr2=0x7f158006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 -- 172.21.15.84:0/1444874733 shutdown_connections 2024-09-10T06:22:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.537+0000 7f1586615640 1 -- 172.21.15.84:0/1444874733 wait complete. 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 Processor -- start 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 -- start start 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1580137570 con 0x7f158012aee0 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58470/0 (socket says 172.21.15.84:58470) 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157ffff640 1 -- 172.21.15.84:0/3492443371 learned_addr learned my addr 172.21.15.84:0/3492443371 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157ffff640 1 -- 172.21.15.84:0/3492443371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1580073a80 con 0x7f158012aee0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157ffff640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f157000cb40 tx=0x7f157000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f157000ab50 con 0x7f158012aee0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157000acf0 con 0x7f158012aee0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158011bf60 con 0x7f158012aee0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1570012530 con 0x7f158012aee0 2024-09-10T06:22:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158011c5c0 con 0x7f158012aee0 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158012b2c0 con 0x7f158012aee0 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f15700126d0 con 0x7f158012aee0 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 0x7f156c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f157004f330 con 0x7f158012aee0 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157f7fe640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 0x7f156c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.541+0000 7f157f7fe640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 0x7f156c03d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15740ae000 tx=0x7f1574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.545+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f157001a360 con 0x7f158012aee0 2024-09-10T06:22:29.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.697+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1580072170 con 0x7f156c03b1d0 2024-09-10T06:22:29.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f157cff9640 1 -- 172.21.15.84:0/3492443371 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32238 (secure 0 0 0) 0x7f1580072170 con 0x7f156c03b1d0 2024-09-10T06:22:29.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:29.702 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 msgr2=0x7f156c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 0x7f156c03d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15740ae000 tx=0x7f1574008040 comp rx=0 tx=0).stop 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 msgr2=0x7f1580129760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f157000cb40 tx=0x7f157000a060 comp rx=0 tx=0).stop 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 shutdown_connections 2024-09-10T06:22:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f156c03b1d0 0x7f156c03d690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 --2- 172.21.15.84:0/3492443371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f158012aee0 0x7f1580129760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 >> 172.21.15.84:0/3492443371 conn(0x7f15800a0a60 msgr2=0x7f15800a10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 shutdown_connections 2024-09-10T06:22:29.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.701+0000 7f1586615640 1 -- 172.21.15.84:0/3492443371 wait complete. 2024-09-10T06:22:29.719 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T06:22:27.750640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1368994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.903742"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872457+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:22:25.872457+0000","last_peered":"2024-09-10T06:22:25.872457+0000","last_clean":"2024-09-10T06:22:25.872457+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:22:25.872457+0000","last_undegraded":"2024-09-10T06:22:25.872457+0000","last_fullsized":"2024-09-10T06:22:25.872457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.866236+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:22:25.866236+0000","last_peered":"2024-09-10T06:22:25.866236+0000","last_clean":"2024-09-10T06:22:25.866236+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:22:25.866236+0000","last_undegraded":"2024-09-10T06:22:25.866236+0000","last_fullsized":"2024-09-10T06:22:25.866236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872125+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:22:25.872125+0000","last_peered":"2024-09-10T06:22:25.872125+0000","last_clean":"2024-09-10T06:22:25.872125+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:22:25.872125+0000","last_undegraded":"2024-09-10T06:22:25.872125+0000","last_fullsized":"2024-09-10T06:22:25.872125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.866472+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:22:25.866472+0000","last_peered":"2024-09-10T06:22:25.866472+0000","last_clean":"2024-09-10T06:22:25.866472+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:22:25.866472+0000","last_undegraded":"2024-09-10T06:22:25.866472+0000","last_fullsized":"2024-09-10T06:22:25.866472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.872304+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:22:25.872304+0000","last_peered":"2024-09-10T06:22:25.872304+0000","last_clean":"2024-09-10T06:22:25.872304+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:22:25.872304+0000","last_undegraded":"2024-09-10T06:22:25.872304+0000","last_fullsized":"2024-09-10T06:22:25.872304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:26.162277+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:22:26.162277+0000","last_peered":"2024-09-10T06:22:26.162277+0000","last_clean":"2024-09-10T06:22:26.162277+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:22:26.162277+0000","last_undegraded":"2024-09-10T06:22:26.162277+0000","last_fullsized":"2024-09-10T06:22:26.162277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.870987+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:22:25.870987+0000","last_peered":"2024-09-10T06:22:25.870987+0000","last_clean":"2024-09-10T06:22:25.870987+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:22:25.870987+0000","last_undegraded":"2024-09-10T06:22:25.870987+0000","last_fullsized":"2024-09-10T06:22:25.870987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:25.871569+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:22:25.871569+0000","last_peered":"2024-09-10T06:22:25.871569+0000","last_clean":"2024-09-10T06:22:25.871569+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:22:25.871569+0000","last_undegraded":"2024-09-10T06:22:25.871569+0000","last_fullsized":"2024-09-10T06:22:25.871569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T06:22:26.229600+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:22:26.229600+0000","last_peered":"2024-09-10T06:22:26.229600+0000","last_clean":"2024-09-10T06:22:26.229600+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:22:26.229600+0000","last_undegraded":"2024-09-10T06:22:26.229600+0000","last_fullsized":"2024-09-10T06:22:26.229600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:22:29.719 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T06:22:29.719 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T06:22:29.720 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T06:22:29.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T06:22:29.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f636d0640 1 Processor -- start 2024-09-10T06:22:29.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f636d0640 1 -- start start 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f636d0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f5c12be30 0x7f6f5c12c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f636d0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5c113b40 con 0x7f6f5c12c750 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f636d0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5c112fd0 con 0x7f6f5c12be30 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f6146c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f5c12be30 0x7f6f5c12c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f60c6b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f5c12c750 0x7f6f5c1288b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47392/0 (socket says 172.21.15.84:47392) 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f60c6b640 1 -- 172.21.15.84:0/2928927353 learned_addr learned my addr 172.21.15.84:0/2928927353 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f6146c640 1 -- 172.21.15.84:0/2928927353 >> v1:172.21.15.84:6789/0 conn(0x7f6f5c12c750 legacy=0x7f6f5c1288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f6146c640 1 -- 172.21.15.84:0/2928927353 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c113700 con 0x7f6f5c12be30 2024-09-10T06:22:29.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.825+0000 7f6f53fff640 1 -- 172.21.15.84:0/2928927353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767993092 0 0) 0x7f6f5c113b40 con 0x7f6f5c12c750 2024-09-10T06:22:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 --2- 172.21.15.84:0/2928927353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c12c210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009740 tx=0x7f6f4c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e92acdb04f8bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f53fff640 1 -- 172.21.15.84:0/2928927353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0b1070 con 0x7f6f5c12be30 2024-09-10T06:22:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f53fff640 1 -- 172.21.15.84:0/2928927353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0ac570 con 0x7f6f5c12be30 2024-09-10T06:22:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f53fff640 1 -- 172.21.15.84:0/2928927353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0ac870 con 0x7f6f5c12be30 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2928927353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 msgr2=0x7f6f5c12c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2928927353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c12c210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009740 tx=0x7f6f4c01c400 comp rx=0 tx=0).stop 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2928927353 shutdown_connections 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2928927353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c12c210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2928927353 >> 172.21.15.84:0/2928927353 conn(0x7f6f5c071790 msgr2=0x7f6f5c10fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2928927353 shutdown_connections 2024-09-10T06:22:29.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2928927353 wait complete. 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 Processor -- start 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- start start 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c134bf0 con 0x7f6f5c12be30 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58500/0 (socket says 172.21.15.84:58500) 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 -- 172.21.15.84:0/2104546963 learned_addr learned my addr 172.21.15.84:0/2104546963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 -- 172.21.15.84:0/2104546963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c130fd0 con 0x7f6f5c12be30 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f6146c640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c01a030 tx=0x7f6f4c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0b1050 con 0x7f6f5c12be30 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0b2040 con 0x7f6f5c12be30 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c131de0 con 0x7f6f5c12be30 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0b6740 con 0x7f6f5c12be30 2024-09-10T06:22:29.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.829+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c1c6910 con 0x7f6f5c12be30 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6f4c0bf030 con 0x7f6f5c12be30 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5c12c210 con 0x7f6f5c12be30 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f51ffb640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 0x7f6f4003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f6f4c0bd070 con 0x7f6f5c12be30 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f60c6b640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 0x7f6f4003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:29.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.833+0000 7f6f60c6b640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 0x7f6f4003d690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:29.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:29.837+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6f4c0c6020 con 0x7f6f5c12be30 2024-09-10T06:22:30.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6f5c12b670 con 0x7f6f5c12be30 2024-09-10T06:22:30.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f51ffb640 1 -- 172.21.15.84:0/2104546963 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6f4c015ff0 con 0x7f6f5c12be30 2024-09-10T06:22:30.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:22:30.042 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T06:22:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 msgr2=0x7f6f4003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 0x7f6f4003d690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58007900 comp rx=0 tx=0).stop 2024-09-10T06:22:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 msgr2=0x7f6f5c1c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c01a030 tx=0x7f6f4c01ac40 comp rx=0 tx=0).stop 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 shutdown_connections 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6f4003b1d0 0x7f6f4003d690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 --2- 172.21.15.84:0/2104546963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f5c12be30 0x7f6f5c1c6200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 >> 172.21.15.84:0/2104546963 conn(0x7f6f5c071790 msgr2=0x7f6f5c123160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 shutdown_connections 2024-09-10T06:22:30.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:22:30.041+0000 7f6f636d0640 1 -- 172.21.15.84:0/2104546963 wait complete. 2024-09-10T06:22:30.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T06:22:30.060 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T06:22:30.075 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T06:22:30.075 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T06:22:30.075 INFO:tasks.rgw:Creating data pools 2024-09-10T06:22:30.075 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T06:22:30.075 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-10T06:22:30.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b39a5640 1 Processor -- start 2024-09-10T06:22:30.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b39a5640 1 -- start start 2024-09-10T06:22:30.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b39a5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3ac1104a0 0x7fb3ac11c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:30.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b39a5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3ac110930 con 0x7fb3ac074bf0 2024-09-10T06:22:30.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b39a5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb3ac110b00 con 0x7fb3ac1104a0 2024-09-10T06:22:30.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b0f40640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3ac1104a0 0x7fb3ac11c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:30.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b1741640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb3ac074bf0 0x7fb3ac10fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:51836/0 (socket says 172.21.15.117:51836) 2024-09-10T06:22:30.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.205+0000 7fb3b1741640 1 -- 172.21.15.117:0/2551974538 learned_addr learned my addr 172.21.15.117:0/2551974538 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:30.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b0f40640 1 -- 172.21.15.117:0/2551974538 >> v1:172.21.15.84:6789/0 conn(0x7fb3ac074bf0 legacy=0x7fb3ac10fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b0f40640 1 -- 172.21.15.117:0/2551974538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac11d670 con 0x7fb3ac1104a0 2024-09-10T06:22:30.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b0f40640 1 --2- 172.21.15.117:0/2551974538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac1104a0 0x7fb3ac11c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009740 tx=0x7fb39c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c29961e6bdc7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:30.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3a3fff640 1 -- 172.21.15.117:0/2551974538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39c0b0070 con 0x7fb3ac1104a0 2024-09-10T06:22:30.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3a3fff640 1 -- 172.21.15.117:0/2551974538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c0ab530 con 0x7fb3ac1104a0 2024-09-10T06:22:30.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3a3fff640 1 -- 172.21.15.117:0/2551974538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39c0ab830 con 0x7fb3ac1104a0 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- 172.21.15.117:0/2551974538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac1104a0 msgr2=0x7fb3ac11c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/2551974538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac1104a0 0x7fb3ac11c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009740 tx=0x7fb39c01c370 comp rx=0 tx=0).stop 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- 172.21.15.117:0/2551974538 shutdown_connections 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/2551974538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac1104a0 0x7fb3ac11c120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- 172.21.15.117:0/2551974538 >> 172.21.15.117:0/2551974538 conn(0x7fb3ac06fe70 msgr2=0x7fb3ac072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- 172.21.15.117:0/2551974538 shutdown_connections 2024-09-10T06:22:30.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- 172.21.15.117:0/2551974538 wait complete. 2024-09-10T06:22:30.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 Processor -- start 2024-09-10T06:22:30.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.209+0000 7fb3b39a5640 1 -- start start 2024-09-10T06:22:30.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b39a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:30.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b39a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac11d320 con 0x7fb3ac074bf0 2024-09-10T06:22:30.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b1741640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:30.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b1741640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45074/0 (socket says 172.21.15.117:45074) 2024-09-10T06:22:30.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b1741640 1 -- 172.21.15.117:0/350576748 learned_addr learned my addr 172.21.15.117:0/350576748 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b1741640 1 -- 172.21.15.117:0/350576748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac1a83f0 con 0x7fb3ac074bf0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b1741640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c480 tx=0x7fb3a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8017070 con 0x7fb3ac074bf0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a8005c20 con 0x7fb3ac074bf0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac1a86e0 con 0x7fb3ac074bf0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3a80070d0 con 0x7fb3ac074bf0 2024-09-10T06:22:30.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac1ad830 con 0x7fb3ac074bf0 2024-09-10T06:22:30.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac10fd90 con 0x7fb3ac074bf0 2024-09-10T06:22:30.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb3a801a070 con 0x7fb3ac074bf0 2024-09-10T06:22:30.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 0x7fb39003d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:30.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb3a804e570 con 0x7fb3ac074bf0 2024-09-10T06:22:30.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.213+0000 7fb3b0f40640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 0x7fb39003d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:30.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.217+0000 7fb3b0f40640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 0x7fb39003d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0ad000 tx=0x7fb39c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:30.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.225+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb3a8021020 con 0x7fb3ac074bf0 2024-09-10T06:22:30.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.397+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fb3ac1a8a20 con 0x7fb3ac074bf0 2024-09-10T06:22:30.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.877+0000 7fb3a1ffb640 1 -- 172.21.15.117:0/350576748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v18) ==== 167+0+0 (secure 0 0 0) 0x7fb3a801ada0 con 0x7fb3ac074bf0 2024-09-10T06:22:30.880 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 msgr2=0x7fb39003d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 0x7fb39003d670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0ad000 tx=0x7fb39c008040 comp rx=0 tx=0).stop 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 msgr2=0x7fb3ac1a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c480 tx=0x7fb3a800c940 comp rx=0 tx=0).stop 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 shutdown_connections 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb39003b1b0 0x7fb39003d670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:30.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 --2- 172.21.15.117:0/350576748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ac074bf0 0x7fb3ac1a7e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:30.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 >> 172.21.15.117:0/350576748 conn(0x7fb3ac06fe70 msgr2=0x7fb3ac118470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:30.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 shutdown_connections 2024-09-10T06:22:30.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:30.881+0000 7fb3b39a5640 1 -- 172.21.15.117:0/350576748 wait complete. 2024-09-10T06:22:30.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T06:22:31.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a3139c640 1 Processor -- start 2024-09-10T06:22:31.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a3139c640 1 -- start start 2024-09-10T06:22:31.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a3139c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a2c113070 0x7f0a2c113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a3139c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2c113b40 con 0x7f0a2c116660 2024-09-10T06:22:31.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a3139c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2c117200 con 0x7f0a2c113070 2024-09-10T06:22:31.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a2affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a2c113070 0x7f0a2c113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a2affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a2c113070 0x7f0a2c113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45088/0 (socket says 172.21.15.117:45088) 2024-09-10T06:22:31.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a2affd640 1 -- 172.21.15.117:0/3879088213 learned_addr learned my addr 172.21.15.117:0/3879088213 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:31.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a2affd640 1 -- 172.21.15.117:0/3879088213 >> v1:172.21.15.84:6789/0 conn(0x7f0a2c116660 legacy=0x7f0a2c116af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.029+0000 7f0a2affd640 1 -- 172.21.15.117:0/3879088213 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c1173b0 con 0x7f0a2c113070 2024-09-10T06:22:31.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a2affd640 1 --2- 172.21.15.117:0/3879088213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c113450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0097f0 tx=0x7f0a1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c536f04f9edd8043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a29ffb640 1 -- 172.21.15.117:0/3879088213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c0ab580 con 0x7f0a2c113070 2024-09-10T06:22:31.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a29ffb640 1 -- 172.21.15.117:0/3879088213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0b0070 con 0x7f0a2c113070 2024-09-10T06:22:31.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a29ffb640 1 -- 172.21.15.117:0/3879088213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c0ab870 con 0x7f0a2c113070 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- 172.21.15.117:0/3879088213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 msgr2=0x7f0a2c113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 --2- 172.21.15.117:0/3879088213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c113450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0097f0 tx=0x7f0a1c01c430 comp rx=0 tx=0).stop 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- 172.21.15.117:0/3879088213 shutdown_connections 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 --2- 172.21.15.117:0/3879088213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c113450 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- 172.21.15.117:0/3879088213 >> 172.21.15.117:0/3879088213 conn(0x7f0a2c06f370 msgr2=0x7f0a2c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- 172.21.15.117:0/3879088213 shutdown_connections 2024-09-10T06:22:31.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- 172.21.15.117:0/3879088213 wait complete. 2024-09-10T06:22:31.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 Processor -- start 2024-09-10T06:22:31.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- start start 2024-09-10T06:22:31.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a3139c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c1214d0 con 0x7f0a2c113070 2024-09-10T06:22:31.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a2affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a2affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45098/0 (socket says 172.21.15.117:45098) 2024-09-10T06:22:31.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.033+0000 7f0a2affd640 1 -- 172.21.15.117:0/4137362805 learned_addr learned my addr 172.21.15.117:0/4137362805 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a2affd640 1 -- 172.21.15.117:0/4137362805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c1aa400 con 0x7f0a2c113070 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a2affd640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01a060 tx=0x7f0a1c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c0aa7d0 con 0x7f0a2c113070 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0aa970 con 0x7f0a2c113070 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c0aac70 con 0x7f0a2c113070 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2c1aa690 con 0x7f0a2c113070 2024-09-10T06:22:31.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2c1af6f0 con 0x7f0a2c113070 2024-09-10T06:22:31.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2c1134d0 con 0x7f0a2c113070 2024-09-10T06:22:31.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a1c0c7440 con 0x7f0a2c113070 2024-09-10T06:22:31.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 0x7f0a1803d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (secure 0 0 0) 0x7f0a1c0e9f00 con 0x7f0a2c113070 2024-09-10T06:22:31.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a2a7fc640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 0x7f0a1803d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.037+0000 7f0a2a7fc640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 0x7f0a1803d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a20000f70 tx=0x7f0a20007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.053+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0a1c0160b0 con 0x7f0a2c113070 2024-09-10T06:22:31.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.221+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f0a2c116660 con 0x7f0a2c113070 2024-09-10T06:22:31.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.777+0000 7f0a137fe640 1 -- 172.21.15.117:0/4137362805 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f0a1c0cc0c0 con 0x7f0a2c113070 2024-09-10T06:22:31.782 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 msgr2=0x7f0a1803d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 0x7f0a1803d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a20000f70 tx=0x7f0a20007a40 comp rx=0 tx=0).stop 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 msgr2=0x7f0a2c1a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01a060 tx=0x7f0a1c01ac70 comp rx=0 tx=0).stop 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 shutdown_connections 2024-09-10T06:22:31.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0a1803b1b0 0x7f0a1803d670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:31.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 --2- 172.21.15.117:0/4137362805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a2c113070 0x7f0a2c1a9e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:31.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 >> 172.21.15.117:0/4137362805 conn(0x7f0a2c06f370 msgr2=0x7f0a2c114d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:31.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 shutdown_connections 2024-09-10T06:22:31.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.781+0000 7f0a3139c640 1 -- 172.21.15.117:0/4137362805 wait complete. 2024-09-10T06:22:31.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T06:22:31.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5914124640 1 Processor -- start 2024-09-10T06:22:31.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5914124640 1 -- start start 2024-09-10T06:22:31.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5914124640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f590c06fff0 0x7f590c06e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5914124640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590c06ee30 con 0x7f590c06e980 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5914124640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f590c06f000 con 0x7f590c06fff0 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5911ec0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f590c06fff0 0x7f590c06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5911ec0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f590c06fff0 0x7f590c06e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45110/0 (socket says 172.21.15.117:45110) 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5911ec0640 1 -- 172.21.15.117:0/1329905224 learned_addr learned my addr 172.21.15.117:0/1329905224 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f59116bf640 1 --1- 172.21.15.117:0/1329905224 >> v1:172.21.15.84:6789/0 conn(0x7f590c06e980 0x7f590c11d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:51846/0 (socket says 172.21.15.117:51846) 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5911ec0640 1 -- 172.21.15.117:0/1329905224 >> v1:172.21.15.84:6789/0 conn(0x7f590c06e980 legacy=0x7f590c11d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.945+0000 7f5911ec0640 1 -- 172.21.15.117:0/1329905224 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c06f1b0 con 0x7f590c06fff0 2024-09-10T06:22:31.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 --2- 172.21.15.117:0/1329905224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06fff0 0x7f590c06e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59000097f0 tx=0x7f590001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be0034e30727e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5910ebe640 1 -- 172.21.15.117:0/1329905224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59000b1070 con 0x7f590c06fff0 2024-09-10T06:22:31.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5910ebe640 1 -- 172.21.15.117:0/1329905224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59000ac560 con 0x7f590c06fff0 2024-09-10T06:22:31.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5910ebe640 1 -- 172.21.15.117:0/1329905224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59000a8050 con 0x7f590c06fff0 2024-09-10T06:22:31.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- 172.21.15.117:0/1329905224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06fff0 msgr2=0x7f590c06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:31.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 --2- 172.21.15.117:0/1329905224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06fff0 0x7f590c06e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59000097f0 tx=0x7f590001c4c0 comp rx=0 tx=0).stop 2024-09-10T06:22:31.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- 172.21.15.117:0/1329905224 shutdown_connections 2024-09-10T06:22:31.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 --2- 172.21.15.117:0/1329905224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06fff0 0x7f590c06e440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:31.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- 172.21.15.117:0/1329905224 >> 172.21.15.117:0/1329905224 conn(0x7f590c071e50 msgr2=0x7f590c074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:31.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- 172.21.15.117:0/1329905224 shutdown_connections 2024-09-10T06:22:31.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- 172.21.15.117:0/1329905224 wait complete. 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 Processor -- start 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- start start 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5914124640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f590c1215d0 con 0x7f590c06e980 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45112/0 (socket says 172.21.15.117:45112) 2024-09-10T06:22:31.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 -- 172.21.15.117:0/3631187241 learned_addr learned my addr 172.21.15.117:0/3631187241 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 -- 172.21.15.117:0/3631187241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c1aa480 con 0x7f590c06e980 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.949+0000 7f5911ec0640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f590001a0f0 tx=0x7f590001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59000bb020 con 0x7f590c06e980 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c1aa770 con 0x7f590c06e980 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59000ab830 con 0x7f590c06e980 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c1af8c0 con 0x7f590c06e980 2024-09-10T06:22:31.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59000b1040 con 0x7f590c06e980 2024-09-10T06:22:31.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c06e440 con 0x7f590c06e980 2024-09-10T06:22:31.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f59000be020 con 0x7f590c06e980 2024-09-10T06:22:31.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 0x7f58f003d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:31.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3884+0+0 (secure 0 0 0) 0x7f59000e9b60 con 0x7f590c06e980 2024-09-10T06:22:31.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f59116bf640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 0x7f58f003d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:31.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.953+0000 7f59116bf640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 0x7f58f003d670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5908001640 tx=0x7f5908007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:31.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:31.965+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f59000c5030 con 0x7f590c06e980 2024-09-10T06:22:32.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.137+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f590c1aaab0 con 0x7f590c06e980 2024-09-10T06:22:32.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.781+0000 7f58fe7fc640 1 -- 172.21.15.117:0/3631187241 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7f59000160b0 con 0x7f590c06e980 2024-09-10T06:22:32.785 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T06:22:32.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 msgr2=0x7f58f003d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:32.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 0x7f58f003d670 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5908001640 tx=0x7f5908007a30 comp rx=0 tx=0).stop 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 msgr2=0x7f590c1a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f590001a0f0 tx=0x7f590001ad00 comp rx=0 tx=0).stop 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 shutdown_connections 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f58f003b1b0 0x7f58f003d670 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 --2- 172.21.15.117:0/3631187241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f590c06e980 0x7f590c1a9eb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 >> 172.21.15.117:0/3631187241 conn(0x7f590c071e50 msgr2=0x7f590c1164c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 shutdown_connections 2024-09-10T06:22:32.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.785+0000 7f5914124640 1 -- 172.21.15.117:0/3631187241 wait complete. 2024-09-10T06:22:32.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T06:22:32.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f5474e34640 1 Processor -- start 2024-09-10T06:22:32.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f5474e34640 1 -- start start 2024-09-10T06:22:32.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f5474e34640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5470112cc0 0x7f5470074600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:32.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f5474e34640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5470074c80 con 0x7f54701127f0 2024-09-10T06:22:32.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f5474e34640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f547011f520 con 0x7f5470112cc0 2024-09-10T06:22:32.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f546dd9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5470112cc0 0x7f5470074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:32.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f546dd9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5470112cc0 0x7f5470074600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45120/0 (socket says 172.21.15.117:45120) 2024-09-10T06:22:32.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f546dd9b640 1 -- 172.21.15.117:0/1783798822 learned_addr learned my addr 172.21.15.117:0/1783798822 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:32.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f546dd9b640 1 -- 172.21.15.117:0/1783798822 >> v1:172.21.15.84:6789/0 conn(0x7f54701127f0 legacy=0x7f5470073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:32.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.929+0000 7f546dd9b640 1 -- 172.21.15.117:0/1783798822 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547011f6a0 con 0x7f5470112cc0 2024-09-10T06:22:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f546dd9b640 1 --2- 172.21.15.117:0/1783798822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5470112cc0 0x7f5470074600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54580097f0 tx=0x7f545801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5b7ee83a66139c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f546d59a640 1 -- 172.21.15.117:0/1783798822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54580ab580 con 0x7f5470112cc0 2024-09-10T06:22:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f546d59a640 1 -- 172.21.15.117:0/1783798822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54580b0070 con 0x7f5470112cc0 2024-09-10T06:22:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f546d59a640 1 -- 172.21.15.117:0/1783798822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54580ab870 con 0x7f5470112cc0 2024-09-10T06:22:32.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- 172.21.15.117:0/1783798822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5470112cc0 msgr2=0x7f5470074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:32.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 --2- 172.21.15.117:0/1783798822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5470112cc0 0x7f5470074600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54580097f0 tx=0x7f545801c430 comp rx=0 tx=0).stop 2024-09-10T06:22:32.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- 172.21.15.117:0/1783798822 shutdown_connections 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 --2- 172.21.15.117:0/1783798822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5470112cc0 0x7f5470074600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- 172.21.15.117:0/1783798822 >> 172.21.15.117:0/1783798822 conn(0x7f547006fe70 msgr2=0x7f5470072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- 172.21.15.117:0/1783798822 shutdown_connections 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- 172.21.15.117:0/1783798822 wait complete. 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 Processor -- start 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- start start 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:32.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.933+0000 7f5474e34640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f547011f200 con 0x7f54701127f0 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45132/0 (socket says 172.21.15.117:45132) 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546e59c640 1 -- 172.21.15.117:0/80059184 learned_addr learned my addr 172.21.15.117:0/80059184 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546e59c640 1 -- 172.21.15.117:0/80059184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54701aa530 con 0x7f54701127f0 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546e59c640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f546800c7f0 tx=0x7f546800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:32.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468003980 con 0x7f54701127f0 2024-09-10T06:22:32.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54701aa820 con 0x7f54701127f0 2024-09-10T06:22:32.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5468003b40 con 0x7f54701127f0 2024-09-10T06:22:32.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468003e60 con 0x7f54701127f0 2024-09-10T06:22:32.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701af970 con 0x7f54701127f0 2024-09-10T06:22:32.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5470074600 con 0x7f54701127f0 2024-09-10T06:22:32.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f546800a820 con 0x7f54701127f0 2024-09-10T06:22:32.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 0x7f545403d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:32.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4220+0+0 (secure 0 0 0) 0x7f546804f930 con 0x7f54701127f0 2024-09-10T06:22:32.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546dd9b640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 0x7f545403d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:32.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.937+0000 7f546dd9b640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 0x7f545403d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54580af000 tx=0x7f54580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:32.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:32.953+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f546800acf0 con 0x7f54701127f0 2024-09-10T06:22:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.121+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f54701aab60 con 0x7f54701127f0 2024-09-10T06:22:33.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.781+0000 7f5466ffd640 1 -- 172.21.15.117:0/80059184 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7f546804d630 con 0x7f54701127f0 2024-09-10T06:22:33.786 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T06:22:33.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.793+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 msgr2=0x7f545403d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:33.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.793+0000 7f5474e34640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 0x7f545403d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f54580af000 tx=0x7f54580a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:33.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.793+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 msgr2=0x7f54701a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:33.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.793+0000 7f5474e34640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f546800c7f0 tx=0x7f546800ccb0 comp rx=0 tx=0).stop 2024-09-10T06:22:33.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 shutdown_connections 2024-09-10T06:22:33.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f545403b1b0 0x7f545403d670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:33.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 --2- 172.21.15.117:0/80059184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54701127f0 0x7f54701a9f60 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f546800c7f0 tx=0x7f546800ccb0 comp rx=0 tx=0).stop 2024-09-10T06:22:33.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 >> 172.21.15.117:0/80059184 conn(0x7f547006fe70 msgr2=0x7f5470070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:33.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 shutdown_connections 2024-09-10T06:22:33.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:33.797+0000 7f5474e34640 1 -- 172.21.15.117:0/80059184 wait complete. 2024-09-10T06:22:33.833 DEBUG:tasks.rgw:Pools created 2024-09-10T06:22:33.833 INFO:tasks.rgw:Starting rgw... 2024-09-10T06:22:33.833 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T06:22:33.833 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T06:22:33.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo echo -n http://smithi117.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T06:22:33.849 INFO:teuthology.orchestra.run.smithi117.stdout:http://smithi117.front.sepia.ceph.com:80 2024-09-10T06:22:33.849 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T06:22:33.904 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T06:22:33.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T06:22:33.947 INFO:tasks.rgw.client.0:Started 2024-09-10T06:22:33.947 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:33.947 DEBUG:teuthology.orchestra.run.smithi117:> curl http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:33.971 INFO:teuthology.orchestra.run.smithi117.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:22:33.971 INFO:teuthology.orchestra.run.smithi117.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:22:33.972 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:22:33.972 INFO:teuthology.orchestra.run.smithi117.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:22:33.973 INFO:teuthology.orchestra.run.smithi117.stderr:curl: (7) Failed to connect to smithi117.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:22:34.973 DEBUG:teuthology.orchestra.run.smithi117:> curl http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:34.984 INFO:teuthology.orchestra.run.smithi117.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:22:34.985 INFO:teuthology.orchestra.run.smithi117.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:22:34.985 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:22:34.986 INFO:teuthology.orchestra.run.smithi117.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:22:34.986 INFO:teuthology.orchestra.run.smithi117.stderr:curl: (7) Failed to connect to smithi117.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:22:36.987 DEBUG:teuthology.orchestra.run.smithi117:> curl http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:36.999 INFO:teuthology.orchestra.run.smithi117.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:22:36.999 INFO:teuthology.orchestra.run.smithi117.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:22:36.999 INFO:teuthology.orchestra.run.smithi117.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:22:36.999 INFO:teuthology.orchestra.run.smithi117.stderr:curl: (7) Failed to connect to smithi117.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:22:36.999 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:22:41.000 DEBUG:teuthology.orchestra.run.smithi117:> curl http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:41.012 INFO:teuthology.orchestra.run.smithi117.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:22:41.012 INFO:teuthology.orchestra.run.smithi117.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:22:41.013 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:22:41.014 INFO:teuthology.orchestra.run.smithi117.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:22:41.014 INFO:teuthology.orchestra.run.smithi117.stderr:curl: (7) Failed to connect to smithi117.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:22:49.015 DEBUG:teuthology.orchestra.run.smithi117:> curl http://smithi117.front.sepia.ceph.com:80/ 2024-09-10T06:22:49.026 INFO:teuthology.orchestra.run.smithi117.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:22:49.026 INFO:teuthology.orchestra.run.smithi117.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:22:49.029 INFO:teuthology.orchestra.run.smithi117.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53246 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-10T06:22:49.030 INFO:teuthology.orchestra.run.smithi117.stdout:anonymous 2024-09-10T06:22:49.031 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-10T06:22:49.109 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-10T06:22:49.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T06:22:49.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T06:22:49.109 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T06:22:49.147 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:49.147 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6d1c469c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e415a3ec60 0x55e415a41050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6d1c469c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4158f09c0 con 0x55e415a41590 2024-09-10T06:22:49.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6d1c469c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55e4159406d0 con 0x55e415a3ec60 2024-09-10T06:22:49.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6cf74c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e415a3ec60 0x55e415a41050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6cf74c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e415a3ec60 0x55e415a41050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41320/0 (socket says 172.21.15.117:41320) 2024-09-10T06:22:49.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6cf74c640 1 -- 172.21.15.117:0/464767383 learned_addr learned my addr 172.21.15.117:0/464767383 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6cf74c640 1 -- 172.21.15.117:0/464767383 >> v1:172.21.15.84:6789/0 conn(0x55e415a41590 legacy=0x55e415a43980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.145+0000 7fe6cf74c640 1 -- 172.21.15.117:0/464767383 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4158e4ca0 con 0x55e415a3ec60 2024-09-10T06:22:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/464767383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415a41050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800a4e0 tx=0x7fe6c801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6be02768e4bc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6ce74a640 1 -- 172.21.15.117:0/464767383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80aa540 con 0x55e415a3ec60 2024-09-10T06:22:49.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6ce74a640 1 -- 172.21.15.117:0/464767383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80aa6e0 con 0x55e415a3ec60 2024-09-10T06:22:49.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6ce74a640 1 -- 172.21.15.117:0/464767383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80aaa40 con 0x55e415a3ec60 2024-09-10T06:22:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/464767383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 msgr2=0x55e415a41050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/464767383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415a41050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800a4e0 tx=0x7fe6c801b090 comp rx=0 tx=0).stop 2024-09-10T06:22:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/464767383 shutdown_connections 2024-09-10T06:22:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/464767383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415a41050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/464767383 >> 172.21.15.117:0/464767383 conn(0x55e4159b1ff0 msgr2=0x55e4159b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/464767383 shutdown_connections 2024-09-10T06:22:49.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.149+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/464767383 wait complete. 2024-09-10T06:22:49.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.165+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.165+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e415944680 con 0x55e415a3ec60 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41330/0 (socket says 172.21.15.117:41330) 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1430754033 learned_addr learned my addr 172.21.15.117:0/1430754033 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1430754033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4158bfda0 con 0x55e415a3ec60 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/1430754033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8018cc0 tx=0x7fe6c80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0024f7eaf96c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe5bd60a640 1 -- 172.21.15.117:0/1430754033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80b9070 con 0x55e415a3ec60 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe5bd60a640 1 -- 172.21.15.117:0/1430754033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80aaa80 con 0x55e415a3ec60 2024-09-10T06:22:49.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe5bd60a640 1 -- 172.21.15.117:0/1430754033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80aad60 con 0x55e415a3ec60 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1430754033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 msgr2=0x55e415b299c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1430754033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8018cc0 tx=0x7fe6c80033b0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1430754033 shutdown_connections 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1430754033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b299c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1430754033 >> 172.21.15.117:0/1430754033 conn(0x55e4159b1ff0 msgr2=0x55e415b25660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1430754033 shutdown_connections 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1430754033 wait complete. 2024-09-10T06:22:49.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b30eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6d1c469c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e4158e6a50 con 0x55e415a3ec60 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b30eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b30eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41332/0 (socket says 172.21.15.117:41332) 2024-09-10T06:22:49.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.169+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1236086346 learned_addr learned my addr 172.21.15.117:0/1236086346 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e415b31410 con 0x55e415a3ec60 2024-09-10T06:22:49.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b30eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8018cc0 tx=0x7fe6c8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 -- 172.21.15.117:0/1236086346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80b9070 con 0x55e415a3ec60 2024-09-10T06:22:49.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e415b316a0 con 0x55e415a3ec60 2024-09-10T06:22:49.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 -- 172.21.15.117:0/1236086346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80b5a50 con 0x55e415a3ec60 2024-09-10T06:22:49.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 -- 172.21.15.117:0/1236086346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80b5d30 con 0x55e415a3ec60 2024-09-10T06:22:49.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e415b32000 con 0x55e415a3ec60 2024-09-10T06:22:49.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 -- 172.21.15.117:0/1236086346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe6c80b3040 con 0x55e415a3ec60 2024-09-10T06:22:49.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b4039a70 0x7fe5b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe5bbe07640 1 -- 172.21.15.117:0/1236086346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe6c80c4070 con 0x55e415a3ec60 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b4039a70 0x7fe5b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415a41590 0x55e415b37fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b38510 con 0x55e415a41590 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415a41590 0x55e415b37fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b4039a70 0x7fe5b403bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001ec0 tx=0x7fe6c4001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415a41590 0x55e415b37fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cff4d640 1 -- 172.21.15.117:0/1236086346 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415a41590 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b32450 con 0x55e415a41590 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.173+0000 7fe6cff4d640 1 -- 172.21.15.117:0/1236086346 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415a41590 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b3a820 0x55e415b3cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b3d300 con 0x55e415b3a820 2024-09-10T06:22:49.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b3a820 0x55e415b3cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b3a820 0x55e415b3cc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1236086346 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6c80cd060 con 0x55e415b3a820 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b396c0 con 0x55e415a41590 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cff4d640 1 -- 172.21.15.117:0/1236086346 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415a41590 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b3e760 0x55e415b40b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b41290 con 0x55e415b3e760 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b3e760 0x55e415b40b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b3e760 0x55e415b40b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cef4b640 1 -- 172.21.15.117:0/1236086346 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6c400d040 con 0x55e415b3e760 2024-09-10T06:22:49.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6d1c469c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e415951450 con 0x55e415b4ed90 2024-09-10T06:22:49.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41344/0 (socket says 172.21.15.117:41344) 2024-09-10T06:22:49.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 -- 172.21.15.117:0/3142617604 learned_addr learned my addr 172.21.15.117:0/3142617604 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.177+0000 7fe6cf74c640 1 -- 172.21.15.117:0/3142617604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e415b4f7f0 con 0x55e415b4ed90 2024-09-10T06:22:49.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80b2cd0 tx=0x7fe6c80c6660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 -- 172.21.15.117:0/3142617604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80a9da0 con 0x55e415b4ed90 2024-09-10T06:22:49.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 -- 172.21.15.117:0/3142617604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80b3330 con 0x55e415b4ed90 2024-09-10T06:22:49.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 -- 172.21.15.117:0/3142617604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80b3630 con 0x55e415b4ed90 2024-09-10T06:22:49.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e415b50050 con 0x55e415b4ed90 2024-09-10T06:22:49.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e415b505c0 con 0x55e415b4ed90 2024-09-10T06:22:49.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 -- 172.21.15.117:0/3142617604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe6c80b39f0 con 0x55e415b4ed90 2024-09-10T06:22:49.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 0x7fe5a803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe5b9602640 1 -- 172.21.15.117:0/3142617604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe6c80da070 con 0x55e415b4ed90 2024-09-10T06:22:49.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 0x7fe5a803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 0x7fe5a803bf80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55e415b389a0 tx=0x7fe6c4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6d1c469c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e415b2a130 con 0x55e415b5b400 2024-09-10T06:22:49.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41356/0 (socket says 172.21.15.117:41356) 2024-09-10T06:22:49.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.181+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1921020325 learned_addr learned my addr 172.21.15.117:0/1921020325 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 -- 172.21.15.117:0/1921020325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e415b5bdb0 con 0x55e415b5b400 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/1921020325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80c6bd0 tx=0x7fe6c80de820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316dd675fe7f161c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b2ffd640 1 -- 172.21.15.117:0/1921020325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80fd020 con 0x55e415b5b400 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b2ffd640 1 -- 172.21.15.117:0/1921020325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80de9e0 con 0x55e415b5b400 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b2ffd640 1 -- 172.21.15.117:0/1921020325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80d2e00 con 0x55e415b5b400 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1921020325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 msgr2=0x55e415b5b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1921020325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80c6bd0 tx=0x7fe6c80de820 comp rx=0 tx=0).stop 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1921020325 shutdown_connections 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1921020325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b5b7e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1921020325 >> 172.21.15.117:0/1921020325 conn(0x55e415b57830 msgr2=0x55e415b55a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1921020325 shutdown_connections 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1921020325 wait complete. 2024-09-10T06:22:49.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 Processor -- start 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- start start 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b62710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e415b5c290 con 0x55e415b5b400 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b62710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b62710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41358/0 (socket says 172.21.15.117:41358) 2024-09-10T06:22:49.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 learned_addr learned my addr 172.21.15.117:0/2370009769 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e415b62c70 con 0x55e415b5b400 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b62710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80cf750 tx=0x7fe6c80a9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b17fa640 1 -- 172.21.15.117:0/2370009769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c8111070 con 0x55e415b5b400 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e415b62c70 con 0x55e415b5b400 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b17fa640 1 -- 172.21.15.117:0/2370009769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c80de9e0 con 0x55e415b5b400 2024-09-10T06:22:49.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe5b17fa640 1 -- 172.21.15.117:0/2370009769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6c80de640 con 0x55e415b5b400 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.185+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e415b632a0 con 0x55e415b5b400 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe5b17fa640 1 -- 172.21.15.117:0/2370009769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe6c8114070 con 0x55e415b5b400 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe5b17fa640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe598039a20 0x7fe59803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe5b17fa640 1 -- 172.21.15.117:0/2370009769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fe6c8109050 con 0x55e415b5b400 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe598039a20 0x7fe59803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415b6d9a0 0x55e415b6fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b70580 con 0x55e415b6d9a0 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415b6d9a0 0x55e415b6fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe598039a20 0x7fe59803bee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4010fd0 tx=0x7fe6c4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415b6d9a0 0x55e415b6fe30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 realm 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b70990 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71260 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415b6d9a0 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b72130 0x55e415b74520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b74c60 con 0x55e415b72130 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b72130 0x55e415b74520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.189+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b72130 0x55e415b74520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6d1c469c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6d1c469c0 20 searching for the correct realm 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b76c00 0x55e415b79070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b79740 con 0x55e415b76c00 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b76c00 0x55e415b79070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cef4b640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b76c00 0x55e415b79070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b79740 con 0x55e415b72130 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cf74c640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe6c8116060 0x7fe6c80e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b79740 con 0x7fe6c8116060 2024-09-10T06:22:49.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe6c8116060 0x7fe6c80e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe6c8116060 0x7fe6c80e27e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00083f0 con 0x7fe6c8116060 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c00083f0 con 0x55e415b6d9a0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.193+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b72130 2024-09-10T06:22:49.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b72130 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.197+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b72130 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.201+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b72130 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b76c00 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x7fe6c8116060 2024-09-10T06:22:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b6d9a0 2024-09-10T06:22:49.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b71600 con 0x55e415b72130 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.205+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b6d9a0 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75910 con 0x55e415b6d9a0 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75910 con 0x55e415b76c00 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 zone default found 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 4 Realm: () 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 zonegroup default 2024-09-10T06:22:49.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b79bc0 con 0x7fe6c8116060 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7b5b0 con 0x55e415b76c00 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7b950 con 0x55e415b76c00 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 started sync module instance, tier type = 2024-09-10T06:22:49.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:49.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7aa50 con 0x55e415b72130 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94438105263680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7a6b0 con 0x55e415b72130 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.209+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7c880 con 0x55e415b6d9a0 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.213+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94438105263680] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.213+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.213+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438105269200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7cca0 con 0x55e415b6d9a0 2024-09-10T06:22:49.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.213+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7d660 con 0x55e415b76c00 2024-09-10T06:22:49.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94438105269200] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94438105270256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7cc10 con 0x55e415b76c00 2024-09-10T06:22:49.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94438105276080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7ec00 con 0x55e415b72130 2024-09-10T06:22:49.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7f5c0 con 0x55e415b6d9a0 2024-09-10T06:22:49.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.217+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94438105270256] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94438105276080] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94438105280784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7ec00 con 0x55e415b6d9a0 2024-09-10T06:22:49.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7f530 con 0x7fe6c8116060 2024-09-10T06:22:49.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94438105280784] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94438105278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7eb70 con 0x7fe6c8116060 2024-09-10T06:22:49.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.221+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b803f0 con 0x7fe6c8116060 2024-09-10T06:22:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.225+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.225+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94438105284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b80810 con 0x7fe6c8116060 2024-09-10T06:22:49.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.225+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b81270 con 0x7fe6c8116060 2024-09-10T06:22:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94438105278288] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94438105288016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b81270 con 0x7fe6c8116060 2024-09-10T06:22:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=0 2024-09-10T06:22:49.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=1 2024-09-10T06:22:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=2 2024-09-10T06:22:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=3 2024-09-10T06:22:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=4 2024-09-10T06:22:49.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=5 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94438105284416] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=6 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94438105288016] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 20 add_watcher() i=7 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:49.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e415b842a0 con 0x55e415b6d9a0 2024-09-10T06:22:49.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.229+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94438105282768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b81720 con 0x55e415b6d9a0 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94438105282768] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 5 note: GC not initialized 2024-09-10T06:22:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe584fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 20 Filter name: none 2024-09-10T06:22:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe4fe7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415ba6f10 con 0x55e415b76c00 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7d660 con 0x55e415b76c00 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7d660 con 0x55e415b6d9a0 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.233+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b6d9a0 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b72130 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.237+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.241+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x7fe6c8116060 2024-09-10T06:22:49.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.245+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b6d9a0 2024-09-10T06:22:49.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b76c00 2024-09-10T06:22:49.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e360 con 0x55e415b72130 2024-09-10T06:22:49.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94438105282768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7d660 con 0x55e415b6d9a0 2024-09-10T06:22:49.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94438105282768] v30'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.249+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94438105263680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b72130 2024-09-10T06:22:49.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94438105263680] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6d1c469c0 20 remove_watcher() i=0 2024-09-10T06:22:49.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6d1c469c0 2 removed watcher, disabling cache 2024-09-10T06:22:49.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94438105269200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b6d9a0 2024-09-10T06:22:49.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94438105269200] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6d1c469c0 20 remove_watcher() i=1 2024-09-10T06:22:49.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.253+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94438105270256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b75520 con 0x55e415b76c00 2024-09-10T06:22:49.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6cef4b640 1 -- 172.21.15.117:0/2370009769 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94438105270256] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c4036040 con 0x55e415b76c00 2024-09-10T06:22:49.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6d1c469c0 20 remove_watcher() i=2 2024-09-10T06:22:49.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94438105276080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7ae40 con 0x55e415b72130 2024-09-10T06:22:49.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6cf74c640 1 -- 172.21.15.117:0/2370009769 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94438105276080] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c8113030 con 0x55e415b72130 2024-09-10T06:22:49.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6d1c469c0 20 remove_watcher() i=3 2024-09-10T06:22:49.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.257+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94438105280784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7ae40 con 0x55e415b6d9a0 2024-09-10T06:22:49.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94438105280784] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x55e415b6d9a0 2024-09-10T06:22:49.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6d1c469c0 20 remove_watcher() i=4 2024-09-10T06:22:49.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94438105278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7f110 con 0x7fe6c8116060 2024-09-10T06:22:49.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94438105278288] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6d1c469c0 20 remove_watcher() i=5 2024-09-10T06:22:49.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.261+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94438105284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7ae40 con 0x7fe6c8116060 2024-09-10T06:22:49.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.265+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94438105284416] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.265+0000 7fe6d1c469c0 20 remove_watcher() i=6 2024-09-10T06:22:49.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.265+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94438105288016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e415b7e750 con 0x7fe6c8116060 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94438105288016] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6c0026040 con 0x7fe6c8116060 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 20 remove_watcher() i=7 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe6c8116060 msgr2=0x7fe6c80e27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe6c8116060 0x7fe6c80e27e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415b6d9a0 msgr2=0x55e415b6fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415b6d9a0 0x55e415b6fe30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b72130 msgr2=0x55e415b74520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b72130 0x55e415b74520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b76c00 msgr2=0x55e415b79070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b76c00 0x55e415b79070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe598039a20 msgr2=0x7fe59803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe598039a20 0x7fe59803bee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4010fd0 tx=0x7fe6c4011000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 msgr2=0x55e415b62710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/2370009769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b5b400 0x55e415b62710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80cf750 tx=0x7fe6c80a9f90 comp rx=0 tx=0).stop 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6cff4d640 1 -- 172.21.15.117:0/2370009769 reap_dead start 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 shutdown_connections 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 >> 172.21.15.117:0/2370009769 conn(0x55e415b57830 msgr2=0x55e415b55a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 shutdown_connections 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/2370009769 wait complete. 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 msgr2=0x7fe5a803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 0x7fe5a803bf80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55e415b389a0 tx=0x7fe6c4006000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 msgr2=0x55e415b4f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80b2cd0 tx=0x7fe6c80c6660 comp rx=0 tx=0).stop 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 shutdown_connections 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5a8039ac0 0x7fe5a803bf80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/3142617604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415b4ed90 0x55e415b4f1b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 >> 172.21.15.117:0/3142617604 conn(0x55e415b44740 msgr2=0x55e415b44b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 shutdown_connections 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/3142617604 wait complete. 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415a41590 msgr2=0x55e415b37fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e415a41590 0x55e415b37fd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b3a820 msgr2=0x55e415b3cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e415b3a820 0x55e415b3cc10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b3e760 msgr2=0x55e415b40b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e415b3e760 0x55e415b40b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b4039a70 msgr2=0x7fe5b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b4039a70 0x7fe5b403bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001ec0 tx=0x7fe6c4001440 comp rx=0 tx=0).stop 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 msgr2=0x55e415b30eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 --2- 172.21.15.117:0/1236086346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e415a3ec60 0x55e415b30eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8018cc0 tx=0x7fe6c8017e30 comp rx=0 tx=0).stop 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6cff4d640 1 -- 172.21.15.117:0/1236086346 reap_dead start 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 shutdown_connections 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 >> 172.21.15.117:0/1236086346 conn(0x55e4159b1ff0 msgr2=0x55e415b240f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 shutdown_connections 2024-09-10T06:22:49.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.269+0000 7fe6d1c469c0 1 -- 172.21.15.117:0/1236086346 wait complete. 2024-09-10T06:22:49.284 INFO:teuthology.orchestra.run.smithi117.stdout:[] 2024-09-10T06:22:49.284 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T06:22:49.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-10T06:22:49.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-10T06:22:49.284 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-10T06:22:49.363 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:49.363 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:49.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b889a69c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563fc44127b0 0x563fc44a1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b889a69c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fc43529c0 con 0x563fc44a16a0 2024-09-10T06:22:49.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b889a69c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x563fc43a26d0 con 0x563fc44127b0 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b864ac640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563fc44127b0 0x563fc44a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b864ac640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563fc44127b0 0x563fc44a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41370/0 (socket says 172.21.15.117:41370) 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b864ac640 1 -- 172.21.15.117:0/3212327286 learned_addr learned my addr 172.21.15.117:0/3212327286 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b85cab640 1 --1- 172.21.15.117:0/3212327286 >> v1:172.21.15.84:6789/0 conn(0x563fc44a16a0 0x563fc44a3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44104/0 (socket says 172.21.15.117:44104) 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b864ac640 1 -- 172.21.15.117:0/3212327286 >> v1:172.21.15.84:6789/0 conn(0x563fc44a16a0 legacy=0x563fc44a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.361+0000 7f6b864ac640 1 -- 172.21.15.117:0/3212327286 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc4346ca0 con 0x563fc44127b0 2024-09-10T06:22:49.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b864ac640 1 --2- 172.21.15.117:0/3212327286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc44a1160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a5c0 tx=0x7f6b7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a368f575f218f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b854aa640 1 -- 172.21.15.117:0/3212327286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780b1070 con 0x563fc44127b0 2024-09-10T06:22:49.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b854aa640 1 -- 172.21.15.117:0/3212327286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780a8070 con 0x563fc44127b0 2024-09-10T06:22:49.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b854aa640 1 -- 172.21.15.117:0/3212327286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780ac5b0 con 0x563fc44127b0 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3212327286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 msgr2=0x563fc44a1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3212327286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc44a1160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a5c0 tx=0x7f6b7801b340 comp rx=0 tx=0).stop 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3212327286 shutdown_connections 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3212327286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc44a1160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3212327286 >> 172.21.15.117:0/3212327286 conn(0x563fc4498e90 msgr2=0x563fc449b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3212327286 shutdown_connections 2024-09-10T06:22:49.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.365+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3212327286 wait complete. 2024-09-10T06:22:49.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.381+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.381+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.381+0000 7f6b889a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.381+0000 7f6b889a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fc43a6680 con 0x563fc44127b0 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.381+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41372/0 (socket says 172.21.15.117:41372) 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 -- 172.21.15.117:0/2958960667 learned_addr learned my addr 172.21.15.117:0/2958960667 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 -- 172.21.15.117:0/2958960667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc4321da0 con 0x563fc44127b0 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 --2- 172.21.15.117:0/2958960667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b780af040 tx=0x7f6b78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18d33cb146aec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6a74608640 1 -- 172.21.15.117:0/2958960667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780b1040 con 0x563fc44127b0 2024-09-10T06:22:49.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6a74608640 1 -- 172.21.15.117:0/2958960667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780ac820 con 0x563fc44127b0 2024-09-10T06:22:49.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6a74608640 1 -- 172.21.15.117:0/2958960667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780acb00 con 0x563fc44127b0 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2958960667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 msgr2=0x563fc449e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2958960667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b780af040 tx=0x7f6b78003030 comp rx=0 tx=0).stop 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2958960667 shutdown_connections 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2958960667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44127b0 0x563fc449e640 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b780af040 tx=0x7f6b78003030 comp rx=0 tx=0).stop 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2958960667 >> 172.21.15.117:0/2958960667 conn(0x563fc4498e90 msgr2=0x563fc4585530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2958960667 shutdown_connections 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2958960667 wait complete. 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 0x563fc4593350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b889a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fc4348a50 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 0x563fc4593350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 0x563fc4593350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41386/0 (socket says 172.21.15.117:41386) 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 -- 172.21.15.117:0/3376898528 learned_addr learned my addr 172.21.15.117:0/3376898528 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc45938b0 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.385+0000 7f6b864ac640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 0x563fc4593350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b78018f70 tx=0x7f6b78019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 -- 172.21.15.117:0/3376898528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780cd070 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fc4593b40 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 -- 172.21.15.117:0/3376898528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780b7880 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc4594400 con 0x563fc44a16a0 2024-09-10T06:22:49.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 -- 172.21.15.117:0/3376898528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780b1070 con 0x563fc44a16a0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 -- 172.21.15.117:0/3376898528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b780d0070 con 0x563fc44a16a0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a6c039ac0 0x7f6a6c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6a72e05640 1 -- 172.21.15.117:0/3376898528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6b780eacc0 con 0x563fc44a16a0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b85cab640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a6c039ac0 0x7f6a6c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45983c0 0x563fc459a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc459acf0 con 0x563fc45983c0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b86cad640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45983c0 0x563fc459a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b85cab640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a6c039ac0 0x7f6a6c03bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001e90 tx=0x7f6b7c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b86cad640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45983c0 0x563fc459a7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b86cad640 1 -- 172.21.15.117:0/3376898528 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45983c0 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc459b090 con 0x563fc45983c0 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b86cad640 1 -- 172.21.15.117:0/3376898528 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45983c0 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc459ce70 0x563fc459f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc459f930 con 0x563fc459ce70 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b864ac640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc459ce70 0x563fc459f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.389+0000 7f6b864ac640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc459ce70 0x563fc459f260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 -- 172.21.15.117:0/3376898528 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b780cf030 con 0x563fc459ce70 2024-09-10T06:22:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc459bce0 con 0x563fc45983c0 2024-09-10T06:22:49.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b86cad640 1 -- 172.21.15.117:0/3376898528 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45983c0 2024-09-10T06:22:49.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45a0d90 0x563fc45a3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45a38f0 con 0x563fc45a0d90 2024-09-10T06:22:49.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b85cab640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45a0d90 0x563fc45a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b85cab640 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45a0d90 0x563fc45a3180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b85cab640 1 -- 172.21.15.117:0/3376898528 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b7c00f6e0 con 0x563fc45a0d90 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fc43b3450 con 0x563fc45b13f0 2024-09-10T06:22:49.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41388/0 (socket says 172.21.15.117:41388) 2024-09-10T06:22:49.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 -- 172.21.15.117:0/2056677078 learned_addr learned my addr 172.21.15.117:0/2056677078 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 -- 172.21.15.117:0/2056677078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc45b1e50 con 0x563fc45b13f0 2024-09-10T06:22:49.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b864ac640 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b78003050 tx=0x7f6b780c84c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6a6bfff640 1 -- 172.21.15.117:0/2056677078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780c1b20 con 0x563fc45b13f0 2024-09-10T06:22:49.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fc45b26b0 con 0x563fc45b13f0 2024-09-10T06:22:49.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc45b2c20 con 0x563fc45b13f0 2024-09-10T06:22:49.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6a6bfff640 1 -- 172.21.15.117:0/2056677078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780c1cc0 con 0x563fc45b13f0 2024-09-10T06:22:49.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.393+0000 7f6a6bfff640 1 -- 172.21.15.117:0/2056677078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780067f0 con 0x563fc45b13f0 2024-09-10T06:22:49.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a6bfff640 1 -- 172.21.15.117:0/2056677078 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b780aa070 con 0x563fc45b13f0 2024-09-10T06:22:49.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a6bfff640 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 0x7f6a6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a6bfff640 1 -- 172.21.15.117:0/2056677078 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6b780e5030 con 0x563fc45b13f0 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b85cab640 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 0x7f6a6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b85cab640 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 0x7f6a6003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x563fc4594770 tx=0x7f6b7c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fc449ee30 con 0x563fc45beb20 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41404/0 (socket says 172.21.15.117:41404) 2024-09-10T06:22:49.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b864ac640 1 -- 172.21.15.117:0/1277441336 learned_addr learned my addr 172.21.15.117:0/1277441336 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b864ac640 1 -- 172.21.15.117:0/1277441336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc45bf510 con 0x563fc45beb20 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b864ac640 1 --2- 172.21.15.117:0/1277441336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c1100 tx=0x7f6b780b4680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1086f5f3d717703 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a69ffb640 1 -- 172.21.15.117:0/1277441336 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b78102020 con 0x563fc45beb20 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a69ffb640 1 -- 172.21.15.117:0/1277441336 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780d2440 con 0x563fc45beb20 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6a69ffb640 1 -- 172.21.15.117:0/1277441336 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780ea790 con 0x563fc45beb20 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1277441336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 msgr2=0x563fc45bef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1277441336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c1100 tx=0x7f6b780b4680 comp rx=0 tx=0).stop 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1277441336 shutdown_connections 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1277441336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45bef20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1277441336 >> 172.21.15.117:0/1277441336 conn(0x563fc45b9f40 msgr2=0x563fc45b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1277441336 shutdown_connections 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.397+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1277441336 wait complete. 2024-09-10T06:22:49.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 Processor -- start 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 -- start start 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fc45bd8f0 con 0x563fc45beb20 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b864ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41410/0 (socket says 172.21.15.117:41410) 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 learned_addr learned my addr 172.21.15.117:0/1015944019 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc45c53a0 con 0x563fc45beb20 2024-09-10T06:22:49.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b864ac640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c1890 tx=0x7f6b780bafb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 -- 172.21.15.117:0/1015944019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b78117070 con 0x563fc45beb20 2024-09-10T06:22:49.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fc45c53a0 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc45c53a0 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 -- 172.21.15.117:0/1015944019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b780ea410 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 -- 172.21.15.117:0/1015944019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b780b4400 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 -- 172.21.15.117:0/1015944019 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b7811a070 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a50039a70 0x7f6a5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6a57fff640 1 -- 172.21.15.117:0/1015944019 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6b7810d030 con 0x563fc45beb20 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b85cab640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a50039a70 0x7f6a5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45cff60 0x563fc45d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.401+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d2b40 con 0x563fc45cff60 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45cff60 0x563fc45d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b85cab640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a50039a70 0x7f6a5003bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x563fc45a3cf0 tx=0x7f6b7c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45cff60 0x563fc45d23f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 realm 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d2f50 con 0x563fc45cff60 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3820 con 0x563fc45cff60 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc45d4920 0x563fc45d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d7320 con 0x563fc45d4920 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc45d4920 0x563fc45d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc45d4920 0x563fc45d6d10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 20 searching for the correct realm 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45d9200 0x563fc45db630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dbcb0 con 0x563fc45d9200 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b85cab640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45d9200 0x563fc45db630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b85cab640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45d9200 0x563fc45db630 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dbcb0 con 0x563fc45d4920 2024-09-10T06:22:49.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6b7811c060 0x7f6b780f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.405+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dbcb0 con 0x7f6b7811c060 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6b7811c060 0x7f6b780f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6b7811c060 0x7f6b780f56e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d4920 2024-09-10T06:22:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.409+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d4920 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.413+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d4920 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d4920 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.417+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d9200 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x7f6b7811c060 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45cff60 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d3bc0 con 0x563fc45d4920 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d7b70 con 0x563fc45cff60 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d7f60 con 0x563fc45cff60 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45d7f60 con 0x563fc45d9200 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 zone default found 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 4 Realm: () 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:49.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 zonegroup default 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dc130 con 0x7f6b7811c060 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45ddc20 con 0x563fc45d9200 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45de0d0 con 0x563fc45d9200 2024-09-10T06:22:49.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 started sync module instance, tier type = 2024-09-10T06:22:49.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:49.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.421+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dcfc0 con 0x563fc45d4920 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94831877411760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dcc20 con 0x563fc45d4920 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45df000 con 0x563fc45cff60 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94831877418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45df730 con 0x563fc45cff60 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.425+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e0250 con 0x563fc45d9200 2024-09-10T06:22:49.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.429+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94831877411760] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.429+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94831877418080] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94831877422368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45df180 con 0x563fc45d9200 2024-09-10T06:22:49.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e0af0 con 0x563fc45d4920 2024-09-10T06:22:49.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94831877426832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e1760 con 0x563fc45d4920 2024-09-10T06:22:49.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e2120 con 0x563fc45cff60 2024-09-10T06:22:49.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94831877422368] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94831877426832] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94831877430384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e2540 con 0x563fc45cff60 2024-09-10T06:22:49.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.433+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e12d0 con 0x7f6b7811c060 2024-09-10T06:22:49.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.437+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94831877430384] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.437+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.437+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94831877431440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e2960 con 0x7f6b7811c060 2024-09-10T06:22:49.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.437+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e31f0 con 0x7f6b7811c060 2024-09-10T06:22:49.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94831877433696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e3880 con 0x7f6b7811c060 2024-09-10T06:22:49.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e4130 con 0x7f6b7811c060 2024-09-10T06:22:49.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94831877431440] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94831877432496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e4310 con 0x7f6b7811c060 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=0 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=1 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=2 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=3 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=4 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=5 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94831877433696] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.441+0000 7f6b889a69c0 20 add_watcher() i=6 2024-09-10T06:22:49.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94831877432496] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 20 add_watcher() i=7 2024-09-10T06:22:49.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:49.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e7230 con 0x563fc45cff60 2024-09-10T06:22:49.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94831877436576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e46b0 con 0x563fc45cff60 2024-09-10T06:22:49.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94831877436576] v30'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:49.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:49.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.445+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45ef920 con 0x563fc45cff60 2024-09-10T06:22:49.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.449+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.449+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45ef920 con 0x7f6b7811c060 2024-09-10T06:22:49.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.449+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.449+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f03e0 con 0x563fc45d9200 2024-09-10T06:22:49.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.453+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.453+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f0e00 con 0x563fc45cff60 2024-09-10T06:22:49.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.457+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.457+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45edf80 con 0x563fc45d4920 2024-09-10T06:22:49.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.457+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.457+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45edf80 con 0x563fc45d9200 2024-09-10T06:22:49.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.461+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.461+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45edf80 con 0x563fc45cff60 2024-09-10T06:22:49.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.461+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.461+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1960 con 0x7f6b7811c060 2024-09-10T06:22:49.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.465+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.465+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1960 con 0x563fc45d4920 2024-09-10T06:22:49.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.465+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.465+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1960 con 0x563fc45d9200 2024-09-10T06:22:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.469+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.469+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x563fc45d4920 2024-09-10T06:22:49.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.469+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.469+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x7f6b7811c060 2024-09-10T06:22:49.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.473+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.473+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x563fc45d4920 2024-09-10T06:22:49.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.473+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.473+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x7f6b7811c060 2024-09-10T06:22:49.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.477+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.477+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x563fc45cff60 2024-09-10T06:22:49.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.477+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.477+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1e10 con 0x563fc45d9200 2024-09-10T06:22:49.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.481+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.481+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1ea0 con 0x563fc45d4920 2024-09-10T06:22:49.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.481+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.481+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1ea0 con 0x563fc45d9200 2024-09-10T06:22:49.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.485+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.485+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45cff60 2024-09-10T06:22:49.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.489+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.489+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45cff60 2024-09-10T06:22:49.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.489+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.489+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45d9200 2024-09-10T06:22:49.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.493+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.493+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45d4920 2024-09-10T06:22:49.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.493+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.493+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45d9200 2024-09-10T06:22:49.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.497+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.497+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f1fd0 con 0x563fc45d9200 2024-09-10T06:22:49.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.497+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.497+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x563fc45d9200 2024-09-10T06:22:49.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.501+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.501+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x563fc45d9200 2024-09-10T06:22:49.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.501+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.501+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x7f6b7811c060 2024-09-10T06:22:49.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.505+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.505+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x563fc45d9200 2024-09-10T06:22:49.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.509+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.509+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x7f6b7811c060 2024-09-10T06:22:49.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.509+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.509+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x563fc45d9200 2024-09-10T06:22:49.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.513+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.513+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x7f6b7811c060 2024-09-10T06:22:49.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.517+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.517+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45f2480 con 0x563fc45d4920 2024-09-10T06:22:49.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.517+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f69b77fe640 20 reqs_thread_entry: start 2024-09-10T06:22:49.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:49.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 20 Filter name: none 2024-09-10T06:22:49.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f69b57fa640 20 reqs_thread_entry: start 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563fc460d4b0 con 0x563fc45d4920 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-10T06:22:49.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:22:49.524 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T06:22:49.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.521+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94831877436576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45ec2b0 con 0x563fc45cff60 2024-09-10T06:22:49.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94831877436576] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94831877411760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e34a0 con 0x563fc45d4920 2024-09-10T06:22:49.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94831877411760] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b889a69c0 20 remove_watcher() i=0 2024-09-10T06:22:49.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b889a69c0 2 removed watcher, disabling cache 2024-09-10T06:22:49.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.525+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94831877418080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x563fc45cff60 2024-09-10T06:22:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.529+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94831877418080] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.529+0000 7f6b889a69c0 20 remove_watcher() i=1 2024-09-10T06:22:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.529+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94831877422368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x563fc45d9200 2024-09-10T06:22:49.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b85cab640 1 -- 172.21.15.117:0/1015944019 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94831877422368] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c037040 con 0x563fc45d9200 2024-09-10T06:22:49.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 20 remove_watcher() i=2 2024-09-10T06:22:49.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94831877426832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x563fc45d4920 2024-09-10T06:22:49.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b864ac640 1 -- 172.21.15.117:0/1015944019 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94831877426832] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b78119030 con 0x563fc45d4920 2024-09-10T06:22:49.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 20 remove_watcher() i=3 2024-09-10T06:22:49.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94831877430384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x563fc45cff60 2024-09-10T06:22:49.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94831877430384] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x563fc45cff60 2024-09-10T06:22:49.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 20 remove_watcher() i=4 2024-09-10T06:22:49.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.533+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94831877431440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45e1c70 con 0x7f6b7811c060 2024-09-10T06:22:49.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.537+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94831877431440] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.537+0000 7f6b889a69c0 20 remove_watcher() i=5 2024-09-10T06:22:49.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.537+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94831877433696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x7f6b7811c060 2024-09-10T06:22:49.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94831877433696] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 20 remove_watcher() i=6 2024-09-10T06:22:49.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94831877432496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563fc45dd3b0 con 0x7f6b7811c060 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94831877432496] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b8000a4d0 con 0x7f6b7811c060 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 20 remove_watcher() i=7 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6b7811c060 msgr2=0x7f6b780f56e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6b7811c060 0x7f6b780f56e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45cff60 msgr2=0x563fc45d23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45cff60 0x563fc45d23f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc45d4920 msgr2=0x563fc45d6d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc45d4920 0x563fc45d6d10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45d9200 msgr2=0x563fc45db630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45d9200 0x563fc45db630 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a50039a70 msgr2=0x7f6a5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a50039a70 0x7f6a5003bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x563fc45a3cf0 tx=0x7f6b7c010000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b86cad640 1 -- 172.21.15.117:0/1015944019 reap_dead start 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 msgr2=0x563fc45c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c1890 tx=0x7f6b780bafb0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 shutdown_connections 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/1015944019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45beb20 0x563fc45c4e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 >> 172.21.15.117:0/1015944019 conn(0x563fc45b9f40 msgr2=0x563fc45b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 shutdown_connections 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/1015944019 wait complete. 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 msgr2=0x7f6a6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 0x7f6a6003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x563fc4594770 tx=0x7f6b7c00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 msgr2=0x563fc45b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b78003050 tx=0x7f6b780c84c0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 shutdown_connections 2024-09-10T06:22:49.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a60039a70 0x7f6a6003bf30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/2056677078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc45b13f0 0x563fc45b1810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 >> 172.21.15.117:0/2056677078 conn(0x563fc45a6da0 msgr2=0x563fc45a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 shutdown_connections 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/2056677078 wait complete. 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45983c0 msgr2=0x563fc459a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563fc45983c0 0x563fc459a7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc459ce70 msgr2=0x563fc459f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563fc459ce70 0x563fc459f260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45a0d90 msgr2=0x563fc45a3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.541+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563fc45a0d90 0x563fc45a3180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a6c039ac0 msgr2=0x7f6a6c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a6c039ac0 0x7f6a6c03bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c001e90 tx=0x7f6b7c0013f0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 msgr2=0x563fc4593350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 --2- 172.21.15.117:0/3376898528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fc44a16a0 0x563fc4593350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b78018f70 tx=0x7f6b78019b80 comp rx=0 tx=0).stop 2024-09-10T06:22:49.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b86cad640 1 -- 172.21.15.117:0/3376898528 reap_dead start 2024-09-10T06:22:49.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 shutdown_connections 2024-09-10T06:22:49.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 >> 172.21.15.117:0/3376898528 conn(0x563fc4498e90 msgr2=0x563fc449d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 shutdown_connections 2024-09-10T06:22:49.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.545+0000 7f6b889a69c0 1 -- 172.21.15.117:0/3376898528 wait complete. 2024-09-10T06:22:49.558 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T06:22:49.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-10T06:22:49.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-10T06:22:49.559 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-10T06:22:49.638 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:49.638 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:49.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b2e739c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577d48fc4d0 0x5577d48fc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b2e739c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577d48399c0 con 0x5577d48ff6b0 2024-09-10T06:22:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b2e739c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5577d48896d0 con 0x5577d48fc4d0 2024-09-10T06:22:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b0979640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577d48fc4d0 0x5577d48fc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b0979640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577d48fc4d0 0x5577d48fc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41412/0 (socket says 172.21.15.117:41412) 2024-09-10T06:22:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b0979640 1 -- 172.21.15.117:0/1222645805 learned_addr learned my addr 172.21.15.117:0/1222645805 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b0979640 1 -- 172.21.15.117:0/1222645805 >> v1:172.21.15.84:6789/0 conn(0x5577d48ff6b0 legacy=0x5577d48ffac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.637+0000 7ff1b0979640 1 -- 172.21.15.117:0/1222645805 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d482dca0 con 0x5577d48fc4d0 2024-09-10T06:22:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b0979640 1 --2- 172.21.15.117:0/1222645805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d48fc8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800a4e0 tx=0x7ff1a801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fffb9015b9803e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1af977640 1 -- 172.21.15.117:0/1222645805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80aa540 con 0x5577d48fc4d0 2024-09-10T06:22:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1af977640 1 -- 172.21.15.117:0/1222645805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80aa6e0 con 0x5577d48fc4d0 2024-09-10T06:22:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1af977640 1 -- 172.21.15.117:0/1222645805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80aaa40 con 0x5577d48fc4d0 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1222645805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 msgr2=0x5577d48fc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/1222645805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d48fc8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800a4e0 tx=0x7ff1a801b090 comp rx=0 tx=0).stop 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1222645805 shutdown_connections 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/1222645805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d48fc8b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1222645805 >> 172.21.15.117:0/1222645805 conn(0x5577d48fb010 msgr2=0x5577d48fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1222645805 shutdown_connections 2024-09-10T06:22:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.641+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1222645805 wait complete. 2024-09-10T06:22:49.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b2e739c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b2e739c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577d488d680 con 0x5577d48fc4d0 2024-09-10T06:22:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41428/0 (socket says 172.21.15.117:41428) 2024-09-10T06:22:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b0979640 1 -- 172.21.15.117:0/1373109978 learned_addr learned my addr 172.21.15.117:0/1373109978 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.657+0000 7ff1b0979640 1 -- 172.21.15.117:0/1373109978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d4808da0 con 0x5577d48fc4d0 2024-09-10T06:22:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 --2- 172.21.15.117:0/1373109978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80ac040 tx=0x7ff1a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6708cb59495f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09ee0d640 1 -- 172.21.15.117:0/1373109978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80b9030 con 0x5577d48fc4d0 2024-09-10T06:22:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09ee0d640 1 -- 172.21.15.117:0/1373109978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80aaa40 con 0x5577d48fc4d0 2024-09-10T06:22:49.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09ee0d640 1 -- 172.21.15.117:0/1373109978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80aad20 con 0x5577d48fc4d0 2024-09-10T06:22:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1373109978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 msgr2=0x5577d4a76ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/1373109978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80ac040 tx=0x7ff1a80033b0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1373109978 shutdown_connections 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/1373109978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48fc4d0 0x5577d4a76ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1373109978 >> 172.21.15.117:0/1373109978 conn(0x5577d48fb010 msgr2=0x5577d4a72b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1373109978 shutdown_connections 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/1373109978 wait complete. 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 0x5577d4a7e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577d482fa50 con 0x5577d48ff6b0 2024-09-10T06:22:49.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 0x5577d4a7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 0x5577d4a7e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41438/0 (socket says 172.21.15.117:41438) 2024-09-10T06:22:49.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 -- 172.21.15.117:0/3966916233 learned_addr learned my addr 172.21.15.117:0/3966916233 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d4a7ebe0 con 0x5577d48ff6b0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b0979640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 0x5577d4a7e680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1a801b0d0 tx=0x7ff1a8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09d60a640 1 -- 172.21.15.117:0/3966916233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80b9030 con 0x5577d48ff6b0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577d4a7ee70 con 0x5577d48ff6b0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09d60a640 1 -- 172.21.15.117:0/3966916233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80c2070 con 0x5577d48ff6b0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.661+0000 7ff09d60a640 1 -- 172.21.15.117:0/3966916233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80b5ab0 con 0x5577d48ff6b0 2024-09-10T06:22:49.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d4a7f780 con 0x5577d48ff6b0 2024-09-10T06:22:49.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff09d60a640 1 -- 172.21.15.117:0/3966916233 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1a80c4070 con 0x5577d48ff6b0 2024-09-10T06:22:49.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff09d60a640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff098039a70 0x7ff09803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff09d60a640 1 -- 172.21.15.117:0/3966916233 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1a80ba070 con 0x5577d48ff6b0 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b0178640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff098039a70 0x7ff09803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4a83740 0x5577d4a85b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4a86070 con 0x5577d4a83740 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b117a640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4a83740 0x5577d4a85b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b0178640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff098039a70 0x7ff09803bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001ec0 tx=0x7ff1a4001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b117a640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4a83740 0x5577d4a85b30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b117a640 1 -- 172.21.15.117:0/3966916233 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4a83740 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4a86490 con 0x5577d4a83740 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b117a640 1 -- 172.21.15.117:0/3966916233 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4a83740 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4a882a0 0x5577d4a8a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4a8ad80 con 0x5577d4a882a0 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b0979640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4a882a0 0x5577d4a8a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b0979640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4a882a0 0x5577d4a8a690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b0979640 1 -- 172.21.15.117:0/3966916233 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1a80bea60 con 0x5577d4a882a0 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.665+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4a87140 con 0x5577d4a83740 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b117a640 1 -- 172.21.15.117:0/3966916233 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4a83740 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4a8c1e0 0x5577d4a8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4a8ecd0 con 0x5577d4a8c1e0 2024-09-10T06:22:49.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0178640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4a8c1e0 0x5577d4a8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0178640 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4a8c1e0 0x5577d4a8e5d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0178640 1 -- 172.21.15.117:0/3966916233 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1a400d040 con 0x5577d4a8c1e0 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577d489a450 con 0x5577d4a9c7d0 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41448/0 (socket says 172.21.15.117:41448) 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0979640 1 -- 172.21.15.117:0/2865282665 learned_addr learned my addr 172.21.15.117:0/2865282665 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0979640 1 -- 172.21.15.117:0/2865282665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d4a9d230 con 0x5577d4a9c7d0 2024-09-10T06:22:49.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b0979640 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80e8c80 tx=0x7ff1a80e7710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff0967fc640 1 -- 172.21.15.117:0/2865282665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80e1d00 con 0x5577d4a9c7d0 2024-09-10T06:22:49.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577d4a9da90 con 0x5577d4a9c7d0 2024-09-10T06:22:49.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff0967fc640 1 -- 172.21.15.117:0/2865282665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80e1ea0 con 0x5577d4a9c7d0 2024-09-10T06:22:49.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff0967fc640 1 -- 172.21.15.117:0/2865282665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80bc380 con 0x5577d4a9c7d0 2024-09-10T06:22:49.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.669+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d4a9e000 con 0x5577d4a9c7d0 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff0967fc640 1 -- 172.21.15.117:0/2865282665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1a80b3040 con 0x5577d4a9c7d0 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff0967fc640 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 0x7ff08803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff0967fc640 1 -- 172.21.15.117:0/2865282665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1a80d8aa0 con 0x5577d4a9c7d0 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0178640 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 0x7ff08803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0178640 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 0x7ff08803bf30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5577d4a86850 tx=0x7ff1a4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577d4a77650 con 0x5577d4aa9fe0 2024-09-10T06:22:49.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41456/0 (socket says 172.21.15.117:41456) 2024-09-10T06:22:49.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0979640 1 -- 172.21.15.117:0/3522784798 learned_addr learned my addr 172.21.15.117:0/3522784798 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0979640 1 -- 172.21.15.117:0/3522784798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d4aaa9b0 con 0x5577d4aa9fe0 2024-09-10T06:22:49.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b0979640 1 --2- 172.21.15.117:0/3522784798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80c5b70 tx=0x7ff1a80bc5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63548b39f9b09ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff087fff640 1 -- 172.21.15.117:0/3522784798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80f9020 con 0x5577d4aa9fe0 2024-09-10T06:22:49.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff087fff640 1 -- 172.21.15.117:0/3522784798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80cf9c0 con 0x5577d4aa9fe0 2024-09-10T06:22:49.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff087fff640 1 -- 172.21.15.117:0/3522784798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80d8e40 con 0x5577d4aa9fe0 2024-09-10T06:22:49.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3522784798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 msgr2=0x5577d4aaa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3522784798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80c5b70 tx=0x7ff1a80bc5e0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3522784798 shutdown_connections 2024-09-10T06:22:49.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3522784798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4aaa3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3522784798 >> 172.21.15.117:0/3522784798 conn(0x5577d4aa53a0 msgr2=0x5577d4aa35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3522784798 shutdown_connections 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3522784798 wait complete. 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 Processor -- start 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.673+0000 7ff1b2e739c0 1 -- start start 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4ab0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577d4aa8d50 con 0x5577d4aa9fe0 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4ab0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0979640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4ab0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41468/0 (socket says 172.21.15.117:41468) 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 learned_addr learned my addr 172.21.15.117:0/106813856 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d4ab07b0 con 0x5577d4aa9fe0 2024-09-10T06:22:49.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0979640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4ab0250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80e7a50 tx=0x7ff1a80b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 -- 172.21.15.117:0/106813856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a810e070 con 0x5577d4aa9fe0 2024-09-10T06:22:49.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577d4ab07b0 con 0x5577d4aa9fe0 2024-09-10T06:22:49.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 -- 172.21.15.117:0/106813856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a80bc910 con 0x5577d4aa9fe0 2024-09-10T06:22:49.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 -- 172.21.15.117:0/106813856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a80c7b60 con 0x5577d4aa9fe0 2024-09-10T06:22:49.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d4ab0de0 con 0x5577d4aa9fe0 2024-09-10T06:22:49.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 -- 172.21.15.117:0/106813856 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1a8111070 con 0x5577d4aa9fe0 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff07c039a70 0x7ff07c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff0867fc640 1 -- 172.21.15.117:0/106813856 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff1a8105030 con 0x5577d4aa9fe0 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b0178640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff07c039a70 0x7ff07c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4abb490 0x5577d4abd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abe070 con 0x5577d4abb490 2024-09-10T06:22:49.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.677+0000 7ff1b117a640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4abb490 0x5577d4abd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0178640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff07c039a70 0x7ff07c03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4010fd0 tx=0x7ff1a4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4abb490 0x5577d4abd920 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4abb490 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 realm 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abe480 con 0x5577d4abb490 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4abb490 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abed50 con 0x5577d4abb490 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4abb490 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4abb490 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4abfe50 0x5577d4ac2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac28e0 con 0x5577d4abfe50 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4abfe50 0x5577d4ac2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4abfe50 0x5577d4ac2240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:49.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 20 searching for the correct realm 2024-09-10T06:22:49.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4ac47c0 0x5577d4ac6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac7270 con 0x5577d4ac47c0 2024-09-10T06:22:49.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0178640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4ac47c0 0x5577d4ac6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0178640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4ac47c0 0x5577d4ac6bf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac7270 con 0x5577d4abfe50 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff1a8113060 0x7ff1a80d8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac7270 con 0x7ff1a8113060 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.681+0000 7ff1b117a640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff1a8113060 0x7ff1a80d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff1a8113060 0x7ff1a80d8290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a00083f0 con 0x7ff1a8113060 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a00083f0 con 0x5577d4abb490 2024-09-10T06:22:49.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abfe50 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.685+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abfe50 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.689+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abfe50 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abfe50 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x7ff1a8113060 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abb490 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.693+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577d4abf0f0 con 0x5577d4abfe50 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:49.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac3130 con 0x5577d4abb490 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac3520 con 0x5577d4abb490 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac3520 con 0x5577d4ac47c0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 zone default found 2024-09-10T06:22:49.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 4 Realm: () 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 zonegroup default 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac76f0 con 0x7ff1a8113060 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac91e0 con 0x5577d4ac47c0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac96c0 con 0x5577d4ac47c0 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 started sync module instance, tier type = 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:49.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.697+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac8580 con 0x5577d4abfe50 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93973157546352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ac81e0 con 0x5577d4abfe50 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4aca5f0 con 0x5577d4abb490 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93973157552720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acacc0 con 0x5577d4abb490 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acb7e0 con 0x5577d4ac47c0 2024-09-10T06:22:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.701+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93973157546352] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93973157552720] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93973157556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4aca710 con 0x5577d4ac47c0 2024-09-10T06:22:49.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acc080 con 0x5577d4abfe50 2024-09-10T06:22:49.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.705+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93973157559248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acc8d0 con 0x5577d4abfe50 2024-09-10T06:22:49.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acd290 con 0x5577d4abb490 2024-09-10T06:22:49.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93973157556912] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93973157559248] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93973157561376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4accde0 con 0x5577d4abb490 2024-09-10T06:22:49.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.709+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acd670 con 0x7ff1a8113060 2024-09-10T06:22:49.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.713+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93973157561376] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.713+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.713+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93973157550880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acd290 con 0x7ff1a8113060 2024-09-10T06:22:49.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.713+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace0b0 con 0x7ff1a8113060 2024-09-10T06:22:49.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.717+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.717+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93973157567488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace4d0 con 0x7ff1a8113060 2024-09-10T06:22:49.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.717+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4aceef0 con 0x7ff1a8113060 2024-09-10T06:22:49.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93973157550880] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93973157567488] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93973157563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace4d0 con 0x7ff1a8113060 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=0 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=1 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=2 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=3 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=4 2024-09-10T06:22:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=5 2024-09-10T06:22:49.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.721+0000 7ff1b2e739c0 20 add_watcher() i=6 2024-09-10T06:22:49.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93973157563872] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b2e739c0 20 add_watcher() i=7 2024-09-10T06:22:49.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b2e739c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:49.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ad1ee0 con 0x5577d4abb490 2024-09-10T06:22:49.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93973157568592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acf360 con 0x5577d4abb490 2024-09-10T06:22:49.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.725+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93973157568592] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff066fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff1b2e739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:49.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff1b2e739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:49.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ada710 con 0x5577d4abb490 2024-09-10T06:22:49.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.729+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ada710 con 0x7ff1a8113060 2024-09-10T06:22:49.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adb130 con 0x5577d4ac47c0 2024-09-10T06:22:49.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adb590 con 0x5577d4abb490 2024-09-10T06:22:49.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.733+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adbb00 con 0x5577d4abfe50 2024-09-10T06:22:49.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.737+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.737+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adbb00 con 0x5577d4ac47c0 2024-09-10T06:22:49.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.737+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.737+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc070 con 0x5577d4abb490 2024-09-10T06:22:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.741+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.741+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc070 con 0x7ff1a8113060 2024-09-10T06:22:49.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.741+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.741+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc070 con 0x5577d4abfe50 2024-09-10T06:22:49.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.745+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.745+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc180 con 0x5577d4ac47c0 2024-09-10T06:22:49.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.745+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.745+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x5577d4abfe50 2024-09-10T06:22:49.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.745+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.749+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x7ff1a8113060 2024-09-10T06:22:49.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.749+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.749+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x5577d4abfe50 2024-09-10T06:22:49.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.749+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.749+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x7ff1a8113060 2024-09-10T06:22:49.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.753+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.753+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x5577d4abb490 2024-09-10T06:22:49.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.753+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.753+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc7f0 con 0x5577d4ac47c0 2024-09-10T06:22:49.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.757+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.757+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9b0 con 0x5577d4abfe50 2024-09-10T06:22:49.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.757+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.757+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc970 con 0x5577d4ac47c0 2024-09-10T06:22:49.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc970 con 0x5577d4abb490 2024-09-10T06:22:49.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc970 con 0x5577d4abb490 2024-09-10T06:22:49.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.761+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc970 con 0x5577d4ac47c0 2024-09-10T06:22:49.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc8e0 con 0x5577d4abfe50 2024-09-10T06:22:49.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc8e0 con 0x5577d4ac47c0 2024-09-10T06:22:49.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.765+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc920 con 0x5577d4ac47c0 2024-09-10T06:22:49.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc940 con 0x5577d4ac47c0 2024-09-10T06:22:49.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc940 con 0x5577d4ac47c0 2024-09-10T06:22:49.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.769+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc960 con 0x7ff1a8113060 2024-09-10T06:22:49.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.773+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.773+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9a0 con 0x5577d4ac47c0 2024-09-10T06:22:49.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.773+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.773+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9a0 con 0x7ff1a8113060 2024-09-10T06:22:49.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.777+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.777+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9a0 con 0x5577d4ac47c0 2024-09-10T06:22:49.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.777+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.777+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9a0 con 0x7ff1a8113060 2024-09-10T06:22:49.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.781+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.781+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4adc9e0 con 0x5577d4abfe50 2024-09-10T06:22:49.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff065fe3640 20 reqs_thread_entry: start 2024-09-10T06:22:49.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:49.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 20 Filter name: none 2024-09-10T06:22:49.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7fefd77fe640 20 reqs_thread_entry: start 2024-09-10T06:22:49.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T06:22:49.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ad92b0 con 0x7ff1a8113060 2024-09-10T06:22:49.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff066fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93973157568592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ad8cb0 con 0x5577d4abb490 2024-09-10T06:22:49.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.785+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93973157568592] v30'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93973157546352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace050 con 0x5577d4abfe50 2024-09-10T06:22:49.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93973157546352] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 20 remove_watcher() i=0 2024-09-10T06:22:49.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 2 removed watcher, disabling cache 2024-09-10T06:22:49.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93973157552720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace050 con 0x5577d4abb490 2024-09-10T06:22:49.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93973157552720] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 20 remove_watcher() i=1 2024-09-10T06:22:49.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.789+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93973157556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4aca250 con 0x5577d4ac47c0 2024-09-10T06:22:49.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b0178640 1 -- 172.21.15.117:0/106813856 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93973157556912] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a4036040 con 0x5577d4ac47c0 2024-09-10T06:22:49.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b2e739c0 20 remove_watcher() i=2 2024-09-10T06:22:49.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93973157559248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace050 con 0x5577d4abfe50 2024-09-10T06:22:49.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b0979640 1 -- 172.21.15.117:0/106813856 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93973157559248] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8110030 con 0x5577d4abfe50 2024-09-10T06:22:49.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b2e739c0 20 remove_watcher() i=3 2024-09-10T06:22:49.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.793+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93973157561376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acb2b0 con 0x5577d4abb490 2024-09-10T06:22:49.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93973157561376] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x5577d4abb490 2024-09-10T06:22:49.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b2e739c0 20 remove_watcher() i=4 2024-09-10T06:22:49.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93973157550880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4aca250 con 0x7ff1a8113060 2024-09-10T06:22:49.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93973157550880] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b2e739c0 20 remove_watcher() i=5 2024-09-10T06:22:49.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.797+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93973157567488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4acbbd0 con 0x7ff1a8113060 2024-09-10T06:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.801+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93973157567488] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.801+0000 7ff1b2e739c0 20 remove_watcher() i=6 2024-09-10T06:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.801+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93973157563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577d4ace050 con 0x7ff1a8113060 2024-09-10T06:22:49.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93973157563872] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a0026040 con 0x7ff1a8113060 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 20 remove_watcher() i=7 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff1a8113060 msgr2=0x7ff1a80d8290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff1a8113060 0x7ff1a80d8290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4abb490 msgr2=0x5577d4abd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4abb490 0x5577d4abd920 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4abfe50 msgr2=0x5577d4ac2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4abfe50 0x5577d4ac2240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4ac47c0 msgr2=0x5577d4ac6bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4ac47c0 0x5577d4ac6bf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff07c039a70 msgr2=0x7ff07c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff07c039a70 0x7ff07c03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4010fd0 tx=0x7ff1a4011000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 msgr2=0x5577d4ab0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/106813856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4aa9fe0 0x5577d4ab0250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80e7a50 tx=0x7ff1a80b8000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b117a640 1 -- 172.21.15.117:0/106813856 reap_dead start 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 shutdown_connections 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 >> 172.21.15.117:0/106813856 conn(0x5577d4aa53a0 msgr2=0x5577d4aa35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 shutdown_connections 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/106813856 wait complete. 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 msgr2=0x7ff08803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 0x7ff08803bf30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5577d4a86850 tx=0x7ff1a4006000 comp rx=0 tx=0).stop 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 msgr2=0x5577d4a9cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80e8c80 tx=0x7ff1a80e7710 comp rx=0 tx=0).stop 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 shutdown_connections 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff088039a70 0x7ff08803bf30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/2865282665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d4a9c7d0 0x5577d4a9cbf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 >> 172.21.15.117:0/2865282665 conn(0x5577d4a92180 msgr2=0x5577d4a92560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 shutdown_connections 2024-09-10T06:22:49.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/2865282665 wait complete. 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4a83740 msgr2=0x5577d4a85b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577d4a83740 0x5577d4a85b30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4a882a0 msgr2=0x5577d4a8a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577d4a882a0 0x5577d4a8a690 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4a8c1e0 msgr2=0x5577d4a8e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577d4a8c1e0 0x5577d4a8e5d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff098039a70 msgr2=0x7ff09803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff098039a70 0x7ff09803bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001ec0 tx=0x7ff1a4001440 comp rx=0 tx=0).stop 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 msgr2=0x5577d4a7e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 --2- 172.21.15.117:0/3966916233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577d48ff6b0 0x5577d4a7e680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1a801b0d0 tx=0x7ff1a8017e30 comp rx=0 tx=0).stop 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b117a640 1 -- 172.21.15.117:0/3966916233 reap_dead start 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 shutdown_connections 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 >> 172.21.15.117:0/3966916233 conn(0x5577d48fb010 msgr2=0x5577d4a71610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 shutdown_connections 2024-09-10T06:22:49.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.805+0000 7ff1b2e739c0 1 -- 172.21.15.117:0/3966916233 wait complete. 2024-09-10T06:22:49.821 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T06:22:49.821 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:49.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:49.821 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T06:22:49.899 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:49.899 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:49.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2ccc0639c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5607f5915520 0x5607f5915900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2ccc0639c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607f57c99c0 con 0x5607f59186b0 2024-09-10T06:22:49.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2ccc0639c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5607f58196d0 con 0x5607f5915520 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9b69640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5607f5915520 0x5607f5915900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9368640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5607f59186b0 0x5607f591aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44124/0 (socket says 172.21.15.117:44124) 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9b69640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5607f5915520 0x5607f5915900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41478/0 (socket says 172.21.15.117:41478) 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9368640 1 -- 172.21.15.117:0/1128103988 learned_addr learned my addr 172.21.15.117:0/1128103988 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1128103988 >> v1:172.21.15.84:6789/0 conn(0x5607f59186b0 legacy=0x5607f591aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.897+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1128103988 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f57bdca0 con 0x5607f5915520 2024-09-10T06:22:49.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/1128103988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5915900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400a420 tx=0x7f2cc401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3833cfbec64107 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2cc8b67640 1 -- 172.21.15.117:0/1128103988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40af070 con 0x5607f5915520 2024-09-10T06:22:49.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2cc8b67640 1 -- 172.21.15.117:0/1128103988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40aa530 con 0x5607f5915520 2024-09-10T06:22:49.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2cc8b67640 1 -- 172.21.15.117:0/1128103988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40aa850 con 0x5607f5915520 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1128103988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 msgr2=0x5607f5915900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1128103988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5915900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400a420 tx=0x7f2cc401afd0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1128103988 shutdown_connections 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1128103988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5915900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1128103988 >> 172.21.15.117:0/1128103988 conn(0x5607f5911040 msgr2=0x5607f5913460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1128103988 shutdown_connections 2024-09-10T06:22:49.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.901+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1128103988 wait complete. 2024-09-10T06:22:49.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2ccc0639c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2ccc0639c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607f581d680 con 0x5607f5915520 2024-09-10T06:22:49.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41486/0 (socket says 172.21.15.117:41486) 2024-09-10T06:22:49.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2cc9b69640 1 -- 172.21.15.117:0/4269545525 learned_addr learned my addr 172.21.15.117:0/4269545525 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2cc9b69640 1 -- 172.21.15.117:0/4269545525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5798da0 con 0x5607f5915520 2024-09-10T06:22:49.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.917+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/4269545525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4018c00 tx=0x7f2cc40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b7364475bdd1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb7e07640 1 -- 172.21.15.117:0/4269545525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40af040 con 0x5607f5915520 2024-09-10T06:22:49.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb7e07640 1 -- 172.21.15.117:0/4269545525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40aaa00 con 0x5607f5915520 2024-09-10T06:22:49.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb7e07640 1 -- 172.21.15.117:0/4269545525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40aace0 con 0x5607f5915520 2024-09-10T06:22:49.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/4269545525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 msgr2=0x5607f5a00800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/4269545525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4018c00 tx=0x7f2cc40033b0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/4269545525 shutdown_connections 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/4269545525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a00800 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/4269545525 >> 172.21.15.117:0/4269545525 conn(0x5607f5911040 msgr2=0x5607f59fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/4269545525 shutdown_connections 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/4269545525 wait complete. 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a07ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607f57bfa50 con 0x5607f5915520 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a07ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a07ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41488/0 (socket says 172.21.15.117:41488) 2024-09-10T06:22:49.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2cc9b69640 1 -- 172.21.15.117:0/2193796294 learned_addr learned my addr 172.21.15.117:0/2193796294 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2cc9b69640 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5a08200 con 0x5607f5915520 2024-09-10T06:22:49.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a07ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f90 tx=0x7f2cc4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb6604640 1 -- 172.21.15.117:0/2193796294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40c5030 con 0x5607f5915520 2024-09-10T06:22:49.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f5a08490 con 0x5607f5915520 2024-09-10T06:22:49.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f5a08ec0 con 0x5607f5915520 2024-09-10T06:22:49.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb6604640 1 -- 172.21.15.117:0/2193796294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40c1690 con 0x5607f5915520 2024-09-10T06:22:49.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.921+0000 7f2bb6604640 1 -- 172.21.15.117:0/2193796294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40c1970 con 0x5607f5915520 2024-09-10T06:22:49.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2bb6604640 1 -- 172.21.15.117:0/2193796294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2cc40c8070 con 0x5607f5915520 2024-09-10T06:22:49.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2bb6604640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2bb0039a70 0x7f2bb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2bb6604640 1 -- 172.21.15.117:0/2193796294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2cc40c6070 con 0x5607f5915520 2024-09-10T06:22:49.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9368640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2bb0039a70 0x7f2bb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f59186b0 0x5607f5a0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a0f350 con 0x5607f59186b0 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cca36a640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f59186b0 0x5607f5a0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9368640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2bb0039a70 0x7f2bb003bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4001d80 tx=0x7f2cb40012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cca36a640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f59186b0 0x5607f5a0ee10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cca36a640 1 -- 172.21.15.117:0/2193796294 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f59186b0 2024-09-10T06:22:49.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a091b0 con 0x5607f59186b0 2024-09-10T06:22:49.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cca36a640 1 -- 172.21.15.117:0/2193796294 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f59186b0 2024-09-10T06:22:49.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a115c0 0x5607f5a139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a140a0 con 0x5607f5a115c0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a115c0 0x5607f5a139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a115c0 0x5607f5a139b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9b69640 1 -- 172.21.15.117:0/2193796294 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2cc40b2040 con 0x5607f5a115c0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a10460 con 0x5607f59186b0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cca36a640 1 -- 172.21.15.117:0/2193796294 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f59186b0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a15500 0x5607f5a178f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a18030 con 0x5607f5a15500 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.925+0000 7f2cc9368640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a15500 0x5607f5a178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9368640 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a15500 0x5607f5a178f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9368640 1 -- 172.21.15.117:0/2193796294 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a15500 2024-09-10T06:22:49.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607f582a450 con 0x5607f5a25b10 2024-09-10T06:22:49.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41490/0 (socket says 172.21.15.117:41490) 2024-09-10T06:22:49.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9b69640 1 -- 172.21.15.117:0/577463910 learned_addr learned my addr 172.21.15.117:0/577463910 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9b69640 1 -- 172.21.15.117:0/577463910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5a26570 con 0x5607f5a25b10 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40bf760 tx=0x7f2cc40bf600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2baf7fe640 1 -- 172.21.15.117:0/577463910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40ca540 con 0x5607f5a25b10 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f5a26dd0 con 0x5607f5a25b10 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2baf7fe640 1 -- 172.21.15.117:0/577463910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40b5470 con 0x5607f5a25b10 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2baf7fe640 1 -- 172.21.15.117:0/577463910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40cdc90 con 0x5607f5a25b10 2024-09-10T06:22:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f5a27340 con 0x5607f5a25b10 2024-09-10T06:22:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.929+0000 7f2baf7fe640 1 -- 172.21.15.117:0/577463910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2cc40e2480 con 0x5607f5a25b10 2024-09-10T06:22:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2baf7fe640 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 0x7f2ba403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2baf7fe640 1 -- 172.21.15.117:0/577463910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2cc40d9070 con 0x5607f5a25b10 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9368640 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 0x7f2ba403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9368640 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 0x7f2ba403bf30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400bf50 tx=0x7f2cb400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a00f70 con 0x5607f5a32280 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41506/0 (socket says 172.21.15.117:41506) 2024-09-10T06:22:49.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 -- 172.21.15.117:0/2085433768 learned_addr learned my addr 172.21.15.117:0/2085433768 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 -- 172.21.15.117:0/2085433768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5a32c50 con 0x5607f5a32280 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/2085433768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40e6010 tx=0x7f2cc40ca6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3734fa8d91879154 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2bad7fa640 1 -- 172.21.15.117:0/2085433768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40fe070 con 0x5607f5a32280 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2bad7fa640 1 -- 172.21.15.117:0/2085433768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40cd310 con 0x5607f5a32280 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2bad7fa640 1 -- 172.21.15.117:0/2085433768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40c0c70 con 0x5607f5a32280 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2085433768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 msgr2=0x5607f5a32660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2085433768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40e6010 tx=0x7f2cc40ca6e0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2085433768 shutdown_connections 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2085433768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a32660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2085433768 >> 172.21.15.117:0/2085433768 conn(0x5607f5a2e6b0 msgr2=0x5607f5a2c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2085433768 shutdown_connections 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2085433768 wait complete. 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 Processor -- start 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- start start 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2ccc0639c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a33110 con 0x5607f5a32280 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41516/0 (socket says 172.21.15.117:41516) 2024-09-10T06:22:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.933+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 learned_addr learned my addr 172.21.15.117:0/1925873911 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5a3bd90 con 0x5607f5a32280 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40d2e00 tx=0x7f2cc40bced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 -- 172.21.15.117:0/1925873911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc4109070 con 0x5607f5a32280 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607f5a3bd90 con 0x5607f5a32280 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 -- 172.21.15.117:0/1925873911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40cd310 con 0x5607f5a32280 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 -- 172.21.15.117:0/1925873911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc40fe040 con 0x5607f5a32280 2024-09-10T06:22:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f5a3c3c0 con 0x5607f5a32280 2024-09-10T06:22:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 -- 172.21.15.117:0/1925873911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2cc410c070 con 0x5607f5a32280 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2b94039a70 0x7f2b9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2b9b7fe640 1 -- 172.21.15.117:0/1925873911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f2cc40bb070 con 0x5607f5a32280 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cc9368640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2b94039a70 0x7f2b9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f5a469e0 0x5607f5a48e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a495c0 con 0x5607f5a469e0 2024-09-10T06:22:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cca36a640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f5a469e0 0x5607f5a48e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cc9368640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2b94039a70 0x7f2b9403bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5607f5a0f790 tx=0x7f2cb4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cca36a640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f5a469e0 0x5607f5a48e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.937+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f5a469e0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 realm 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a49a20 con 0x5607f5a469e0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f5a469e0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a2f0 con 0x5607f5a469e0 2024-09-10T06:22:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f5a469e0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f5a469e0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a4b3f0 0x5607f5a4d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4de30 con 0x5607f5a4b3f0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a4b3f0 0x5607f5a4d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a4b3f0 0x5607f5a4d7e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 20 searching for the correct realm 2024-09-10T06:22:49.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a4fd10 0x5607f5a52160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a527e0 con 0x5607f5a4fd10 2024-09-10T06:22:49.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9368640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a4fd10 0x5607f5a52160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9368640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a4fd10 0x5607f5a52160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a527e0 con 0x5607f5a4b3f0 2024-09-10T06:22:49.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2cc410e070 0x7f2cc40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a527e0 con 0x7f2cc410e070 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cca36a640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2cc410e070 0x7f2cc40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.941+0000 7f2cca36a640 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2cc410e070 0x7f2cc40cb130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083f0 con 0x7f2cc410e070 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083f0 con 0x5607f5a469e0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4b3f0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.945+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4b3f0 2024-09-10T06:22:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.949+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4b3f0 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4b3f0 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4fd10 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x7f2cc410e070 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a469e0 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.953+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4a690 con 0x5607f5a4b3f0 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:49.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4e680 con 0x5607f5a469e0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4ea70 con 0x5607f5a469e0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a4ea70 con 0x5607f5a4fd10 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 zone default found 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 4 Realm: () 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 zonegroup default 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a52c60 con 0x7f2cc410e070 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a547a0 con 0x5607f5a4fd10 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a54cb0 con 0x5607f5a4fd10 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 started sync module instance, tier type = 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:49.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a53af0 con 0x5607f5a4b3f0 2024-09-10T06:22:49.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592186007264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a53750 con 0x5607f5a4b3f0 2024-09-10T06:22:49.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.957+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a55be0 con 0x5607f5a469e0 2024-09-10T06:22:49.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.961+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94592186007264] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.961+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.961+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592186013488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a55b50 con 0x5607f5a469e0 2024-09-10T06:22:49.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.961+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a56930 con 0x5607f5a4fd10 2024-09-10T06:22:49.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94592186013488] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592186015696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a56d20 con 0x5607f5a4fd10 2024-09-10T06:22:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a576e0 con 0x5607f5a4b3f0 2024-09-10T06:22:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592186020704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a57f80 con 0x5607f5a4b3f0 2024-09-10T06:22:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a58940 con 0x5607f5a469e0 2024-09-10T06:22:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94592186020704] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.965+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94592186015696] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592186022608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a58940 con 0x5607f5a469e0 2024-09-10T06:22:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a57ef0 con 0x7f2cc410e070 2024-09-10T06:22:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592186026304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a59210 con 0x7f2cc410e070 2024-09-10T06:22:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a59c10 con 0x7f2cc410e070 2024-09-10T06:22:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.969+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94592186022608] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94592186026304] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592186025104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a58d60 con 0x7f2cc410e070 2024-09-10T06:22:49.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a5a4e0 con 0x7f2cc410e070 2024-09-10T06:22:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94592186025104] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.973+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592186029856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a58d60 con 0x7f2cc410e070 2024-09-10T06:22:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=0 2024-09-10T06:22:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=1 2024-09-10T06:22:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=2 2024-09-10T06:22:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=3 2024-09-10T06:22:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=4 2024-09-10T06:22:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=5 2024-09-10T06:22:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=6 2024-09-10T06:22:49.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94592186029856] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 add_watcher() i=7 2024-09-10T06:22:49.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:49.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a5d4c0 con 0x5607f5a469e0 2024-09-10T06:22:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592186031952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a5a9e0 con 0x5607f5a469e0 2024-09-10T06:22:49.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94592186031952] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2b7bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:49.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:49.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:49.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.977+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a65de0 con 0x5607f5a469e0 2024-09-10T06:22:49.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.981+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.981+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a66490 con 0x7f2cc410e070 2024-09-10T06:22:49.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.981+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.981+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a668b0 con 0x5607f5a4fd10 2024-09-10T06:22:49.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a66cf0 con 0x5607f5a469e0 2024-09-10T06:22:49.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67260 con 0x5607f5a4b3f0 2024-09-10T06:22:49.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.985+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67260 con 0x5607f5a4fd10 2024-09-10T06:22:49.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.989+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.989+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a677d0 con 0x5607f5a469e0 2024-09-10T06:22:49.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.989+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:49.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.989+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a677d0 con 0x7f2cc410e070 2024-09-10T06:22:49.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.993+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:49.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.993+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a677d0 con 0x5607f5a4b3f0 2024-09-10T06:22:49.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.993+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:49.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.993+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67860 con 0x5607f5a4fd10 2024-09-10T06:22:49.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.997+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:49.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.997+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67dd0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.997+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:49.997+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67dd0 con 0x7f2cc410e070 2024-09-10T06:22:50.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.001+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.001+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67dd0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.001+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.001+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67e60 con 0x7f2cc410e070 2024-09-10T06:22:50.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.005+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.005+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67e60 con 0x5607f5a469e0 2024-09-10T06:22:50.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.005+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.005+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67e60 con 0x5607f5a4fd10 2024-09-10T06:22:50.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67ef0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a67ef0 con 0x5607f5a4fd10 2024-09-10T06:22:50.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.009+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68020 con 0x5607f5a469e0 2024-09-10T06:22:50.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.013+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.013+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68020 con 0x5607f5a469e0 2024-09-10T06:22:50.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.013+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.017+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68020 con 0x5607f5a4fd10 2024-09-10T06:22:50.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.017+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.017+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a680b0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.017+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.017+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a680b0 con 0x5607f5a4fd10 2024-09-10T06:22:50.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.021+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.021+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a680b0 con 0x5607f5a4fd10 2024-09-10T06:22:50.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.021+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.021+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x5607f5a4fd10 2024-09-10T06:22:50.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.025+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.025+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x5607f5a4fd10 2024-09-10T06:22:50.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.025+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.025+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x7f2cc410e070 2024-09-10T06:22:50.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x5607f5a4fd10 2024-09-10T06:22:50.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x7f2cc410e070 2024-09-10T06:22:50.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.029+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x5607f5a4fd10 2024-09-10T06:22:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.033+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.033+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a68120 con 0x7f2cc410e070 2024-09-10T06:22:50.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a686a0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2b7affd640 20 reqs_thread_entry: start 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 20 Filter name: none 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2b78ff9640 20 reqs_thread_entry: start 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.037+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a836d0 con 0x7f2cc410e070 2024-09-10T06:22:50.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2b7bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592186031952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a62a80 con 0x5607f5a469e0 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94592186031952] v30'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592186007264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a63d30 con 0x5607f5a4b3f0 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94592186007264] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 20 remove_watcher() i=0 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 2 removed watcher, disabling cache 2024-09-10T06:22:50.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.041+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592186013488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a53ee0 con 0x5607f5a469e0 2024-09-10T06:22:50.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94592186013488] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2ccc0639c0 20 remove_watcher() i=1 2024-09-10T06:22:50.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592186015696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a53ee0 con 0x5607f5a4fd10 2024-09-10T06:22:50.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2cc9368640 1 -- 172.21.15.117:0/1925873911 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94592186015696] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb400e620 con 0x5607f5a4fd10 2024-09-10T06:22:50.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2ccc0639c0 20 remove_watcher() i=2 2024-09-10T06:22:50.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.045+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592186020704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a55fd0 con 0x5607f5a4b3f0 2024-09-10T06:22:50.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2cc9b69640 1 -- 172.21.15.117:0/1925873911 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94592186020704] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc4115070 con 0x5607f5a4b3f0 2024-09-10T06:22:50.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2ccc0639c0 20 remove_watcher() i=3 2024-09-10T06:22:50.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592186022608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a53ee0 con 0x5607f5a469e0 2024-09-10T06:22:50.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94592186022608] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x5607f5a469e0 2024-09-10T06:22:50.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2ccc0639c0 20 remove_watcher() i=4 2024-09-10T06:22:50.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.049+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592186026304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a57360 con 0x7f2cc410e070 2024-09-10T06:22:50.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94592186026304] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2ccc0639c0 20 remove_watcher() i=5 2024-09-10T06:22:50.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592186025104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a55fd0 con 0x7f2cc410e070 2024-09-10T06:22:50.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94592186025104] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2ccc0639c0 20 remove_watcher() i=6 2024-09-10T06:22:50.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.053+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592186029856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607f5a57ad0 con 0x7f2cc410e070 2024-09-10T06:22:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94592186029856] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc026040 con 0x7f2cc410e070 2024-09-10T06:22:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 20 remove_watcher() i=7 2024-09-10T06:22:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2cc410e070 msgr2=0x7f2cc40cb130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2cc410e070 0x7f2cc40cb130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f5a469e0 msgr2=0x5607f5a48e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f5a469e0 0x5607f5a48e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a4b3f0 msgr2=0x5607f5a4d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a4b3f0 0x5607f5a4d7e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a4fd10 msgr2=0x5607f5a52160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a4fd10 0x5607f5a52160 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2b94039a70 msgr2=0x7f2b9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2b94039a70 0x7f2b9403bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5607f5a0f790 tx=0x7f2cb4010000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 msgr2=0x5607f5a3b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2cca36a640 1 -- 172.21.15.117:0/1925873911 reap_dead start 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40d2e00 tx=0x7f2cc40bced0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 shutdown_connections 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/1925873911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a32280 0x5607f5a3b830 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 >> 172.21.15.117:0/1925873911 conn(0x5607f5a2e6b0 msgr2=0x5607f5a2c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 shutdown_connections 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/1925873911 wait complete. 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 msgr2=0x7f2ba403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 0x7f2ba403bf30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400bf50 tx=0x7f2cb400f000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 msgr2=0x5607f5a25f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40bf760 tx=0x7f2cc40bf600 comp rx=0 tx=0).stop 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 shutdown_connections 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2ba4039a70 0x7f2ba403bf30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/577463910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5a25b10 0x5607f5a25f30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 >> 172.21.15.117:0/577463910 conn(0x5607f5a1b4c0 msgr2=0x5607f5a1b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 shutdown_connections 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/577463910 wait complete. 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f59186b0 msgr2=0x5607f5a0ee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5607f59186b0 0x5607f5a0ee10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a115c0 msgr2=0x5607f5a139b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5607f5a115c0 0x5607f5a139b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a15500 msgr2=0x5607f5a178f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5607f5a15500 0x5607f5a178f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2bb0039a70 msgr2=0x7f2bb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2bb0039a70 0x7f2bb003bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4001d80 tx=0x7f2cb40012e0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 msgr2=0x5607f5a07ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 --2- 172.21.15.117:0/2193796294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607f5915520 0x5607f5a07ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f90 tx=0x7f2cc4017d70 comp rx=0 tx=0).stop 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2cca36a640 1 -- 172.21.15.117:0/2193796294 reap_dead start 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 shutdown_connections 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 >> 172.21.15.117:0/2193796294 conn(0x5607f5911040 msgr2=0x5607f59faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 shutdown_connections 2024-09-10T06:22:50.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.057+0000 7f2ccc0639c0 1 -- 172.21.15.117:0/2193796294 wait complete. 2024-09-10T06:22:50.070 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T06:22:50.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T06:22:50.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T06:22:50.071 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T06:22:50.146 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:50.146 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf564b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5564280d2770 0x5564280d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf564b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556427f849c0 con 0x5564280d58b0 2024-09-10T06:22:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf564b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x556427fd46d0 con 0x5564280d2770 2024-09-10T06:22:50.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf3151640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5564280d2770 0x5564280d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbea950640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5564280d58b0 0x5564280d7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44132/0 (socket says 172.21.15.117:44132) 2024-09-10T06:22:50.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbea950640 1 -- 172.21.15.117:0/2483304919 learned_addr learned my addr 172.21.15.117:0/2483304919 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:50.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf3151640 1 -- 172.21.15.117:0/2483304919 >> v1:172.21.15.84:6789/0 conn(0x5564280d58b0 legacy=0x5564280d7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.145+0000 7fbbf3151640 1 -- 172.21.15.117:0/2483304919 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556427f78ca0 con 0x5564280d2770 2024-09-10T06:22:50.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf3151640 1 --2- 172.21.15.117:0/2483304919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564280d2b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400a480 tx=0x7fbbe401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98972957f5dc6380 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf2950640 1 -- 172.21.15.117:0/2483304919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40b0070 con 0x5564280d2770 2024-09-10T06:22:50.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf2950640 1 -- 172.21.15.117:0/2483304919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40ab540 con 0x5564280d2770 2024-09-10T06:22:50.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf2950640 1 -- 172.21.15.117:0/2483304919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40ab840 con 0x5564280d2770 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2483304919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 msgr2=0x5564280d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2483304919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564280d2b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400a480 tx=0x7fbbe401b280 comp rx=0 tx=0).stop 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2483304919 shutdown_connections 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2483304919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564280d2b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2483304919 >> 172.21.15.117:0/2483304919 conn(0x556428046080 msgr2=0x556428046490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2483304919 shutdown_connections 2024-09-10T06:22:50.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.149+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2483304919 wait complete. 2024-09-10T06:22:50.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.161+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556427fd8680 con 0x5564280d2770 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41536/0 (socket says 172.21.15.117:41536) 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 -- 172.21.15.117:0/4023208984 learned_addr learned my addr 172.21.15.117:0/4023208984 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 -- 172.21.15.117:0/4023208984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556427f53da0 con 0x5564280d2770 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 --2- 172.21.15.117:0/4023208984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae040 tx=0x7fbbe4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ade776b7b6bdaf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbae160a640 1 -- 172.21.15.117:0/4023208984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40b0070 con 0x5564280d2770 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbae160a640 1 -- 172.21.15.117:0/4023208984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40b1040 con 0x5564280d2770 2024-09-10T06:22:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbae160a640 1 -- 172.21.15.117:0/4023208984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40ab6f0 con 0x5564280d2770 2024-09-10T06:22:50.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/4023208984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 msgr2=0x5564281bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/4023208984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae040 tx=0x7fbbe4003030 comp rx=0 tx=0).stop 2024-09-10T06:22:50.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/4023208984 shutdown_connections 2024-09-10T06:22:50.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/4023208984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281bd9e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/4023208984 >> 172.21.15.117:0/4023208984 conn(0x556428046080 msgr2=0x5564281b9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/4023208984 shutdown_connections 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/4023208984 wait complete. 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf564b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556427f7aa50 con 0x5564280d2770 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41542/0 (socket says 172.21.15.117:41542) 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.165+0000 7fbbf3151640 1 -- 172.21.15.117:0/2747044863 learned_addr learned my addr 172.21.15.117:0/2747044863 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3151640 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564281c5450 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3151640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281c4ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae040 tx=0x7fbbe4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 -- 172.21.15.117:0/2747044863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40b7480 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564281c56e0 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 -- 172.21.15.117:0/2747044863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40b7620 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 -- 172.21.15.117:0/2747044863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40b7920 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564281c6090 con 0x5564280d2770 2024-09-10T06:22:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 -- 172.21.15.117:0/2747044863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbbe40b7ac0 con 0x5564280d2770 2024-09-10T06:22:50.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbad8039a70 0x7fbad803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbadfe07640 1 -- 172.21.15.117:0/2747044863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbbe40bc070 con 0x5564280d2770 2024-09-10T06:22:50.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbea950640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbad8039a70 0x7fbad803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5564280d58b0 0x5564281cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564281cc5a0 con 0x5564280d58b0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3952640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5564280d58b0 0x5564281cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbea950640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbad8039a70 0x7fbad803bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc001d80 tx=0x7fbbdc0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3952640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5564280d58b0 0x5564281cc060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3952640 1 -- 172.21.15.117:0/2747044863 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x5564280d58b0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564281cca10 con 0x5564280d58b0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3952640 1 -- 172.21.15.117:0/2747044863 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbec00a4d0 con 0x5564280d58b0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5564281ce820 0x5564281d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564281d12e0 con 0x5564281ce820 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.169+0000 7fbbf3151640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5564281ce820 0x5564281d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5564281ce820 0x5564281d0c10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 -- 172.21.15.117:0/2747044863 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbe40d0070 con 0x5564281ce820 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564281cd6c0 con 0x5564280d58b0 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3952640 1 -- 172.21.15.117:0/2747044863 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbec00a4d0 con 0x5564280d58b0 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5564281d2720 0x5564281d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564281d5280 con 0x5564281d2720 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbea950640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5564281d2720 0x5564281d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbea950640 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5564281d2720 0x5564281d4b10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbea950640 1 -- 172.21.15.117:0/2747044863 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbdc00e620 con 0x5564281d2720 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556427fe5450 con 0x5564281e2d20 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41558/0 (socket says 172.21.15.117:41558) 2024-09-10T06:22:50.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 -- 172.21.15.117:0/2749026613 learned_addr learned my addr 172.21.15.117:0/2749026613 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 -- 172.21.15.117:0/2749026613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564281e3780 con 0x5564281e2d20 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf3151640 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b65a0 tx=0x7fbbe40b6c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbadd602640 1 -- 172.21.15.117:0/2749026613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40ce040 con 0x5564281e2d20 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564281e3fe0 con 0x5564281e2d20 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbadd602640 1 -- 172.21.15.117:0/2749026613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40eade0 con 0x5564281e2d20 2024-09-10T06:22:50.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564281e3fe0 con 0x5564281e2d20 2024-09-10T06:22:50.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.173+0000 7fbadd602640 1 -- 172.21.15.117:0/2749026613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40e8430 con 0x5564281e2d20 2024-09-10T06:22:50.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbadd602640 1 -- 172.21.15.117:0/2749026613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbbe40b5850 con 0x5564281e2d20 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbadd602640 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 0x7fbacc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbadd602640 1 -- 172.21.15.117:0/2749026613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbbe40a8070 con 0x5564281e2d20 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbea950640 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 0x7fbacc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564281be150 con 0x5564281ef2f0 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbea950640 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 0x7fbacc03bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00bf50 tx=0x7fbbdc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41560/0 (socket says 172.21.15.117:41560) 2024-09-10T06:22:50.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf3151640 1 -- 172.21.15.117:0/3374388412 learned_addr learned my addr 172.21.15.117:0/3374388412 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf3151640 1 -- 172.21.15.117:0/3374388412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564281efcc0 con 0x5564281ef2f0 2024-09-10T06:22:50.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf3151640 1 --2- 172.21.15.117:0/3374388412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c07c0 tx=0x7fbbe40d0da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac8b1b830f7959e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbad6ffd640 1 -- 172.21.15.117:0/3374388412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40d3c80 con 0x5564281ef2f0 2024-09-10T06:22:50.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbad6ffd640 1 -- 172.21.15.117:0/3374388412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40e3d20 con 0x5564281ef2f0 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbad6ffd640 1 -- 172.21.15.117:0/3374388412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40d3520 con 0x5564281ef2f0 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/3374388412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 msgr2=0x5564281ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/3374388412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c07c0 tx=0x7fbbe40d0da0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/3374388412 shutdown_connections 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/3374388412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281ef6d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/3374388412 >> 172.21.15.117:0/3374388412 conn(0x5564281eb720 msgr2=0x5564281e9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/3374388412 shutdown_connections 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.177+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/3374388412 wait complete. 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 Processor -- start 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 -- start start 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5564281f0180 con 0x5564281ef2f0 2024-09-10T06:22:50.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf3151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41572/0 (socket says 172.21.15.117:41572) 2024-09-10T06:22:50.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 learned_addr learned my addr 172.21.15.117:0/1608971809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564281f6b90 con 0x5564281ef2f0 2024-09-10T06:22:50.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf3151640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281f6630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c07c0 tx=0x7fbbe40b2f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 -- 172.21.15.117:0/1608971809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe4110070 con 0x5564281ef2f0 2024-09-10T06:22:50.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564281f6b90 con 0x5564281ef2f0 2024-09-10T06:22:50.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564281f6b90 con 0x5564281ef2f0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 -- 172.21.15.117:0/1608971809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe40ade80 con 0x5564281ef2f0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 -- 172.21.15.117:0/1608971809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbe40c0960 con 0x5564281ef2f0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 -- 172.21.15.117:0/1608971809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbbe4113070 con 0x5564281ef2f0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbabc039ac0 0x7fbabc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbad57fa640 1 -- 172.21.15.117:0/1608971809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbbe4116af0 con 0x5564281ef2f0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbea950640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbabc039ac0 0x7fbabc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556428201680 0x556428203b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.181+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428204260 con 0x556428201680 2024-09-10T06:22:50.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556428201680 0x556428203b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbea950640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbabc039ac0 0x7fbabc03bf80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5564281d5680 tx=0x7fbbdc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556428201680 0x556428203b10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 realm 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428204670 con 0x556428201680 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:50.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428204f40 con 0x556428201680 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556428206040 0x556428208430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428208a40 con 0x556428206040 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556428206040 0x556428208430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556428206040 0x556428208430 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbbe4112030 con 0x556428206040 2024-09-10T06:22:50.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 20 searching for the correct realm 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55642820a920 0x55642820cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55642820d3d0 con 0x55642820a920 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbea950640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55642820a920 0x55642820cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbea950640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55642820a920 0x55642820cd50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55642820d3d0 con 0x556428206040 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe4112030 con 0x556428206040 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbbe4115060 0x7fbbe41067c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55642820d3d0 con 0x7fbbe4115060 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.185+0000 7fbbf3952640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbbe4115060 0x7fbbe41067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbbe4115060 0x7fbbe41067c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428206040 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.189+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428206040 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.193+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428206040 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428206040 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x55642820a920 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x7fbbe4115060 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428201680 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5564282052e0 con 0x556428206040 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:50.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.197+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428209290 con 0x556428201680 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428209680 con 0x556428201680 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556428209680 con 0x55642820a920 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 zone default found 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 4 Realm: () 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 zonegroup default 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642820d850 con 0x7fbbe4115060 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642820f370 con 0x55642820a920 2024-09-10T06:22:50.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642820f830 con 0x55642820a920 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 started sync module instance, tier type = 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642820e6e0 con 0x556428206040 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93888658336464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642820e340 con 0x556428206040 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.201+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428210760 con 0x556428201680 2024-09-10T06:22:50.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93888658336464] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93888658342576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428210b80 con 0x556428201680 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428211540 con 0x55642820a920 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93888658346128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428211d90 con 0x55642820a920 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93888658342576] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.205+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282106d0 con 0x556428206040 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93888658351024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428212d00 con 0x556428206040 2024-09-10T06:22:50.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428213820 con 0x556428201680 2024-09-10T06:22:50.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93888658346128] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93888658351024] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93888658352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282118e0 con 0x556428201680 2024-09-10T06:22:50.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.209+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282140c0 con 0x7fbbe4115060 2024-09-10T06:22:50.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.213+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.213+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93888658357072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428214420 con 0x7fbbe4115060 2024-09-10T06:22:50.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.213+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428214e60 con 0x7fbbe4115060 2024-09-10T06:22:50.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.213+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93888658352080] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.213+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93888658357072] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93888658360624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428213f70 con 0x7fbbe4115060 2024-09-10T06:22:50.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282154f0 con 0x7fbbe4115060 2024-09-10T06:22:50.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93888658360624] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93888658354928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282154f0 con 0x7fbbe4115060 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=0 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=1 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=2 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=3 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=4 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=5 2024-09-10T06:22:50.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.217+0000 7fbbf564b9c0 20 add_watcher() i=6 2024-09-10T06:22:50.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93888658354928] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 20 add_watcher() i=7 2024-09-10T06:22:50.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:50.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5564282186a0 con 0x556428201680 2024-09-10T06:22:50.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93888658362432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428215910 con 0x556428201680 2024-09-10T06:22:50.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93888658362432] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:50.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:50.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.221+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428221030 con 0x556428201680 2024-09-10T06:22:50.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.225+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.225+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428221680 con 0x7fbbe4115060 2024-09-10T06:22:50.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.225+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.225+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428221ae0 con 0x55642820a920 2024-09-10T06:22:50.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222050 con 0x556428201680 2024-09-10T06:22:50.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222500 con 0x556428206040 2024-09-10T06:22:50.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222500 con 0x55642820a920 2024-09-10T06:22:50.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.229+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222a70 con 0x556428201680 2024-09-10T06:22:50.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.233+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.233+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222e50 con 0x7fbbe4115060 2024-09-10T06:22:50.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.233+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.233+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222c40 con 0x556428206040 2024-09-10T06:22:50.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428222cd0 con 0x55642820a920 2024-09-10T06:22:50.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223240 con 0x556428206040 2024-09-10T06:22:50.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.237+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223240 con 0x7fbbe4115060 2024-09-10T06:22:50.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.241+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.241+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223240 con 0x556428206040 2024-09-10T06:22:50.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.241+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.241+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223240 con 0x7fbbe4115060 2024-09-10T06:22:50.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.245+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.245+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223410 con 0x556428201680 2024-09-10T06:22:50.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.245+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.245+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223410 con 0x55642820a920 2024-09-10T06:22:50.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223410 con 0x556428206040 2024-09-10T06:22:50.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223410 con 0x55642820a920 2024-09-10T06:22:50.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.249+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223410 con 0x556428201680 2024-09-10T06:22:50.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.253+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.253+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428223a20 con 0x556428201680 2024-09-10T06:22:50.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.253+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.253+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282236f0 con 0x55642820a920 2024-09-10T06:22:50.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5564282236f0 con 0x556428206040 2024-09-10T06:22:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821edb0 con 0x55642820a920 2024-09-10T06:22:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.257+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821edb0 con 0x55642820a920 2024-09-10T06:22:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821edb0 con 0x55642820a920 2024-09-10T06:22:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821edb0 con 0x55642820a920 2024-09-10T06:22:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.261+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x7fbbe4115060 2024-09-10T06:22:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.265+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.265+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x55642820a920 2024-09-10T06:22:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.265+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.265+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x7fbbe4115060 2024-09-10T06:22:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.269+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.269+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x55642820a920 2024-09-10T06:22:50.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.269+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.269+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x7fbbe4115060 2024-09-10T06:22:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821ebe0 con 0x556428206040 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbaa8fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 20 Filter name: none 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fba227fc640 20 reqs_thread_entry: start 2024-09-10T06:22:50.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.273+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55642823e7f0 con 0x556428201680 2024-09-10T06:22:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93888658362432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642821e070 con 0x556428201680 2024-09-10T06:22:50.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93888658362432] v30'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93888658336464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428215040 con 0x556428206040 2024-09-10T06:22:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93888658336464] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 20 remove_watcher() i=0 2024-09-10T06:22:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 2 removed watcher, disabling cache 2024-09-10T06:22:50.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.277+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93888658342576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642820ead0 con 0x556428201680 2024-09-10T06:22:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93888658342576] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbf564b9c0 20 remove_watcher() i=1 2024-09-10T06:22:50.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93888658346128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642820ead0 con 0x55642820a920 2024-09-10T06:22:50.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbea950640 1 -- 172.21.15.117:0/1608971809 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93888658346128] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbdc00e620 con 0x55642820a920 2024-09-10T06:22:50.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbf564b9c0 20 remove_watcher() i=2 2024-09-10T06:22:50.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.281+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93888658351024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428211090 con 0x556428206040 2024-09-10T06:22:50.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf3151640 1 -- 172.21.15.117:0/1608971809 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93888658351024] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbe4124040 con 0x556428206040 2024-09-10T06:22:50.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf564b9c0 20 remove_watcher() i=3 2024-09-10T06:22:50.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93888658352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55642820ead0 con 0x556428201680 2024-09-10T06:22:50.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93888658352080] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x556428201680 2024-09-10T06:22:50.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf564b9c0 20 remove_watcher() i=4 2024-09-10T06:22:50.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.285+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93888658357072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428211090 con 0x7fbbe4115060 2024-09-10T06:22:50.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93888658357072] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf564b9c0 20 remove_watcher() i=5 2024-09-10T06:22:50.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93888658360624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428213b50 con 0x7fbbe4115060 2024-09-10T06:22:50.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93888658360624] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf564b9c0 20 remove_watcher() i=6 2024-09-10T06:22:50.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.289+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93888658354928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556428211090 con 0x7fbbe4115060 2024-09-10T06:22:50.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93888658354928] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbec00a4d0 con 0x7fbbe4115060 2024-09-10T06:22:50.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 20 remove_watcher() i=7 2024-09-10T06:22:50.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbbe4115060 msgr2=0x7fbbe41067c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbbe4115060 0x7fbbe41067c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556428201680 msgr2=0x556428203b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556428201680 0x556428203b10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556428206040 msgr2=0x556428208430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556428206040 0x556428208430 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55642820a920 msgr2=0x55642820cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55642820a920 0x55642820cd50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbabc039ac0 msgr2=0x7fbabc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbabc039ac0 0x7fbabc03bf80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5564281d5680 tx=0x7fbbdc010000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 msgr2=0x5564281f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/1608971809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281ef2f0 0x5564281f6630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40c07c0 tx=0x7fbbe40b2f80 comp rx=0 tx=0).stop 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf3952640 1 -- 172.21.15.117:0/1608971809 reap_dead start 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 shutdown_connections 2024-09-10T06:22:50.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 >> 172.21.15.117:0/1608971809 conn(0x5564281eb720 msgr2=0x5564281e9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 shutdown_connections 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/1608971809 wait complete. 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 msgr2=0x7fbacc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 0x7fbacc03bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00bf50 tx=0x7fbbdc00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 msgr2=0x5564281e3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b65a0 tx=0x7fbbe40b6c10 comp rx=0 tx=0).stop 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 shutdown_connections 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbacc039a70 0x7fbacc03bf30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2749026613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564281e2d20 0x5564281e3140 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 >> 172.21.15.117:0/2749026613 conn(0x5564281d86d0 msgr2=0x5564281d8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 shutdown_connections 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2749026613 wait complete. 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5564280d58b0 msgr2=0x5564281cc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5564280d58b0 0x5564281cc060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5564281ce820 msgr2=0x5564281d0c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5564281ce820 0x5564281d0c10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5564281d2720 msgr2=0x5564281d4b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5564281d2720 0x5564281d4b10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbad8039a70 msgr2=0x7fbad803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbad8039a70 0x7fbad803bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc001d80 tx=0x7fbbdc0012e0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 msgr2=0x5564281c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 --2- 172.21.15.117:0/2747044863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5564280d2770 0x5564281c4ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae040 tx=0x7fbbe4018020 comp rx=0 tx=0).stop 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf3952640 1 -- 172.21.15.117:0/2747044863 reap_dead start 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 shutdown_connections 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 >> 172.21.15.117:0/2747044863 conn(0x556428046080 msgr2=0x5564281b8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 shutdown_connections 2024-09-10T06:22:50.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.293+0000 7fbbf564b9c0 1 -- 172.21.15.117:0/2747044863 wait complete. 2024-09-10T06:22:50.309 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T06:22:50.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T06:22:50.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T06:22:50.310 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T06:22:50.385 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:50.385 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9e2319c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ecca1ea8f0 0x55ecca1ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9e2319c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecca09a9c0 con 0x55ecca15a890 2024-09-10T06:22:50.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9e2319c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55ecca0ea6d0 con 0x55ecca1ea8f0 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9b536640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ecca1ea8f0 0x55ecca1ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9bd37640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55ecca15a890 0x55ecca1e91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44142/0 (socket says 172.21.15.117:44142) 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9b536640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ecca1ea8f0 0x55ecca1ecce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41586/0 (socket says 172.21.15.117:41586) 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2420859407 learned_addr learned my addr 172.21.15.117:0/2420859407 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9b536640 1 -- 172.21.15.117:0/2420859407 >> v1:172.21.15.84:6789/0 conn(0x55ecca15a890 legacy=0x55ecca1e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.385+0000 7f7f9b536640 1 -- 172.21.15.117:0/2420859407 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca08eca0 con 0x55ecca1ea8f0 2024-09-10T06:22:50.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9b536640 1 --2- 172.21.15.117:0/2420859407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1ea8f0 0x55ecca1ecce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000a480 tx=0x7f7f9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a777f866ccccfa19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9ad35640 1 -- 172.21.15.117:0/2420859407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f900af070 con 0x55ecca1ea8f0 2024-09-10T06:22:50.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9ad35640 1 -- 172.21.15.117:0/2420859407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f900aa530 con 0x55ecca1ea8f0 2024-09-10T06:22:50.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9ad35640 1 -- 172.21.15.117:0/2420859407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f900aa830 con 0x55ecca1ea8f0 2024-09-10T06:22:50.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2420859407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1ea8f0 msgr2=0x55ecca1ecce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2420859407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1ea8f0 0x55ecca1ecce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000a480 tx=0x7f7f9001b280 comp rx=0 tx=0).stop 2024-09-10T06:22:50.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2420859407 shutdown_connections 2024-09-10T06:22:50.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2420859407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1ea8f0 0x55ecca1ecce0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2420859407 >> 172.21.15.117:0/2420859407 conn(0x55ecca1e0f00 msgr2=0x55ecca1e3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2420859407 shutdown_connections 2024-09-10T06:22:50.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.389+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2420859407 wait complete. 2024-09-10T06:22:50.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9e2319c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9e2319c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecca0ee680 con 0x55ecca15a890 2024-09-10T06:22:50.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41590/0 (socket says 172.21.15.117:41590) 2024-09-10T06:22:50.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2036450392 learned_addr learned my addr 172.21.15.117:0/2036450392 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2036450392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca069da0 con 0x55ecca15a890 2024-09-10T06:22:50.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2036450392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c001e00 tx=0x7f7f8c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eee353f3641ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.401+0000 7f7e89e0b640 1 -- 172.21.15.117:0/2036450392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c012020 con 0x55ecca15a890 2024-09-10T06:22:50.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7e89e0b640 1 -- 172.21.15.117:0/2036450392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00e690 con 0x55ecca15a890 2024-09-10T06:22:50.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7e89e0b640 1 -- 172.21.15.117:0/2036450392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c00ea10 con 0x55ecca15a890 2024-09-10T06:22:50.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2036450392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 msgr2=0x55ecca2d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2036450392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c001e00 tx=0x7f7f8c00b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2036450392 shutdown_connections 2024-09-10T06:22:50.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2036450392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d19f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2036450392 >> 172.21.15.117:0/2036450392 conn(0x55ecca1e0f00 msgr2=0x55ecca2cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2036450392 shutdown_connections 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2036450392 wait complete. 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecca090a50 con 0x55ecca15a890 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41598/0 (socket says 172.21.15.117:41598) 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2822965507 learned_addr learned my addr 172.21.15.117:0/2822965507 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca2d95f0 con 0x55ecca15a890 2024-09-10T06:22:50.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00b710 tx=0x7f7f8c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7e83fff640 1 -- 172.21.15.117:0/2822965507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c012030 con 0x55ecca15a890 2024-09-10T06:22:50.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecca2d9880 con 0x55ecca15a890 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecca2da230 con 0x55ecca15a890 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7e83fff640 1 -- 172.21.15.117:0/2822965507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c01a750 con 0x55ecca15a890 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7e83fff640 1 -- 172.21.15.117:0/2822965507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c01aa70 con 0x55ecca15a890 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9e2319c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecca0fb450 con 0x55ecca1e6a60 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9c538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.405+0000 7f7f9c538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41604/0 (socket says 172.21.15.117:41604) 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 -- 172.21.15.117:0/371435381 learned_addr learned my addr 172.21.15.117:0/371435381 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e83fff640 1 -- 172.21.15.117:0/2822965507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7f8c015020 con 0x55ecca15a890 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e83fff640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 0x7f7e8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 -- 172.21.15.117:0/371435381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca1e6f10 con 0x55ecca1e6a60 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e83fff640 1 -- 172.21.15.117:0/2822965507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7f8c020030 con 0x55ecca15a890 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 0x7f7e8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 --2- 172.21.15.117:0/371435381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400a430 tx=0x7f7f9400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f236beea083a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 0x7f7e8403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c016b20 tx=0x7f7f8c0169b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e81ffb640 1 -- 172.21.15.117:0/371435381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9400f6e0 con 0x55ecca1e6a60 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e81ffb640 1 -- 172.21.15.117:0/371435381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f94015070 con 0x55ecca1e6a60 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e81ffb640 1 -- 172.21.15.117:0/371435381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9400fa10 con 0x55ecca1e6a60 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/371435381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 msgr2=0x55ecca1e51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/371435381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400a430 tx=0x7f7f9400a8f0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/371435381 shutdown_connections 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/371435381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca1e51d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/371435381 >> 172.21.15.117:0/371435381 conn(0x55ecca1ea8f0 msgr2=0x55ecca2e1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/371435381 shutdown_connections 2024-09-10T06:22:50.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/371435381 wait complete. 2024-09-10T06:22:50.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecca1e57d0 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41614/0 (socket says 172.21.15.117:41614) 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 -- 172.21.15.117:0/1959086498 learned_addr learned my addr 172.21.15.117:0/1959086498 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 -- 172.21.15.117:0/1959086498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca2ef8a0 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9c538640 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ecca1e62f0 tx=0x7f7f94003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e7bfff640 1 -- 172.21.15.117:0/1959086498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f94010a20 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e7bfff640 1 -- 172.21.15.117:0/1959086498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f94020070 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7e7bfff640 1 -- 172.21.15.117:0/1959086498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f94010d50 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecca2efb30 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.409+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecca2f04e0 con 0x55ecca1e6a60 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:50.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e7bfff640 1 -- 172.21.15.117:0/1959086498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7f9401b420 con 0x55ecca1e6a60 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 Processor -- start 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 -- start start 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e7bfff640 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 0x7f7e7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecca2d2220 con 0x55ecca308e90 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e7bfff640 1 -- 172.21.15.117:0/1959086498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7f940509f0 con 0x55ecca1e6a60 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9c538640 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 0x7f7e7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9bd37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41624/0 (socket says 172.21.15.117:41624) 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2041730415 learned_addr learned my addr 172.21.15.117:0/2041730415 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9c538640 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 0x7f7e7403bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f9401c920 tx=0x7f7f9401c830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2041730415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecca3098a0 con 0x55ecca308e90 2024-09-10T06:22:50.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c01a6a0 tx=0x7f7f8c02d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e0bfff640 1 -- 172.21.15.117:0/2041730415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c03c070 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecca30a150 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e0bfff640 1 -- 172.21.15.117:0/2041730415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c02c350 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7e0bfff640 1 -- 172.21.15.117:0/2041730415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f8c015310 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.413+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecca30a670 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7e0bfff640 1 -- 172.21.15.117:0/2041730415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7f8c03f070 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7e0bfff640 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 0x7f7ddc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7e0bfff640 1 -- 172.21.15.117:0/2041730415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7f8c005050 con 0x55ecca308e90 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9b536640 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 0x7f7ddc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7e09ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 0x55ecca310d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecca3113f0 con 0x55ecca30e880 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9b536640 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 0x7f7ddc03bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ac000 tx=0x7f7f900a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9c538640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 0x55ecca310d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9c538640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 0x55ecca310d40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9c538640 1 -- 172.21.15.117:0/2822965507 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f9400e070 con 0x55ecca30e880 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 0x55ecca315650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:2 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecca315cf0 con 0x55ecca313260 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 0x55ecca315650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9bd37640 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 0x55ecca315650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2822965507 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(2 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f8c03e030 con 0x55ecca313260 2024-09-10T06:22:50.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.417+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecca31ae90 con 0x55ecca313260 2024-09-10T06:22:50.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9bd37640 1 -- 172.21.15.117:0/2822965507 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f7f8c03e030 con 0x55ecca313260 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 msgr2=0x7f7e7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 0x7f7e7403bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f9401c920 tx=0x7f7f9401c830 comp rx=0 tx=0).stop 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 msgr2=0x55ecca2ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ecca1e62f0 tx=0x7f7f94003380 comp rx=0 tx=0).stop 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 shutdown_connections 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e74039a70 0x7f7e7403bf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/1959086498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca1e6a60 0x55ecca2ef340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 >> 172.21.15.117:0/1959086498 conn(0x55ecca1ea8f0 msgr2=0x55ecca2dfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 shutdown_connections 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/1959086498 wait complete. 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 msgr2=0x7f7ddc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 0x7f7ddc03bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ac000 tx=0x7f7f900a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 msgr2=0x55ecca3092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c01a6a0 tx=0x7f7f8c02d7c0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 shutdown_connections 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7ddc039a70 0x7f7ddc03bf30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2041730415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca308e90 0x55ecca3092b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 >> 172.21.15.117:0/2041730415 conn(0x55ecca2fe490 msgr2=0x55ecca2fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 shutdown_connections 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2041730415 wait complete. 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 msgr2=0x55ecca310d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 0x55ecca310d40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 msgr2=0x55ecca315650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 0x55ecca315650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 msgr2=0x7f7e8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 0x7f7e8403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c016b20 tx=0x7f7f8c0169b0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 msgr2=0x55ecca2d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00b710 tx=0x7f7f8c000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 shutdown_connections 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ecca313260 0x55ecca315650 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ecca30e880 0x55ecca310d40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7e84039a70 0x7f7e8403bf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 --2- 172.21.15.117:0/2822965507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecca15a890 0x55ecca2d9090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 >> 172.21.15.117:0/2822965507 conn(0x55ecca1e0f00 msgr2=0x55ecca2cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 shutdown_connections 2024-09-10T06:22:50.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.421+0000 7f7f9e2319c0 1 -- 172.21.15.117:0/2822965507 wait complete. 2024-09-10T06:22:50.433 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T06:22:50.434 DEBUG:tasks.util.rgw: json result: {'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T06:22:50.435 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T06:22:50.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T06:22:50.435 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T06:22:50.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:50.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:50.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.501+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.501+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.501+0000 7f9fbc5ee9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b642e05750 0x55b642e96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.501+0000 7f9fbc5ee9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b642d459c0 con 0x55b642e05b30 2024-09-10T06:22:50.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.501+0000 7f9fbc5ee9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55b642d956d0 con 0x55b642e05750 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b642e05750 0x55b642e96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b642e05750 0x55b642e96580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41628/0 (socket says 172.21.15.117:41628) 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 -- 172.21.15.117:0/87426548 learned_addr learned my addr 172.21.15.117:0/87426548 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fb98f3640 1 --1- 172.21.15.117:0/87426548 >> v1:172.21.15.84:6789/0 conn(0x55b642e05b30 0x55b642e98ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44144/0 (socket says 172.21.15.117:44144) 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 -- 172.21.15.117:0/87426548 >> v1:172.21.15.84:6789/0 conn(0x55b642e05b30 legacy=0x55b642e98ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 -- 172.21.15.117:0/87426548 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642d39ca0 con 0x55b642e05750 2024-09-10T06:22:50.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/87426548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642e96580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400a5c0 tx=0x7f9fa401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010effeafb6e9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fb90f2640 1 -- 172.21.15.117:0/87426548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40a6070 con 0x55b642e05750 2024-09-10T06:22:50.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fb90f2640 1 -- 172.21.15.117:0/87426548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40af070 con 0x55b642e05750 2024-09-10T06:22:50.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fb90f2640 1 -- 172.21.15.117:0/87426548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40aa5c0 con 0x55b642e05750 2024-09-10T06:22:50.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/87426548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 msgr2=0x55b642e96580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/87426548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642e96580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400a5c0 tx=0x7f9fa401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:50.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/87426548 shutdown_connections 2024-09-10T06:22:50.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/87426548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642e96580 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/87426548 >> 172.21.15.117:0/87426548 conn(0x55b642e8be70 msgr2=0x55b642e8e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/87426548 shutdown_connections 2024-09-10T06:22:50.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.505+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/87426548 wait complete. 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.517+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b642d99680 con 0x55b642e05750 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41638/0 (socket says 172.21.15.117:41638) 2024-09-10T06:22:50.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 -- 172.21.15.117:0/3084447108 learned_addr learned my addr 172.21.15.117:0/3084447108 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 -- 172.21.15.117:0/3084447108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642d14da0 con 0x55b642e05750 2024-09-10T06:22:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/3084447108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4018f70 tx=0x7f9fa4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d3130bd1c50ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9ea8608640 1 -- 172.21.15.117:0/3084447108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40aa9e0 con 0x55b642e05750 2024-09-10T06:22:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9ea8608640 1 -- 172.21.15.117:0/3084447108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40aab80 con 0x55b642e05750 2024-09-10T06:22:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9ea8608640 1 -- 172.21.15.117:0/3084447108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40aae60 con 0x55b642e05750 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3084447108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 msgr2=0x55b642f7e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3084447108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4018f70 tx=0x7f9fa4003030 comp rx=0 tx=0).stop 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3084447108 shutdown_connections 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3084447108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f7e9c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3084447108 >> 172.21.15.117:0/3084447108 conn(0x55b642e8be70 msgr2=0x55b642f7a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3084447108 shutdown_connections 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3084447108 wait complete. 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f85f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fbc5ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b642d3ba50 con 0x55b642e05750 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f85f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f85f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41654/0 (socket says 172.21.15.117:41654) 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 -- 172.21.15.117:0/1073309366 learned_addr learned my addr 172.21.15.117:0/1073309366 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.521+0000 7f9fba0f4640 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642f86460 con 0x55b642e05750 2024-09-10T06:22:50.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f85f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c10 tx=0x7f9fa40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 -- 172.21.15.117:0/1073309366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40c6750 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b642f866f0 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b642f870a0 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 -- 172.21.15.117:0/1073309366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40c68f0 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 -- 172.21.15.117:0/1073309366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40c6bd0 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 -- 172.21.15.117:0/1073309366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9fa40ce030 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9ea0039ac0 0x7f9ea003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9ea6e05640 1 -- 172.21.15.117:0/1073309366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9fa40cc020 con 0x55b642e05750 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9ea0039ac0 0x7f9ea003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642e05b30 0x55b642f8d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642f8d5b0 con 0x55b642e05b30 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642e05b30 0x55b642f8d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9ea0039ac0 0x7f9ea003bf80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9fac001e40 tx=0x7f9fac0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642e05b30 0x55b642f8d070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba8f5640 1 -- 172.21.15.117:0/1073309366 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642e05b30 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642f8da00 con 0x55b642e05b30 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba8f5640 1 -- 172.21.15.117:0/1073309366 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642e05b30 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642f8f810 0x55b642f91c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642f922d0 con 0x55b642f8f810 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642f8f810 0x55b642f91c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642f8f810 0x55b642f91c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fba0f4640 1 -- 172.21.15.117:0/1073309366 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fa40b33f0 con 0x55b642f8f810 2024-09-10T06:22:50.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.525+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642f8e6b0 con 0x55b642e05b30 2024-09-10T06:22:50.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba8f5640 1 -- 172.21.15.117:0/1073309366 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642e05b30 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642f93710 0x55b642f95b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642f96290 con 0x55b642f93710 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642f93710 0x55b642f95b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642f93710 0x55b642f95b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fb98f3640 1 -- 172.21.15.117:0/1073309366 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fac00bd60 con 0x55b642f93710 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b642da6450 con 0x55b642fa3d50 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41668/0 (socket says 172.21.15.117:41668) 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba0f4640 1 -- 172.21.15.117:0/3769528775 learned_addr learned my addr 172.21.15.117:0/3769528775 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba0f4640 1 -- 172.21.15.117:0/3769528775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642fa47b0 con 0x55b642fa3d50 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4018f70 tx=0x7f9fa40c5bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9e9ffff640 1 -- 172.21.15.117:0/3769528775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40c57b0 con 0x55b642fa3d50 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b642fa5010 con 0x55b642fa3d50 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9e9ffff640 1 -- 172.21.15.117:0/3769528775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40eba80 con 0x55b642fa3d50 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b642fa5580 con 0x55b642fa3d50 2024-09-10T06:22:50.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.529+0000 7f9e9ffff640 1 -- 172.21.15.117:0/3769528775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40c5950 con 0x55b642fa3d50 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9ffff640 1 -- 172.21.15.117:0/3769528775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9fa40f2060 con 0x55b642fa3d50 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9ffff640 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 0x7f9e9403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9ffff640 1 -- 172.21.15.117:0/3769528775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9fa40e5070 con 0x55b642fa3d50 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 0x7f9e9403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 0x7f9e9403bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c010 tx=0x7f9fac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b642f7f150 con 0x55b642fb13d0 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41680/0 (socket says 172.21.15.117:41680) 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 -- 172.21.15.117:0/2723195369 learned_addr learned my addr 172.21.15.117:0/2723195369 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 -- 172.21.15.117:0/2723195369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642fb1dc0 con 0x55b642fb13d0 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/2723195369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40cf900 tx=0x7f9fa40c7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fe136c73648a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9dffb640 1 -- 172.21.15.117:0/2723195369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4103070 con 0x55b642fb13d0 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9dffb640 1 -- 172.21.15.117:0/2723195369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40eb340 con 0x55b642fb13d0 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9e9dffb640 1 -- 172.21.15.117:0/2723195369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40e8400 con 0x55b642fb13d0 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/2723195369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 msgr2=0x55b642fb17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/2723195369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40cf900 tx=0x7f9fa40c7cb0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/2723195369 shutdown_connections 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/2723195369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb17d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/2723195369 >> 172.21.15.117:0/2723195369 conn(0x55b642fac7f0 msgr2=0x55b642faaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/2723195369 shutdown_connections 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/2723195369 wait complete. 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 Processor -- start 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- start start 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fbc5ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b642fb01a0 con 0x55b642fb13d0 2024-09-10T06:22:50.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41682/0 (socket says 172.21.15.117:41682) 2024-09-10T06:22:50.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.533+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 learned_addr learned my addr 172.21.15.117:0/4040724257 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642fb7cc0 con 0x55b642fb13d0 2024-09-10T06:22:50.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40de7f0 tx=0x7f9fa40eef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 -- 172.21.15.117:0/4040724257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4118070 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b642fb7cc0 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b642fb7cc0 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 -- 172.21.15.117:0/4040724257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40eb340 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 -- 172.21.15.117:0/4040724257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4103040 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 -- 172.21.15.117:0/4040724257 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9fa411b070 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e84039a70 0x7f9e8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9e8bfff640 1 -- 172.21.15.117:0/4040724257 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f9fa410f030 con 0x55b642fb13d0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e84039a70 0x7f9e8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642fc2740 0x55b642fc4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc5320 con 0x55b642fc2740 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642fc2740 0x55b642fc4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e84039a70 0x7f9e8403bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55b642f96690 tx=0x7f9fac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642fc2740 0x55b642fc4bd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 realm 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc5730 con 0x55b642fc2740 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc6000 con 0x55b642fc2740 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.537+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642fc6ed0 0x55b642fc92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc9a00 con 0x55b642fc6ed0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642fc6ed0 0x55b642fc92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642fc6ed0 0x55b642fc92c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 20 searching for the correct realm 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642fcb9a0 0x55b642fcde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fce4e0 con 0x55b642fcb9a0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642fcb9a0 0x55b642fcde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fb98f3640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642fcb9a0 0x55b642fcde10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fce4e0 con 0x55b642fc6ed0 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9fa411d060 0x7f9fa40e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fce4e0 con 0x7f9fa411d060 2024-09-10T06:22:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9fa411d060 0x7f9fa40e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9fa411d060 0x7f9fa40e4990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.541+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc6ed0 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc6ed0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.545+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc6ed0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.549+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc6ed0 2024-09-10T06:22:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fcb9a0 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x7f9fa411d060 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc2740 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b642fc63a0 con 0x55b642fc6ed0 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fca2c0 con 0x55b642fc2740 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fca6b0 con 0x55b642fc2740 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fca6b0 con 0x55b642fcb9a0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 zone default found 2024-09-10T06:22:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 4 Realm: () 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 zonegroup default 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fce960 con 0x7f9fa411d060 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd0350 con 0x55b642fcb9a0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd06f0 con 0x55b642fcb9a0 2024-09-10T06:22:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 started sync module instance, tier type = 2024-09-10T06:22:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.553+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fcf7f0 con 0x55b642fc6ed0 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241296284688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fcf450 con 0x55b642fc6ed0 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd15d0 con 0x55b642fc2740 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241296284688] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241296290080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd1540 con 0x55b642fc2740 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.557+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd2360 con 0x55b642fcb9a0 2024-09-10T06:22:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241296290080] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241296292288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd2750 con 0x55b642fcb9a0 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd3110 con 0x55b642fc6ed0 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241296297328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd37c0 con 0x55b642fc6ed0 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd42e0 con 0x55b642fc2740 2024-09-10T06:22:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.561+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241296292288] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241296297328] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241296301488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd42a0 con 0x55b642fc2740 2024-09-10T06:22:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd4b80 con 0x7f9fa411d060 2024-09-10T06:22:50.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241296301488] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241296293344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd4750 con 0x7f9fa411d060 2024-09-10T06:22:50.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.565+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd5110 con 0x7f9fa411d060 2024-09-10T06:22:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.569+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.569+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241296305248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd5530 con 0x7f9fa411d060 2024-09-10T06:22:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.569+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd6020 con 0x7f9fa411d060 2024-09-10T06:22:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241296293344] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241296305248] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241296308976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd42a0 con 0x7f9fa411d060 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=0 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=1 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=2 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=3 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=4 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=5 2024-09-10T06:22:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=6 2024-09-10T06:22:50.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241296308976] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 20 add_watcher() i=7 2024-09-10T06:22:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.573+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd9010 con 0x55b642fc2740 2024-09-10T06:22:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241296306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642fd6490 con 0x55b642fc2740 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241296306304] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9e70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 5 note: GC not initialized 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9deb7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 20 Filter name: none 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9de97fa640 20 reqs_thread_entry: start 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcb20 con 0x55b642fc2740 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcb20 con 0x55b642fc6ed0 2024-09-10T06:22:50.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcae0 con 0x55b642fc2740 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcae0 con 0x55b642fcb9a0 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcff0 con 0x55b642fcb9a0 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcff0 con 0x55b642fcb9a0 2024-09-10T06:22:50.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcff0 con 0x55b642fc2740 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcff0 con 0x55b642fc2740 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.577+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fcb9a0 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fcb9a0 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x7f9fa411d060 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fc2740 2024-09-10T06:22:50.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fc6ed0 2024-09-10T06:22:50.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fcb9a0 2024-09-10T06:22:50.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fcb9a0 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.581+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fc2740 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fcb9a0 2024-09-10T06:22:50.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x7f9fa411d060 2024-09-10T06:22:50.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcfa0 con 0x55b642fc6ed0 2024-09-10T06:22:50.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x7f9fa411d060 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fcb9a0 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.585+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x7f9fa411d060 2024-09-10T06:22:50.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9e70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241296306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94241296306304] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241296284688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc6ed0 2024-09-10T06:22:50.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94241296284688] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 20 remove_watcher() i=0 2024-09-10T06:22:50.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 2 removed watcher, disabling cache 2024-09-10T06:22:50.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.589+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241296290080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.593+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94241296290080] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.593+0000 7f9fbc5ee9c0 20 remove_watcher() i=1 2024-09-10T06:22:50.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.593+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241296292288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fcb9a0 2024-09-10T06:22:50.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fb98f3640 1 -- 172.21.15.117:0/4040724257 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94241296292288] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac037040 con 0x55b642fcb9a0 2024-09-10T06:22:50.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fbc5ee9c0 20 remove_watcher() i=2 2024-09-10T06:22:50.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241296297328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc6ed0 2024-09-10T06:22:50.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fba0f4640 1 -- 172.21.15.117:0/4040724257 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94241296297328] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa411a030 con 0x55b642fc6ed0 2024-09-10T06:22:50.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fbc5ee9c0 20 remove_watcher() i=3 2024-09-10T06:22:50.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.597+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241296301488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x55b642fc2740 2024-09-10T06:22:50.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94241296301488] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x55b642fc2740 2024-09-10T06:22:50.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fbc5ee9c0 20 remove_watcher() i=4 2024-09-10T06:22:50.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241296293344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x7f9fa411d060 2024-09-10T06:22:50.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94241296293344] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fbc5ee9c0 20 remove_watcher() i=5 2024-09-10T06:22:50.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.601+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241296305248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x7f9fa411d060 2024-09-10T06:22:50.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.605+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94241296305248] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.605+0000 7f9fbc5ee9c0 20 remove_watcher() i=6 2024-09-10T06:22:50.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.605+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241296308976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b642ffcf50 con 0x7f9fa411d060 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94241296308976] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fb400a4d0 con 0x7f9fa411d060 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 20 remove_watcher() i=7 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9fa411d060 msgr2=0x7f9fa40e4990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9fa411d060 0x7f9fa40e4990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642fc2740 msgr2=0x55b642fc4bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642fc2740 0x55b642fc4bd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642fc6ed0 msgr2=0x55b642fc92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642fc6ed0 0x55b642fc92c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642fcb9a0 msgr2=0x55b642fcde10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642fcb9a0 0x55b642fcde10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e84039a70 msgr2=0x7f9e8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e84039a70 0x7f9e8403bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55b642f96690 tx=0x7f9fac010000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fba8f5640 1 -- 172.21.15.117:0/4040724257 reap_dead start 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 msgr2=0x55b642fb7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40de7f0 tx=0x7f9fa40eef90 comp rx=0 tx=0).stop 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 shutdown_connections 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/4040724257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fb13d0 0x55b642fb7760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 >> 172.21.15.117:0/4040724257 conn(0x55b642fac7f0 msgr2=0x55b642faaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 shutdown_connections 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/4040724257 wait complete. 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 msgr2=0x7f9e9403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 0x7f9e9403bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c010 tx=0x7f9fac00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 msgr2=0x55b642fa4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4018f70 tx=0x7f9fa40c5bf0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 shutdown_connections 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9e94039ac0 0x7f9e9403bf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/3769528775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642fa3d50 0x55b642fa4170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 >> 172.21.15.117:0/3769528775 conn(0x55b642f99700 msgr2=0x55b642f99ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 shutdown_connections 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/3769528775 wait complete. 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642e05b30 msgr2=0x55b642f8d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b642e05b30 0x55b642f8d070 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642f8f810 msgr2=0x55b642f91c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b642f8f810 0x55b642f91c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642f93710 msgr2=0x55b642f95b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b642f93710 0x55b642f95b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9ea0039ac0 msgr2=0x7f9ea003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9ea0039ac0 0x7f9ea003bf80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9fac001e40 tx=0x7f9fac0013a0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 msgr2=0x55b642f85f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 --2- 172.21.15.117:0/1073309366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b642e05750 0x55b642f85f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c10 tx=0x7f9fa40180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fba8f5640 1 -- 172.21.15.117:0/1073309366 reap_dead start 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 shutdown_connections 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 >> 172.21.15.117:0/1073309366 conn(0x55b642e8be70 msgr2=0x55b642f790f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 shutdown_connections 2024-09-10T06:22:50.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.609+0000 7f9fbc5ee9c0 1 -- 172.21.15.117:0/1073309366 wait complete. 2024-09-10T06:22:50.620 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[],"summary":[]} 2024-09-10T06:22:50.621 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T06:22:50.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:50.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:50.621 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:50.695 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:50.695 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:50.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4af0b239c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c3c9637f90 0x55c3c96c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4af0b239c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3c95779c0 con 0x55c3c9638370 2024-09-10T06:22:50.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4af0b239c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c3c95c76d0 con 0x55c3c9637f90 2024-09-10T06:22:50.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4aee629640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c3c9637f90 0x55c3c96c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4aede28640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55c3c9638370 0x55c3c96cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44158/0 (socket says 172.21.15.117:44158) 2024-09-10T06:22:50.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4aede28640 1 -- 172.21.15.117:0/3378391582 learned_addr learned my addr 172.21.15.117:0/3378391582 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:50.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4aee629640 1 -- 172.21.15.117:0/3378391582 >> v1:172.21.15.84:6789/0 conn(0x55c3c9638370 legacy=0x55c3c96cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.693+0000 7f4aee629640 1 -- 172.21.15.117:0/3378391582 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c956bca0 con 0x55c3c9637f90 2024-09-10T06:22:50.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4aee629640 1 --2- 172.21.15.117:0/3378391582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9637f90 0x55c3c96c85f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800a480 tx=0x7f4ae801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e64a0ec67714358 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4aed627640 1 -- 172.21.15.117:0/3378391582 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80b0070 con 0x55c3c9637f90 2024-09-10T06:22:50.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4aed627640 1 -- 172.21.15.117:0/3378391582 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80ab540 con 0x55c3c9637f90 2024-09-10T06:22:50.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4aed627640 1 -- 172.21.15.117:0/3378391582 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80ab840 con 0x55c3c9637f90 2024-09-10T06:22:50.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3378391582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9637f90 msgr2=0x55c3c96c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3378391582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9637f90 0x55c3c96c85f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800a480 tx=0x7f4ae801b280 comp rx=0 tx=0).stop 2024-09-10T06:22:50.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3378391582 shutdown_connections 2024-09-10T06:22:50.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3378391582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9637f90 0x55c3c96c85f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3378391582 >> 172.21.15.117:0/3378391582 conn(0x55c3c96bdee0 msgr2=0x55c3c96c0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3378391582 shutdown_connections 2024-09-10T06:22:50.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.697+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3378391582 wait complete. 2024-09-10T06:22:50.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.709+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.709+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3c95cb680 con 0x55c3c9638370 2024-09-10T06:22:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41694/0 (socket says 172.21.15.117:41694) 2024-09-10T06:22:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 -- 172.21.15.117:0/1660553418 learned_addr learned my addr 172.21.15.117:0/1660553418 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 -- 172.21.15.117:0/1660553418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c9546da0 con 0x55c3c9638370 2024-09-10T06:22:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 --2- 172.21.15.117:0/1660553418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8018eb0 tx=0x7f4ae8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c7bdad4dce6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f49dc608640 1 -- 172.21.15.117:0/1660553418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80b0040 con 0x55c3c9638370 2024-09-10T06:22:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f49dc608640 1 -- 172.21.15.117:0/1660553418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80bb070 con 0x55c3c9638370 2024-09-10T06:22:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f49dc608640 1 -- 172.21.15.117:0/1660553418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80ab6f0 con 0x55c3c9638370 2024-09-10T06:22:50.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- 172.21.15.117:0/1660553418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 msgr2=0x55c3c97b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/1660553418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8018eb0 tx=0x7f4ae8003030 comp rx=0 tx=0).stop 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- 172.21.15.117:0/1660553418 shutdown_connections 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/1660553418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b0bb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- 172.21.15.117:0/1660553418 >> 172.21.15.117:0/1660553418 conn(0x55c3c96bdee0 msgr2=0x55c3c97ac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- 172.21.15.117:0/1660553418 shutdown_connections 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- 172.21.15.117:0/1660553418 wait complete. 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4af0b239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3c956da50 con 0x55c3c9638370 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41696/0 (socket says 172.21.15.117:41696) 2024-09-10T06:22:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 -- 172.21.15.117:0/302186244 learned_addr learned my addr 172.21.15.117:0/302186244 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.713+0000 7f4aee629640 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c97b85c0 con 0x55c3c9638370 2024-09-10T06:22:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aee629640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b8060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ae801bb20 tx=0x7f4ae8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 -- 172.21.15.117:0/302186244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80b0070 con 0x55c3c9638370 2024-09-10T06:22:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3c97b8850 con 0x55c3c9638370 2024-09-10T06:22:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c97b91b0 con 0x55c3c9638370 2024-09-10T06:22:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 -- 172.21.15.117:0/302186244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80bb030 con 0x55c3c9638370 2024-09-10T06:22:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 -- 172.21.15.117:0/302186244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80b67b0 con 0x55c3c9638370 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 -- 172.21.15.117:0/302186244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4ae80b6950 con 0x55c3c9638370 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49d4039ac0 0x7f49d403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f49dae05640 1 -- 172.21.15.117:0/302186244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4ae80a8070 con 0x55c3c9638370 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aede28640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49d4039ac0 0x7f49d403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97bd170 0x55c3c97bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97bfaa0 con 0x55c3c97bd170 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97bd170 0x55c3c97bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aede28640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49d4039ac0 0x7f49d403bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4001650 tx=0x7f4ae4006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97bd170 0x55c3c97bf560 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aeee2a640 1 -- 172.21.15.117:0/302186244 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97bd170 2024-09-10T06:22:50.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97bfe40 con 0x55c3c97bd170 2024-09-10T06:22:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aeee2a640 1 -- 172.21.15.117:0/302186244 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97bd170 2024-09-10T06:22:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97c1c50 0x55c3c97c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97c4730 con 0x55c3c97c1c50 2024-09-10T06:22:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aee629640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97c1c50 0x55c3c97c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aee629640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97c1c50 0x55c3c97c4040 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4aee629640 1 -- 172.21.15.117:0/302186244 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97c1c50 2024-09-10T06:22:50.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.717+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97c0af0 con 0x55c3c97bd170 2024-09-10T06:22:50.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aeee2a640 1 -- 172.21.15.117:0/302186244 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97bd170 2024-09-10T06:22:50.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97c5b90 0x55c3c97c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97c86c0 con 0x55c3c97c5b90 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aede28640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97c5b90 0x55c3c97c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aede28640 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97c5b90 0x55c3c97c7f80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aede28640 1 -- 172.21.15.117:0/302186244 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97c5b90 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3c95d8450 con 0x55c3c97d61c0 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41702/0 (socket says 172.21.15.117:41702) 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aee629640 1 -- 172.21.15.117:0/3708478761 learned_addr learned my addr 172.21.15.117:0/3708478761 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aee629640 1 -- 172.21.15.117:0/3708478761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c97d6c20 con 0x55c3c97d61c0 2024-09-10T06:22:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4aee629640 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8000bf0 tx=0x7f4ae80e85e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f49d3fff640 1 -- 172.21.15.117:0/3708478761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80c8400 con 0x55c3c97d61c0 2024-09-10T06:22:50.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3c97d7480 con 0x55c3c97d61c0 2024-09-10T06:22:50.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c97d7480 con 0x55c3c97d61c0 2024-09-10T06:22:50.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f49d3fff640 1 -- 172.21.15.117:0/3708478761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80e1070 con 0x55c3c97d61c0 2024-09-10T06:22:50.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.721+0000 7f49d3fff640 1 -- 172.21.15.117:0/3708478761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80f0060 con 0x55c3c97d61c0 2024-09-10T06:22:50.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d3fff640 1 -- 172.21.15.117:0/3708478761 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4ae80e2270 con 0x55c3c97d61c0 2024-09-10T06:22:50.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d3fff640 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 0x7f49c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d3fff640 1 -- 172.21.15.117:0/3708478761 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4ae80ad0c0 con 0x55c3c97d61c0 2024-09-10T06:22:50.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aede28640 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 0x7f49c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aede28640 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 0x7f49c803bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40062e0 tx=0x7f4ae400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3c97b1320 con 0x55c3c97e36e0 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41704/0 (socket says 172.21.15.117:41704) 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 -- 172.21.15.117:0/3848347955 learned_addr learned my addr 172.21.15.117:0/3848347955 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 -- 172.21.15.117:0/3848347955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c97e40d0 con 0x55c3c97e36e0 2024-09-10T06:22:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 --2- 172.21.15.117:0/3848347955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80defd0 tx=0x7f4ae80dcbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a177a208e481e2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d1ffb640 1 -- 172.21.15.117:0/3848347955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80dc410 con 0x55c3c97e36e0 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d1ffb640 1 -- 172.21.15.117:0/3848347955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80080c0 con 0x55c3c97e36e0 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f49d1ffb640 1 -- 172.21.15.117:0/3848347955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae8006c90 con 0x55c3c97e36e0 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3848347955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 msgr2=0x55c3c97e3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3848347955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80defd0 tx=0x7f4ae80dcbc0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3848347955 shutdown_connections 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3848347955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e3ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3848347955 >> 172.21.15.117:0/3848347955 conn(0x55c3c97deb00 msgr2=0x55c3c97dcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3848347955 shutdown_connections 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3848347955 wait complete. 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 Processor -- start 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- start start 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4af0b239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3c97e24b0 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41718/0 (socket says 172.21.15.117:41718) 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.725+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 learned_addr learned my addr 172.21.15.117:0/132811383 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c97e9ef0 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aee629640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80e87b0 tx=0x7f4ae80b4570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 -- 172.21.15.117:0/132811383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae810e070 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3c97e9ef0 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c97e9ef0 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 -- 172.21.15.117:0/132811383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80e2850 con 0x55c3c97e36e0 2024-09-10T06:22:50.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 -- 172.21.15.117:0/132811383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae80eb540 con 0x55c3c97e36e0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 -- 172.21.15.117:0/132811383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4ae8107040 con 0x55c3c97e36e0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49b8039a70 0x7f49b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f49bffff640 1 -- 172.21.15.117:0/132811383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4ae80d71c0 con 0x55c3c97e36e0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aede28640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49b8039a70 0x7f49b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97f49b0 0x55c3c97f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f7590 con 0x55c3c97f49b0 2024-09-10T06:22:50.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97f49b0 0x55c3c97f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aede28640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49b8039a70 0x7f49b803bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55c3c97b94d0 tx=0x7f4ae4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97f49b0 0x55c3c97f6e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 realm 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f79a0 con 0x55c3c97f49b0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8270 con 0x55c3c97f49b0 2024-09-10T06:22:50.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.729+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97f9140 0x55c3c97fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97fbc70 con 0x55c3c97f9140 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97f9140 0x55c3c97fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97f9140 0x55c3c97fb530 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 20 searching for the correct realm 2024-09-10T06:22:50.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97fdc10 0x55c3c98000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98007a0 con 0x55c3c97fdc10 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aede28640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97fdc10 0x55c3c98000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aede28640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97fdc10 0x55c3c98000d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98007a0 con 0x55c3c97f9140 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4ae810a040 0x7f4ae8009420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98007a0 con 0x7f4ae810a040 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4ae810a040 0x7f4ae8009420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4ae810a040 0x7f4ae8009420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae00083f0 con 0x7f4ae810a040 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae00083f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.733+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f9140 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f9140 2024-09-10T06:22:50.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.737+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f9140 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.741+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f9140 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97fdc10 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x7f4ae810a040 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f49b0 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97f8610 con 0x55c3c97f9140 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:50.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97fc530 con 0x55c3c97f49b0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97fc920 con 0x55c3c97f49b0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c97fc920 con 0x55c3c97fdc10 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:50.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 zone default found 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 4 Realm: () 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 zonegroup default 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9800c20 con 0x7f4ae810a040 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9802610 con 0x55c3c97fdc10 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98029b0 con 0x55c3c97fdc10 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 started sync module instance, tier type = 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.745+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9801ab0 con 0x55c3c97f9140 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94299387600544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9803270 con 0x55c3c97f9140 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9803ac0 con 0x55c3c97f49b0 2024-09-10T06:22:50.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94299387600544] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94299387604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9803ac0 con 0x55c3c97f49b0 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.749+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9804530 con 0x55c3c97fdc10 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94299387604416] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94299387606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9803a30 con 0x55c3c97fdc10 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9805300 con 0x55c3c97f9140 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94299387612624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9805ba0 con 0x55c3c97f9140 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98065a0 con 0x55c3c97f49b0 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94299387606544] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.753+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94299387612624] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94299387611424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98056f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9806e40 con 0x7f4ae810a040 2024-09-10T06:22:50.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94299387611424] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94299387617456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98056f0 con 0x7f4ae810a040 2024-09-10T06:22:50.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.757+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98072e0 con 0x7f4ae810a040 2024-09-10T06:22:50.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94299387620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9807720 con 0x7f4ae810a040 2024-09-10T06:22:50.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c9808230 con 0x7f4ae810a040 2024-09-10T06:22:50.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94299387617456] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94299387620848] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94299387621904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98067d0 con 0x7f4ae810a040 2024-09-10T06:22:50.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=0 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=1 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=2 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=3 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=4 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=5 2024-09-10T06:22:50.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.761+0000 7f4af0b239c0 20 add_watcher() i=6 2024-09-10T06:22:50.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94299387621904] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 add_watcher() i=7 2024-09-10T06:22:50.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:50.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c980b220 con 0x55c3c97f49b0 2024-09-10T06:22:50.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94299387624672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c98086a0 con 0x55c3c97f49b0 2024-09-10T06:22:50.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94299387624672] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f49a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 5 note: GC not initialized 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f491f7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 Filter name: none 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f491d7fa640 20 reqs_thread_entry: start 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982e2f0 con 0x55c3c97f49b0 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.769 INFO:teuthology.orchestra.run.smithi117.stderr:could not fetch user info: no user info saved 2024-09-10T06:22:50.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f49a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.765+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94299387624672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982e2b0 con 0x55c3c97f49b0 2024-09-10T06:22:50.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94299387624672] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94299387600544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982e2b0 con 0x55c3c97f9140 2024-09-10T06:22:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94299387600544] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 20 remove_watcher() i=0 2024-09-10T06:22:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 2 removed watcher, disabling cache 2024-09-10T06:22:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94299387604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982e2b0 con 0x55c3c97f49b0 2024-09-10T06:22:50.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94299387604416] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 20 remove_watcher() i=1 2024-09-10T06:22:50.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.769+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94299387606544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982e2b0 con 0x55c3c97fdc10 2024-09-10T06:22:50.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4aede28640 1 -- 172.21.15.117:0/132811383 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94299387606544] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae400f070 con 0x55c3c97fdc10 2024-09-10T06:22:50.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4af0b239c0 20 remove_watcher() i=2 2024-09-10T06:22:50.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94299387612624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982c0b0 con 0x55c3c97f9140 2024-09-10T06:22:50.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4aee629640 1 -- 172.21.15.117:0/132811383 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94299387612624] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae80b3040 con 0x55c3c97f9140 2024-09-10T06:22:50.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4af0b239c0 20 remove_watcher() i=3 2024-09-10T06:22:50.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.773+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94299387611424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982c0b0 con 0x55c3c97f49b0 2024-09-10T06:22:50.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94299387611424] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x55c3c97f49b0 2024-09-10T06:22:50.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4af0b239c0 20 remove_watcher() i=4 2024-09-10T06:22:50.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94299387617456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982c0b0 con 0x7f4ae810a040 2024-09-10T06:22:50.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94299387617456] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4af0b239c0 20 remove_watcher() i=5 2024-09-10T06:22:50.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.777+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94299387620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982c0b0 con 0x7f4ae810a040 2024-09-10T06:22:50.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94299387620848] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 20 remove_watcher() i=6 2024-09-10T06:22:50.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94299387621904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c3c982c0b0 con 0x7f4ae810a040 2024-09-10T06:22:50.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94299387621904] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae0026040 con 0x7f4ae810a040 2024-09-10T06:22:50.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 20 remove_watcher() i=7 2024-09-10T06:22:50.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4ae810a040 msgr2=0x7f4ae8009420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4ae810a040 0x7f4ae8009420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97f49b0 msgr2=0x55c3c97f6e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97f49b0 0x55c3c97f6e40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97f9140 msgr2=0x55c3c97fb530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97f9140 0x55c3c97fb530 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97fdc10 msgr2=0x55c3c98000d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.781+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97fdc10 0x55c3c98000d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49b8039a70 msgr2=0x7f49b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49b8039a70 0x7f49b803bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55c3c97b94d0 tx=0x7f4ae4010000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4aeee2a640 1 -- 172.21.15.117:0/132811383 reap_dead start 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 msgr2=0x55c3c97e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80e87b0 tx=0x7f4ae80b4570 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 shutdown_connections 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/132811383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97e36e0 0x55c3c97e9990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 >> 172.21.15.117:0/132811383 conn(0x55c3c97deb00 msgr2=0x55c3c97dcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 shutdown_connections 2024-09-10T06:22:50.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/132811383 wait complete. 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 msgr2=0x7f49c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 0x7f49c803bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40062e0 tx=0x7f4ae400f000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 msgr2=0x55c3c97d65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8000bf0 tx=0x7f4ae80e85e0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 shutdown_connections 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49c8039a70 0x7f49c803bf30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/3708478761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c97d61c0 0x55c3c97d65e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 >> 172.21.15.117:0/3708478761 conn(0x55c3c97cbb70 msgr2=0x55c3c97cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 shutdown_connections 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/3708478761 wait complete. 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97bd170 msgr2=0x55c3c97bf560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c3c97bd170 0x55c3c97bf560 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97c1c50 msgr2=0x55c3c97c4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c3c97c1c50 0x55c3c97c4040 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97c5b90 msgr2=0x55c3c97c7f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c3c97c5b90 0x55c3c97c7f80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49d4039ac0 msgr2=0x7f49d403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f49d4039ac0 0x7f49d403bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4001650 tx=0x7f4ae4006720 comp rx=0 tx=0).stop 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 msgr2=0x55c3c97b8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 --2- 172.21.15.117:0/302186244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3c9638370 0x55c3c97b8060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ae801bb20 tx=0x7f4ae8018020 comp rx=0 tx=0).stop 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4aeee2a640 1 -- 172.21.15.117:0/302186244 reap_dead start 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 shutdown_connections 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 >> 172.21.15.117:0/302186244 conn(0x55c3c96bdee0 msgr2=0x55c3c97ab240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 shutdown_connections 2024-09-10T06:22:50.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.785+0000 7f4af0b239c0 1 -- 172.21.15.117:0/302186244 wait complete. 2024-09-10T06:22:50.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T06:22:50.796 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T06:22:50.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T06:22:50.796 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-10T06:22:50.886 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:50.886 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:50.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e754a9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fef410e850 0x55fef4110c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e754a9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fef3fbe9c0 con 0x55fef407e700 2024-09-10T06:22:50.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e754a9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55fef400e6d0 con 0x55fef410e850 2024-09-10T06:22:50.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e484f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fef410e850 0x55fef4110c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e484f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fef410e850 0x55fef4110c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41734/0 (socket says 172.21.15.117:41734) 2024-09-10T06:22:50.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e484f640 1 -- 172.21.15.117:0/1430015905 learned_addr learned my addr 172.21.15.117:0/1430015905 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e484f640 1 -- 172.21.15.117:0/1430015905 >> v1:172.21.15.84:6789/0 conn(0x55fef407e700 legacy=0x55fef410d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.885+0000 7fd2e484f640 1 -- 172.21.15.117:0/1430015905 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef3fb2ca0 con 0x55fef410e850 2024-09-10T06:22:50.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e484f640 1 --2- 172.21.15.117:0/1430015905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef410e850 0x55fef4110c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a5c0 tx=0x7fd2dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9e134fc99601bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2d7fff640 1 -- 172.21.15.117:0/1430015905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc0b1070 con 0x55fef410e850 2024-09-10T06:22:50.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2d7fff640 1 -- 172.21.15.117:0/1430015905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0a8070 con 0x55fef410e850 2024-09-10T06:22:50.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2d7fff640 1 -- 172.21.15.117:0/1430015905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc0ac5b0 con 0x55fef410e850 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1430015905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef410e850 msgr2=0x55fef4110c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1430015905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef410e850 0x55fef4110c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a5c0 tx=0x7fd2dc01b340 comp rx=0 tx=0).stop 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1430015905 shutdown_connections 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1430015905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef410e850 0x55fef4110c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1430015905 >> 172.21.15.117:0/1430015905 conn(0x55fef4104e20 msgr2=0x55fef4107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1430015905 shutdown_connections 2024-09-10T06:22:50.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.889+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1430015905 wait complete. 2024-09-10T06:22:50.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.901+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.901+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.901+0000 7fd2e754a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.901+0000 7fd2e754a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fef4012680 con 0x55fef407e700 2024-09-10T06:22:50.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41742/0 (socket says 172.21.15.117:41742) 2024-09-10T06:22:50.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 -- 172.21.15.117:0/135447206 learned_addr learned my addr 172.21.15.117:0/135447206 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 -- 172.21.15.117:0/135447206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef3f8dda0 con 0x55fef407e700 2024-09-10T06:22:50.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- 172.21.15.117:0/135447206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b220 tx=0x7fd2d800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc88b1da3289ab5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd1d3606640 1 -- 172.21.15.117:0/135447206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d800a040 con 0x55fef407e700 2024-09-10T06:22:50.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd1d3606640 1 -- 172.21.15.117:0/135447206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d800f750 con 0x55fef407e700 2024-09-10T06:22:50.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd1d3606640 1 -- 172.21.15.117:0/135447206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d800fa70 con 0x55fef407e700 2024-09-10T06:22:50.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/135447206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 msgr2=0x55fef410a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/135447206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b220 tx=0x7fd2d800b6e0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/135447206 shutdown_connections 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/135447206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef410a630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/135447206 >> 172.21.15.117:0/135447206 conn(0x55fef4104e20 msgr2=0x55fef41f15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/135447206 shutdown_connections 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/135447206 wait complete. 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef41ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e754a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fef3fb4a50 con 0x55fef407e700 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef41ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef41ff1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41758/0 (socket says 172.21.15.117:41758) 2024-09-10T06:22:50.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 -- 172.21.15.117:0/1996298953 learned_addr learned my addr 172.21.15.117:0/1996298953 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef41ff730 con 0x55fef407e700 2024-09-10T06:22:50.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.905+0000 7fd2e5050640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef41ff1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55fef410a1f0 tx=0x7fd2d8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 -- 172.21.15.117:0/1996298953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d801a880 con 0x55fef407e700 2024-09-10T06:22:50.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef41ff9c0 con 0x55fef407e700 2024-09-10T06:22:50.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 -- 172.21.15.117:0/1996298953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d801aa20 con 0x55fef407e700 2024-09-10T06:22:50.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef4200370 con 0x55fef407e700 2024-09-10T06:22:50.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 -- 172.21.15.117:0/1996298953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d802c060 con 0x55fef407e700 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 -- 172.21.15.117:0/1996298953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd2d8017050 con 0x55fef407e700 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1cc039a70 0x7fd1cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd1d1e03640 1 -- 172.21.15.117:0/1996298953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd2d8015020 con 0x55fef407e700 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e484f640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1cc039a70 0x7fd1cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef410e850 0x55fef4206340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4206880 con 0x55fef410e850 2024-09-10T06:22:50.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5851640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef410e850 0x55fef4206340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e484f640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1cc039a70 0x7fd1cc03bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0ae000 tx=0x7fd2dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5851640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef410e850 0x55fef4206340 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5851640 1 -- 172.21.15.117:0/1996298953 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef410e850 2024-09-10T06:22:50.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42007d0 con 0x55fef410e850 2024-09-10T06:22:50.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5851640 1 -- 172.21.15.117:0/1996298953 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef410e850 2024-09-10T06:22:50.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4208b20 0x55fef420af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef420b600 con 0x55fef4208b20 2024-09-10T06:22:50.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5050640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4208b20 0x55fef420af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5050640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4208b20 0x55fef420af10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.909+0000 7fd2e5050640 1 -- 172.21.15.117:0/1996298953 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2d802e070 con 0x55fef4208b20 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42079c0 con 0x55fef410e850 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5851640 1 -- 172.21.15.117:0/1996298953 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef410e850 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef420ca60 0x55fef420ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef420f590 con 0x55fef420ca60 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e484f640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef420ca60 0x55fef420ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e484f640 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef420ca60 0x55fef420ee50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e484f640 1 -- 172.21.15.117:0/1996298953 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2dc0b4040 con 0x55fef420ca60 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fef401f450 con 0x55fef421d010 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41770/0 (socket says 172.21.15.117:41770) 2024-09-10T06:22:50.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5050640 1 -- 172.21.15.117:0/97797609 learned_addr learned my addr 172.21.15.117:0/97797609 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5050640 1 -- 172.21.15.117:0/97797609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef421da70 con 0x55fef421d010 2024-09-10T06:22:50.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e5050640 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd2d804ecf0 tx=0x7fd2d8050480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd1caffd640 1 -- 172.21.15.117:0/97797609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d8046070 con 0x55fef421d010 2024-09-10T06:22:50.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef421e2d0 con 0x55fef421d010 2024-09-10T06:22:50.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd1caffd640 1 -- 172.21.15.117:0/97797609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d802f350 con 0x55fef421d010 2024-09-10T06:22:50.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd1caffd640 1 -- 172.21.15.117:0/97797609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d802f630 con 0x55fef421d010 2024-09-10T06:22:50.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.913+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef421e840 con 0x55fef421d010 2024-09-10T06:22:50.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1caffd640 1 -- 172.21.15.117:0/97797609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd2d8049070 con 0x55fef421d010 2024-09-10T06:22:50.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1caffd640 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 0x7fd1bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1caffd640 1 -- 172.21.15.117:0/97797609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd2d803b040 con 0x55fef421d010 2024-09-10T06:22:50.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e484f640 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 0x7fd1bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e484f640 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 0x7fd1bc03bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55fef4206cc0 tx=0x7fd2dc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fef410ae80 con 0x55fef4229750 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41786/0 (socket says 172.21.15.117:41786) 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e5050640 1 -- 172.21.15.117:0/2368123770 learned_addr learned my addr 172.21.15.117:0/2368123770 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e5050640 1 -- 172.21.15.117:0/2368123770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef422a120 con 0x55fef4229750 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e5050640 1 --2- 172.21.15.117:0/2368123770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8008fd0 tx=0x7fd2d802f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce1f94abbe4326e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1c8ff9640 1 -- 172.21.15.117:0/2368123770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d8062070 con 0x55fef4229750 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1c8ff9640 1 -- 172.21.15.117:0/2368123770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80508c0 con 0x55fef4229750 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd1c8ff9640 1 -- 172.21.15.117:0/2368123770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d801c740 con 0x55fef4229750 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/2368123770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 msgr2=0x55fef4229b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/2368123770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8008fd0 tx=0x7fd2d802f940 comp rx=0 tx=0).stop 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/2368123770 shutdown_connections 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/2368123770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4229b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/2368123770 >> 172.21.15.117:0/2368123770 conn(0x55fef4225b80 msgr2=0x55fef4223dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/2368123770 shutdown_connections 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/2368123770 wait complete. 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 Processor -- start 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- start start 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.917+0000 7fd2e754a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fef422a5e0 con 0x55fef4229750 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5050640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41798/0 (socket says 172.21.15.117:41798) 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 learned_addr learned my addr 172.21.15.117:0/3591695481 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:50.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef4231050 con 0x55fef4229750 2024-09-10T06:22:50.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5050640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d802f980 tx=0x7fd2d8023fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 -- 172.21.15.117:0/3591695481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d8062030 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef4231050 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 -- 172.21.15.117:0/3591695481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d806f070 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 -- 172.21.15.117:0/3591695481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2d801c520 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef4231620 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 -- 172.21.15.117:0/3591695481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd2d803e040 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1b0039a20 0x7fd1b003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd1baffd640 1 -- 172.21.15.117:0/3591695481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd2d804ee00 con 0x55fef4229750 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e484f640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1b0039a20 0x7fd1b003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef423bcc0 0x55fef423e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef423e8a0 con 0x55fef423bcc0 2024-09-10T06:22:50.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5851640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef423bcc0 0x55fef423e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e484f640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1b0039a20 0x7fd1b003bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c10 tx=0x7fd2dc0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5851640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef423bcc0 0x55fef423e150 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.921+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 realm 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef423ecb0 con 0x55fef423bcc0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f580 con 0x55fef423bcc0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4240680 0x55fef4242a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42430c0 con 0x55fef4240680 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4240680 0x55fef4242a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4240680 0x55fef4242a70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 20 searching for the correct realm 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef4244fa0 0x55fef42473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef4247a50 con 0x55fef4244fa0 2024-09-10T06:22:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e484f640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef4244fa0 0x55fef42473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e484f640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef4244fa0 0x55fef42473d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef4247a50 con 0x55fef4240680 2024-09-10T06:22:50.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd2d804b060 0x7fd2d80748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:50.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd2d807f040 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5851640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd2d804b060 0x7fd2d80748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.925+0000 7fd2e5851640 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd2d804b060 0x7fd2d80748c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4240680 2024-09-10T06:22:50.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.929+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4240680 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4240680 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.933+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4240680 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4244fa0 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x7fd2d804b060 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef423bcc0 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fef423f920 con 0x55fef4240680 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:50.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4243a40 con 0x55fef423bcc0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42442e0 con 0x55fef423bcc0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.937+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4243680 con 0x55fef4244fa0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:50.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 zone default found 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 4 Realm: () 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 zonegroup default 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4247f40 con 0x7fd2d804b060 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249d70 con 0x55fef4244fa0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef424a200 con 0x55fef4244fa0 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 started sync module instance, tier type = 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249210 con 0x55fef4240680 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553506092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4248e70 con 0x55fef4240680 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424b030 con 0x55fef423bcc0 2024-09-10T06:22:50.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.941+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553506092544] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553506096784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424af60 con 0x55fef423bcc0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424ba70 con 0x55fef4244fa0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553506096784] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553506097840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424aed0 con 0x55fef4244fa0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.945+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424c840 con 0x55fef4240680 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553506104080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424d0e0 con 0x55fef4240680 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424dae0 con 0x55fef423bcc0 2024-09-10T06:22:50.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553506097840] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553506104080] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553506102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424cc30 con 0x55fef423bcc0 2024-09-10T06:22:50.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.949+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424e380 con 0x7fd2d804b060 2024-09-10T06:22:50.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553506102880] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553506108912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424cc30 con 0x7fd2d804b060 2024-09-10T06:22:50.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424e830 con 0x7fd2d804b060 2024-09-10T06:22:50.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553506108912] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553506110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424e7f0 con 0x7fd2d804b060 2024-09-10T06:22:50.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.953+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424f210 con 0x7fd2d804b060 2024-09-10T06:22:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553506114816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424f680 con 0x7fd2d804b060 2024-09-10T06:22:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=0 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=1 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=2 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=3 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=4 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=5 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553506110752] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=6 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553506114816] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 20 add_watcher() i=7 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef424e340 con 0x55fef423bcc0 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.957+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553506116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424e340 con 0x55fef423bcc0 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553506116048] v30'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd19b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 5 note: GC not initialized 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd19a7e4640 20 reqs_thread_entry: start 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 Filter name: none 2024-09-10T06:22:50.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd10bfff640 20 reqs_thread_entry: start 2024-09-10T06:22:50.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:50.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4275d40 con 0x55fef423bcc0 2024-09-10T06:22:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42743e0 con 0x55fef423bcc0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef42747d0 con 0x7fd2d804b060 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.961+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef42792e0 con 0x55fef423bcc0 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94553506270288 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef4279d00 con 0x55fef423bcc0 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== watch-notify(notify (1) cookie 94553506102880 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55fef4279680 con 0x55fef423bcc0 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94553506102880 notifier 4290 bl.length()=567 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:50.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(66 notify.4 [notify cookie 94553506270288 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1c8ff9640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd1a8003eb0 con 0x55fef423bcc0 2024-09-10T06:22:50.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== watch-notify(notify_complete (2) cookie 94553506270288 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fef42749a0 con 0x55fef423bcc0 2024-09-10T06:22:50.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4279d00 con 0x55fef423bcc0 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94553506270288 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef427a0f0 con 0x55fef4240680 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== watch-notify(notify (1) cookie 94553506104080 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55fef421e2d0 con 0x55fef4240680 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94553506104080 notifier 4290 bl.length()=169 2024-09-10T06:22:50.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd1bbfff640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd118003410 con 0x55fef4240680 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.965+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(69 notify.3 [notify cookie 94553506270288 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== watch-notify(notify_complete (2) cookie 94553506270288 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fef421da70 con 0x55fef4240680 2024-09-10T06:22:50.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4274c50 con 0x7fd2d804b060 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e754a9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e754a9c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e754a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94553506270288 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fef427a0f0 con 0x55fef4240680 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== watch-notify(notify (1) cookie 94553506104080 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55fef421da70 con 0x55fef4240680 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd1c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94553506104080 notifier 4290 bl.length()=177 2024-09-10T06:22:50.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd1c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd1c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd1c8ff9640 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd1a8003eb0 con 0x55fef4240680 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(72 notify.3 [notify cookie 94553506270288 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.969+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== watch-notify(notify_complete (2) cookie 94553506270288 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fef4200370 con 0x55fef4240680 2024-09-10T06:22:50.974 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:50.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd19b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:50.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553506116048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef42739e0 con 0x55fef423bcc0 2024-09-10T06:22:50.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94553506116048] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553506092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef42739e0 con 0x55fef4240680 2024-09-10T06:22:50.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94553506092544] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e754a9c0 20 remove_watcher() i=0 2024-09-10T06:22:50.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e754a9c0 2 removed watcher, disabling cache 2024-09-10T06:22:50.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.973+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553506096784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249600 con 0x55fef423bcc0 2024-09-10T06:22:50.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94553506096784] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e754a9c0 20 remove_watcher() i=1 2024-09-10T06:22:50.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553506097840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef42739e0 con 0x55fef4244fa0 2024-09-10T06:22:50.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e484f640 1 -- 172.21.15.117:0/3591695481 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94553506097840] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc0d9070 con 0x55fef4244fa0 2024-09-10T06:22:50.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e754a9c0 20 remove_watcher() i=2 2024-09-10T06:22:50.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.977+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553506104080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249600 con 0x55fef4240680 2024-09-10T06:22:50.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e5050640 1 -- 172.21.15.117:0/3591695481 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94553506104080] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d8048030 con 0x55fef4240680 2024-09-10T06:22:50.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e754a9c0 20 remove_watcher() i=3 2024-09-10T06:22:50.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553506102880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249600 con 0x55fef423bcc0 2024-09-10T06:22:50.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94553506102880] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x55fef423bcc0 2024-09-10T06:22:50.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e754a9c0 20 remove_watcher() i=4 2024-09-10T06:22:50.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.981+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553506108912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249600 con 0x7fd2d804b060 2024-09-10T06:22:50.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94553506108912] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e754a9c0 20 remove_watcher() i=5 2024-09-10T06:22:50.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553506110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef424d5f0 con 0x7fd2d804b060 2024-09-10T06:22:50.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94553506110752] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e754a9c0 20 remove_watcher() i=6 2024-09-10T06:22:50.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.985+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553506114816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fef4249600 con 0x7fd2d804b060 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94553506114816] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e000a4d0 con 0x7fd2d804b060 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 20 remove_watcher() i=7 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd2d804b060 msgr2=0x7fd2d80748c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd2d804b060 0x7fd2d80748c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef423bcc0 msgr2=0x55fef423e150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef423bcc0 0x55fef423e150 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4240680 msgr2=0x55fef4242a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4240680 0x55fef4242a70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef4244fa0 msgr2=0x55fef42473d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef4244fa0 0x55fef42473d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1b0039a20 msgr2=0x7fd1b003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1b0039a20 0x7fd1b003bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c10 tx=0x7fd2dc0a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 msgr2=0x55fef4230af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e5851640 1 -- 172.21.15.117:0/3591695481 reap_dead start 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2d802f980 tx=0x7fd2d8023fa0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 shutdown_connections 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/3591695481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef4229750 0x55fef4230af0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 >> 172.21.15.117:0/3591695481 conn(0x55fef4225b80 msgr2=0x55fef4223d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 shutdown_connections 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/3591695481 wait complete. 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 msgr2=0x7fd1bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 0x7fd1bc03bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55fef4206cc0 tx=0x7fd2dc005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 msgr2=0x55fef421d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd2d804ecf0 tx=0x7fd2d8050480 comp rx=0 tx=0).stop 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 shutdown_connections 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1bc039a70 0x7fd1bc03bf30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/97797609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef421d010 0x55fef421d430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 >> 172.21.15.117:0/97797609 conn(0x55fef42129c0 msgr2=0x55fef4212da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 shutdown_connections 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/97797609 wait complete. 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef410e850 msgr2=0x55fef4206340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fef410e850 0x55fef4206340 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4208b20 msgr2=0x55fef420af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fef4208b20 0x55fef420af10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef420ca60 msgr2=0x55fef420ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fef420ca60 0x55fef420ee50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1cc039a70 msgr2=0x7fd1cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd1cc039a70 0x7fd1cc03bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0ae000 tx=0x7fd2dc0a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 msgr2=0x55fef41ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:50.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 --2- 172.21.15.117:0/1996298953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fef407e700 0x55fef41ff1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55fef410a1f0 tx=0x7fd2d8000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:50.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e5851640 1 -- 172.21.15.117:0/1996298953 reap_dead start 2024-09-10T06:22:50.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 shutdown_connections 2024-09-10T06:22:50.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 >> 172.21.15.117:0/1996298953 conn(0x55fef4104e20 msgr2=0x55fef4109350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:50.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 shutdown_connections 2024-09-10T06:22:50.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:50.989+0000 7fd2e754a9c0 1 -- 172.21.15.117:0/1996298953 wait complete. 2024-09-10T06:22:51.002 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:51.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T06:22:51.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T06:22:51.002 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-10T06:22:51.033 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.033 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e5de09c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x565013dc5700 0x565013dc5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e5de09c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565013c779c0 con 0x565013dc8840 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e5de09c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x565013cc76d0 con 0x565013dc5700 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x565013dc5700 0x565013dc5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x565013dc5700 0x565013dc5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41806/0 (socket says 172.21.15.117:41806) 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 -- 172.21.15.117:0/190302862 learned_addr learned my addr 172.21.15.117:0/190302862 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3db0e5640 1 --1- 172.21.15.117:0/190302862 >> v1:172.21.15.84:6789/0 conn(0x565013dc8840 0x565013dcac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44178/0 (socket says 172.21.15.117:44178) 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 -- 172.21.15.117:0/190302862 >> v1:172.21.15.84:6789/0 conn(0x565013dc8840 legacy=0x565013dcac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 -- 172.21.15.117:0/190302862 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013c6bca0 con 0x565013dc5700 2024-09-10T06:22:51.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.033+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/190302862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013dc5ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400a5c0 tx=0x7fb3d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e18a615501d633d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e30e5640 1 -- 172.21.15.117:0/190302862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40a6070 con 0x565013dc5700 2024-09-10T06:22:51.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e30e5640 1 -- 172.21.15.117:0/190302862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40af070 con 0x565013dc5700 2024-09-10T06:22:51.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e30e5640 1 -- 172.21.15.117:0/190302862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40aa5c0 con 0x565013dc5700 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/190302862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 msgr2=0x565013dc5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/190302862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013dc5ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400a5c0 tx=0x7fb3d401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/190302862 shutdown_connections 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/190302862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013dc5ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/190302862 >> 172.21.15.117:0/190302862 conn(0x565013d39010 msgr2=0x565013d39420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/190302862 shutdown_connections 2024-09-10T06:22:51.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.037+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/190302862 wait complete. 2024-09-10T06:22:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565013ccb680 con 0x565013dc5700 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41814/0 (socket says 172.21.15.117:41814) 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e38e6640 1 -- 172.21.15.117:0/1145205263 learned_addr learned my addr 172.21.15.117:0/1145205263 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e38e6640 1 -- 172.21.15.117:0/1145205263 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013c46da0 con 0x565013dc5700 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/1145205263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4018f70 tx=0x7fb3d4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cb7e1ada5ba15b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb2d1e0b640 1 -- 172.21.15.117:0/1145205263 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40aa8b0 con 0x565013dc5700 2024-09-10T06:22:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb2d1e0b640 1 -- 172.21.15.117:0/1145205263 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40aaa50 con 0x565013dc5700 2024-09-10T06:22:51.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb2d1e0b640 1 -- 172.21.15.117:0/1145205263 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40aad30 con 0x565013dc5700 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/1145205263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 msgr2=0x565013eb09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/1145205263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4018f70 tx=0x7fb3d4003030 comp rx=0 tx=0).stop 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/1145205263 shutdown_connections 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/1145205263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb09f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/1145205263 >> 172.21.15.117:0/1145205263 conn(0x565013d39010 msgr2=0x565013eac690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/1145205263 shutdown_connections 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.049+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/1145205263 wait complete. 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565013c6da50 con 0x565013dc5700 2024-09-10T06:22:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41822/0 (socket says 172.21.15.117:41822) 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4236893859 learned_addr learned my addr 172.21.15.117:0/4236893859 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013eb8460 con 0x565013dc5700 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb7f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4018f70 tx=0x7fb3d40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 -- 172.21.15.117:0/4236893859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40c6690 con 0x565013dc5700 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565013eb86f0 con 0x565013dc5700 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565013eb90a0 con 0x565013dc5700 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 -- 172.21.15.117:0/4236893859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40c6830 con 0x565013dc5700 2024-09-10T06:22:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 -- 172.21.15.117:0/4236893859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40c6b10 con 0x565013dc5700 2024-09-10T06:22:51.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 -- 172.21.15.117:0/4236893859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb3d40ce030 con 0x565013dc5700 2024-09-10T06:22:51.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb2cbfff640 1 -- 172.21.15.117:0/4236893859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb3d40cc020 con 0x565013dc5700 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013dc8840 0x565013ebf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ebf5b0 con 0x565013dc8840 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013dc8840 0x565013ebf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.053+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc001e40 tx=0x7fb3cc0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013dc8840 0x565013ebf070 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4236893859 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013dc8840 2024-09-10T06:22:51.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ebfe50 con 0x565013dc8840 2024-09-10T06:22:51.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4236893859 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013dc8840 2024-09-10T06:22:51.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ec17a0 0x565013ec3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ec43c0 con 0x565013ec17a0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ec17a0 0x565013ec3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ec17a0 0x565013ec3c30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4236893859 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3d40cf5a0 con 0x565013ec17a0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ec06a0 con 0x565013dc8840 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4236893859 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013dc8840 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013ec5820 0x565013ec7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ec8350 con 0x565013ec5820 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013ec5820 0x565013ec7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013ec5820 0x565013ec7c10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4236893859 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb3cc00bd60 con 0x565013ec5820 2024-09-10T06:22:51.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e5de09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565013cd8450 con 0x565013ed5e30 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41828/0 (socket says 172.21.15.117:41828) 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 -- 172.21.15.117:0/2890872753 learned_addr learned my addr 172.21.15.117:0/2890872753 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.057+0000 7fb3e38e6640 1 -- 172.21.15.117:0/2890872753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013ed6890 con 0x565013ed5e30 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4003070 tx=0x7fb3d40d0640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 -- 172.21.15.117:0/2890872753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40c58e0 con 0x565013ed5e30 2024-09-10T06:22:51.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565013ed70f0 con 0x565013ed5e30 2024-09-10T06:22:51.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 -- 172.21.15.117:0/2890872753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40ebba0 con 0x565013ed5e30 2024-09-10T06:22:51.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565013ed7660 con 0x565013ed5e30 2024-09-10T06:22:51.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 -- 172.21.15.117:0/2890872753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40b3850 con 0x565013ed5e30 2024-09-10T06:22:51.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 -- 172.21.15.117:0/2890872753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb3d40b39f0 con 0x565013ed5e30 2024-09-10T06:22:51.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 0x7fb2bc03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c97fa640 1 -- 172.21.15.117:0/2890872753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb3d40d1060 con 0x565013ed5e30 2024-09-10T06:22:51.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 0x7fb2bc03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 0x7fb2bc03bee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x565013eb9590 tx=0x7fb3cc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e5de09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565013eb1160 con 0x565013ee3580 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41830/0 (socket says 172.21.15.117:41830) 2024-09-10T06:22:51.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 -- 172.21.15.117:0/905756589 learned_addr learned my addr 172.21.15.117:0/905756589 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 -- 172.21.15.117:0/905756589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013ee3f70 con 0x565013ee3580 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/905756589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40d08b0 tx=0x7fb3d40b3da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb1ed45f5db3376 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c2ffd640 1 -- 172.21.15.117:0/905756589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4102020 con 0x565013ee3580 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c2ffd640 1 -- 172.21.15.117:0/905756589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40a7b90 con 0x565013ee3580 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.061+0000 7fb2c2ffd640 1 -- 172.21.15.117:0/905756589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40ea3f0 con 0x565013ee3580 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/905756589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 msgr2=0x565013ee3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/905756589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40d08b0 tx=0x7fb3d40b3da0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/905756589 shutdown_connections 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/905756589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee3980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/905756589 >> 172.21.15.117:0/905756589 conn(0x565013ede9a0 msgr2=0x565013edcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/905756589 shutdown_connections 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/905756589 wait complete. 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 Processor -- start 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- start start 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565013ee2350 con 0x565013ee3580 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e38e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41842/0 (socket says 172.21.15.117:41842) 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 learned_addr learned my addr 172.21.15.117:0/4068395844 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565013ee9d90 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40e55b0 tx=0x7fb3d40c5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 -- 172.21.15.117:0/4068395844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d4116070 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565013ee9d90 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565013ee9d90 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 -- 172.21.15.117:0/4068395844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40b4c30 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 -- 172.21.15.117:0/4068395844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d40ea900 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 -- 172.21.15.117:0/4068395844 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb3d4119070 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2ac039a70 0x7fb2ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.065+0000 7fb2c17fa640 1 -- 172.21.15.117:0/4068395844 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb3d410e050 con 0x565013ee3580 2024-09-10T06:22:51.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2ac039a70 0x7fb2ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013ef4940 0x565013ef6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ef7520 con 0x565013ef4940 2024-09-10T06:22:51.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013ef4940 0x565013ef6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2ac039a70 0x7fb2ac03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00ffd0 tx=0x7fb3cc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013ef4940 0x565013ef6dd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 realm 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ef7930 con 0x565013ef4940 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ef8200 con 0x565013ef4940 2024-09-10T06:22:51.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ef9300 0x565013efb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013efbd40 con 0x565013ef9300 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ef9300 0x565013efb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ef9300 0x565013efb6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 20 searching for the correct realm 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013efdc20 0x565013f00050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013f006d0 con 0x565013efdc20 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013efdc20 0x565013f00050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013efdc20 0x565013f00050 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013f006d0 con 0x565013ef9300 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb3d411b060 0x7fb3d40c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013f006d0 con 0x7fb3d411b060 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.069+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb3d411b060 0x7fb3d40c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb3d411b060 0x7fb3d40c19d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef9300 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.073+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef9300 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.077+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef9300 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef9300 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013efdc20 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x7fb3d411b060 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef4940 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565013ef85a0 con 0x565013ef9300 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:51.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013efc590 con 0x565013ef4940 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.081+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013efc980 con 0x565013ef4940 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013efc980 con 0x565013efdc20 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 zone default found 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 4 Realm: () 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 zonegroup default 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f00b50 con 0x7fb3d411b060 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f02640 con 0x565013efdc20 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f02af0 con 0x565013efdc20 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 started sync module instance, tier type = 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f019e0 con 0x565013ef9300 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94901931875792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f01640 con 0x565013ef9300 2024-09-10T06:22:51.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f03a20 con 0x565013ef4940 2024-09-10T06:22:51.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.085+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94901931875792] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.089+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.089+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901931881840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f03e40 con 0x565013ef4940 2024-09-10T06:22:51.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.089+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f04710 con 0x565013efdc20 2024-09-10T06:22:51.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.089+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94901931881840] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94901931883168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f04b00 con 0x565013efdc20 2024-09-10T06:22:51.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f054c0 con 0x565013ef9300 2024-09-10T06:22:51.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94901931890864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f06180 con 0x565013ef9300 2024-09-10T06:22:51.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f06b40 con 0x565013ef4940 2024-09-10T06:22:51.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94901931883168] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94901931890864] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94901931884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f05de0 con 0x565013ef4940 2024-09-10T06:22:51.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.093+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f07240 con 0x7fb3d411b060 2024-09-10T06:22:51.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.097+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94901931884352] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94901931896080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f07200 con 0x7fb3d411b060 2024-09-10T06:22:51.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f07c50 con 0x7fb3d411b060 2024-09-10T06:22:51.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94901931898784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f08070 con 0x7fb3d411b060 2024-09-10T06:22:51.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.101+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f08ab0 con 0x7fb3d411b060 2024-09-10T06:22:51.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94901931896080] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94901931898784] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94901931902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f07bc0 con 0x7fb3d411b060 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=0 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=1 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=2 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=3 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=4 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=5 2024-09-10T06:22:51.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.105+0000 7fb3e5de09c0 20 add_watcher() i=6 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94901931902336] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 20 add_watcher() i=7 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f0bbb0 con 0x565013ef4940 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94901931894416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f09030 con 0x565013ef4940 2024-09-10T06:22:51.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94901931894416] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 5 note: GC not initialized 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb298fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.113+0000 7fb3e5de09c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 Filter name: none 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb2127fc640 20 reqs_thread_entry: start 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f2efa0 con 0x7fb3d411b060 2024-09-10T06:22:51.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f2d640 con 0x565013ef4940 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565013f2da30 con 0x565013ef4940 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 20 get_user_info_from_index found 0 xattrs 2024-09-10T06:22:51.121 INFO:teuthology.orchestra.run.smithi117.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94901931894416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f09030 con 0x565013ef4940 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94901931894416] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.117+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94901931875792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f2cd20 con 0x565013ef9300 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94901931875792] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e5de09c0 20 remove_watcher() i=0 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e5de09c0 2 removed watcher, disabling cache 2024-09-10T06:22:51.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94901931881840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f2cd20 con 0x565013ef4940 2024-09-10T06:22:51.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94901931881840] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e5de09c0 20 remove_watcher() i=1 2024-09-10T06:22:51.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.121+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94901931883168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f2cd20 con 0x565013efdc20 2024-09-10T06:22:51.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3db0e5640 1 -- 172.21.15.117:0/4068395844 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94901931883168] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3cc037040 con 0x565013efdc20 2024-09-10T06:22:51.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 20 remove_watcher() i=2 2024-09-10T06:22:51.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94901931890864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f01dd0 con 0x565013ef9300 2024-09-10T06:22:51.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e38e6640 1 -- 172.21.15.117:0/4068395844 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94901931890864] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3d4118030 con 0x565013ef9300 2024-09-10T06:22:51.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 20 remove_watcher() i=3 2024-09-10T06:22:51.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94901931884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f03570 con 0x565013ef4940 2024-09-10T06:22:51.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94901931884352] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x565013ef4940 2024-09-10T06:22:51.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 20 remove_watcher() i=4 2024-09-10T06:22:51.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.125+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94901931896080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f01dd0 con 0x7fb3d411b060 2024-09-10T06:22:51.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94901931896080] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e5de09c0 20 remove_watcher() i=5 2024-09-10T06:22:51.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94901931898784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f03570 con 0x7fb3d411b060 2024-09-10T06:22:51.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94901931898784] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e5de09c0 20 remove_watcher() i=6 2024-09-10T06:22:51.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.129+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94901931902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565013f01dd0 con 0x7fb3d411b060 2024-09-10T06:22:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94901931902336] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3dc00a4d0 con 0x7fb3d411b060 2024-09-10T06:22:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 20 remove_watcher() i=7 2024-09-10T06:22:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb3d411b060 msgr2=0x7fb3d40c19d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb3d411b060 0x7fb3d40c19d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013ef4940 msgr2=0x565013ef6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013ef4940 0x565013ef6dd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ef9300 msgr2=0x565013efb6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ef9300 0x565013efb6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013efdc20 msgr2=0x565013f00050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013efdc20 0x565013f00050 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2ac039a70 msgr2=0x7fb2ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2ac039a70 0x7fb2ac03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00ffd0 tx=0x7fb3cc010000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4068395844 reap_dead start 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 msgr2=0x565013ee9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40e55b0 tx=0x7fb3d40c5a80 comp rx=0 tx=0).stop 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 shutdown_connections 2024-09-10T06:22:51.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4068395844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ee3580 0x565013ee9830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 >> 172.21.15.117:0/4068395844 conn(0x565013ede9a0 msgr2=0x565013edcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 shutdown_connections 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4068395844 wait complete. 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 msgr2=0x7fb2bc03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 0x7fb2bc03bee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x565013eb9590 tx=0x7fb3cc00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 msgr2=0x565013ed6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4003070 tx=0x7fb3d40d0640 comp rx=0 tx=0).stop 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 shutdown_connections 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2bc039a20 0x7fb2bc03bee0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/2890872753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013ed5e30 0x565013ed6250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 >> 172.21.15.117:0/2890872753 conn(0x565013ecb7e0 msgr2=0x565013ecbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 shutdown_connections 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/2890872753 wait complete. 2024-09-10T06:22:51.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013dc8840 msgr2=0x565013ebf070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x565013dc8840 0x565013ebf070 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ec17a0 msgr2=0x565013ec3c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x565013ec17a0 0x565013ec3c30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013ec5820 msgr2=0x565013ec7c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x565013ec5820 0x565013ec7c10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2cc039ac0 msgr2=0x7fb2cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc001e40 tx=0x7fb3cc0013a0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 msgr2=0x565013eb7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 --2- 172.21.15.117:0/4236893859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565013dc5700 0x565013eb7f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4018f70 tx=0x7fb3d40180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e40e7640 1 -- 172.21.15.117:0/4236893859 reap_dead start 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 shutdown_connections 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 >> 172.21.15.117:0/4236893859 conn(0x565013d39010 msgr2=0x565013eab120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 shutdown_connections 2024-09-10T06:22:51.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.133+0000 7fb3e5de09c0 1 -- 172.21.15.117:0/4236893859 wait complete. 2024-09-10T06:22:51.145 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-10T06:22:51.145 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.146 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:51.223 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.223 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f0646ea69c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563d7b6dd520 0x563d7b6dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f0646ea69c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d7b5919c0 con 0x563d7b6e06b0 2024-09-10T06:22:51.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f0646ea69c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x563d7b5e16d0 con 0x563d7b6dd520 2024-09-10T06:22:51.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f06449ac640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563d7b6dd520 0x563d7b6dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f06449ac640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563d7b6dd520 0x563d7b6dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41854/0 (socket says 172.21.15.117:41854) 2024-09-10T06:22:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f06449ac640 1 -- 172.21.15.117:0/286161926 learned_addr learned my addr 172.21.15.117:0/286161926 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.221+0000 7f06441ab640 1 --1- 172.21.15.117:0/286161926 >> v1:172.21.15.84:6789/0 conn(0x563d7b6e06b0 0x563d7b6e2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44182/0 (socket says 172.21.15.117:44182) 2024-09-10T06:22:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06449ac640 1 -- 172.21.15.117:0/286161926 >> v1:172.21.15.84:6789/0 conn(0x563d7b6e06b0 legacy=0x563d7b6e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06449ac640 1 -- 172.21.15.117:0/286161926 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b585ca0 con 0x563d7b6dd520 2024-09-10T06:22:51.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06449ac640 1 --2- 172.21.15.117:0/286161926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b6dd900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f063000a5c0 tx=0x7f063001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9d278dfaab7913 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06439aa640 1 -- 172.21.15.117:0/286161926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300a6070 con 0x563d7b6dd520 2024-09-10T06:22:51.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06439aa640 1 -- 172.21.15.117:0/286161926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300af070 con 0x563d7b6dd520 2024-09-10T06:22:51.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f06439aa640 1 -- 172.21.15.117:0/286161926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300aa5c0 con 0x563d7b6dd520 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 -- 172.21.15.117:0/286161926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 msgr2=0x563d7b6dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/286161926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b6dd900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f063000a5c0 tx=0x7f063001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 -- 172.21.15.117:0/286161926 shutdown_connections 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/286161926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b6dd900 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 -- 172.21.15.117:0/286161926 >> 172.21.15.117:0/286161926 conn(0x563d7b6d9040 msgr2=0x563d7b6db460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 -- 172.21.15.117:0/286161926 shutdown_connections 2024-09-10T06:22:51.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.225+0000 7f0646ea69c0 1 -- 172.21.15.117:0/286161926 wait complete. 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d7b5e5680 con 0x563d7b6dd520 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41866/0 (socket says 172.21.15.117:41866) 2024-09-10T06:22:51.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 -- 172.21.15.117:0/1539116029 learned_addr learned my addr 172.21.15.117:0/1539116029 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 -- 172.21.15.117:0/1539116029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b560da0 con 0x563d7b6dd520 2024-09-10T06:22:51.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 --2- 172.21.15.117:0/1539116029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0630018f70 tx=0x7f0630003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de455edbbfa6395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0532614640 1 -- 172.21.15.117:0/1539116029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300aa8b0 con 0x563d7b6dd520 2024-09-10T06:22:51.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0532614640 1 -- 172.21.15.117:0/1539116029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300aaa50 con 0x563d7b6dd520 2024-09-10T06:22:51.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0532614640 1 -- 172.21.15.117:0/1539116029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300aad30 con 0x563d7b6dd520 2024-09-10T06:22:51.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- 172.21.15.117:0/1539116029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 msgr2=0x563d7b7c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/1539116029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0630018f70 tx=0x7f0630003030 comp rx=0 tx=0).stop 2024-09-10T06:22:51.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- 172.21.15.117:0/1539116029 shutdown_connections 2024-09-10T06:22:51.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/1539116029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7c8800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- 172.21.15.117:0/1539116029 >> 172.21.15.117:0/1539116029 conn(0x563d7b6d9040 msgr2=0x563d7b7c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- 172.21.15.117:0/1539116029 shutdown_connections 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- 172.21.15.117:0/1539116029 wait complete. 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f0646ea69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d7b587a50 con 0x563d7b6dd520 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41882/0 (socket says 172.21.15.117:41882) 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.241+0000 7f06449ac640 1 -- 172.21.15.117:0/3027115714 learned_addr learned my addr 172.21.15.117:0/3027115714 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06449ac640 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b7d0200 con 0x563d7b6dd520 2024-09-10T06:22:51.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06449ac640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7cfca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0630018f70 tx=0x7f06300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 -- 172.21.15.117:0/3027115714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300c6690 con 0x563d7b6dd520 2024-09-10T06:22:51.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d7b7d0490 con 0x563d7b6dd520 2024-09-10T06:22:51.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 -- 172.21.15.117:0/3027115714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300c6830 con 0x563d7b6dd520 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 -- 172.21.15.117:0/3027115714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300c6b10 con 0x563d7b6dd520 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7b7d0e40 con 0x563d7b6dd520 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 -- 172.21.15.117:0/3027115714 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06300ce030 con 0x563d7b6dd520 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f052c039a70 0x7f052c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0530e11640 1 -- 172.21.15.117:0/3027115714 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06300cc020 con 0x563d7b6dd520 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06441ab640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f052c039a70 0x7f052c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b6e06b0 0x563d7b7d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b7d7350 con 0x563d7b6e06b0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06451ad640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b6e06b0 0x563d7b7d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06441ab640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f052c039a70 0x7f052c03bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0634001e40 tx=0x7f06340013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06451ad640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b6e06b0 0x563d7b7d6e10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06451ad640 1 -- 172.21.15.117:0/3027115714 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b6e06b0 2024-09-10T06:22:51.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b7d1190 con 0x563d7b6e06b0 2024-09-10T06:22:51.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06451ad640 1 -- 172.21.15.117:0/3027115714 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b6e06b0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b7d9640 0x563d7b7dba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b7dc100 con 0x563d7b7d9640 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06449ac640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b7d9640 0x563d7b7dba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.245+0000 7f06449ac640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b7d9640 0x563d7b7dba30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 -- 172.21.15.117:0/3027115714 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06300cf5a0 con 0x563d7b7d9640 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b7d84e0 con 0x563d7b6e06b0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06451ad640 1 -- 172.21.15.117:0/3027115714 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b6e06b0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b7dd560 0x563d7b7df950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b7e0090 con 0x563d7b7dd560 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06441ab640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b7dd560 0x563d7b7df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06441ab640 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b7dd560 0x563d7b7df950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06441ab640 1 -- 172.21.15.117:0/3027115714 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f063400bd60 con 0x563d7b7dd560 2024-09-10T06:22:51.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d7b5f2450 con 0x563d7b7edb90 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41898/0 (socket says 172.21.15.117:41898) 2024-09-10T06:22:51.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 -- 172.21.15.117:0/2810912003 learned_addr learned my addr 172.21.15.117:0/2810912003 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 -- 172.21.15.117:0/2810912003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b7ee5f0 con 0x563d7b7edb90 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f06449ac640 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06300cfb30 tx=0x7f06300cfe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0529ffb640 1 -- 172.21.15.117:0/2810912003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300ebca0 con 0x563d7b7edb90 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d7b7eee50 con 0x563d7b7edb90 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0529ffb640 1 -- 172.21.15.117:0/2810912003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300ebe40 con 0x563d7b7edb90 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0529ffb640 1 -- 172.21.15.117:0/2810912003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300c8b10 con 0x563d7b7edb90 2024-09-10T06:22:51.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.249+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7b7ef3c0 con 0x563d7b7edb90 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0529ffb640 1 -- 172.21.15.117:0/2810912003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06300c8cb0 con 0x563d7b7edb90 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0529ffb640 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 0x7f051c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0529ffb640 1 -- 172.21.15.117:0/2810912003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f06300e5030 con 0x563d7b7edb90 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06441ab640 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 0x7f051c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06441ab640 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 0x7f051c03bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x563d7b7d77a0 tx=0x7f063400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d7b7c8f70 con 0x563d7b7fb340 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41910/0 (socket says 172.21.15.117:41910) 2024-09-10T06:22:51.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06449ac640 1 -- 172.21.15.117:0/333008736 learned_addr learned my addr 172.21.15.117:0/333008736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06449ac640 1 -- 172.21.15.117:0/333008736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b7fbd30 con 0x563d7b7fb340 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f06449ac640 1 --2- 172.21.15.117:0/333008736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0630003070 tx=0x7f06300a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380f17a66d77c66e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f05237fe640 1 -- 172.21.15.117:0/333008736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630103020 con 0x563d7b7fb340 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f05237fe640 1 -- 172.21.15.117:0/333008736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300c8020 con 0x563d7b7fb340 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f05237fe640 1 -- 172.21.15.117:0/333008736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300bf0d0 con 0x563d7b7fb340 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- 172.21.15.117:0/333008736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 msgr2=0x563d7b7fb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/333008736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0630003070 tx=0x7f06300a6f60 comp rx=0 tx=0).stop 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- 172.21.15.117:0/333008736 shutdown_connections 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/333008736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b7fb740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- 172.21.15.117:0/333008736 >> 172.21.15.117:0/333008736 conn(0x563d7b7f6760 msgr2=0x563d7b7f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- 172.21.15.117:0/333008736 shutdown_connections 2024-09-10T06:22:51.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- 172.21.15.117:0/333008736 wait complete. 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 Processor -- start 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- start start 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.253+0000 7f0646ea69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d7b7fa110 con 0x563d7b7fb340 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06449ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41914/0 (socket says 172.21.15.117:41914) 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 learned_addr learned my addr 172.21.15.117:0/4263111556 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7b801bd0 con 0x563d7b7fb340 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06449ac640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06300cdfb0 tx=0x7f06300cdf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 -- 172.21.15.117:0/4263111556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0630118070 con 0x563d7b7fb340 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d7b801bd0 con 0x563d7b7fb340 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7b801bd0 con 0x563d7b7fb340 2024-09-10T06:22:51.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 -- 172.21.15.117:0/4263111556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300e0d50 con 0x563d7b7fb340 2024-09-10T06:22:51.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 -- 172.21.15.117:0/4263111556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06300b3b20 con 0x563d7b7fb340 2024-09-10T06:22:51.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 -- 172.21.15.117:0/4263111556 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f063011b070 con 0x563d7b7fb340 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0514039a70 0x7f051403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0521ffb640 1 -- 172.21.15.117:0/4263111556 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f063010e030 con 0x563d7b7fb340 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06441ab640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0514039a70 0x7f051403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b80c710 0x563d7b80eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b80f2f0 con 0x563d7b80c710 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06451ad640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b80c710 0x563d7b80eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06441ab640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0514039a70 0x7f051403bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f063400ffd0 tx=0x7f0634010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06451ad640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b80c710 0x563d7b80eba0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 realm 2024-09-10T06:22:51.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b80f700 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.257+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b80ffd0 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b810ea0 0x563d7b813290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8139d0 con 0x563d7b810ea0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b810ea0 0x563d7b813290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b810ea0 0x563d7b813290 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 20 searching for the correct realm 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b815970 0x563d7b817e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8184e0 con 0x563d7b815970 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06441ab640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b815970 0x563d7b817e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06441ab640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b815970 0x563d7b817e10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8184e0 con 0x563d7b810ea0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f063011d060 0x7f06300e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8184e0 con 0x7f063011d060 2024-09-10T06:22:51.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f063011d060 0x7f06300e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f063011d060 0x7f06300e11c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.261+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b810ea0 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b810ea0 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.265+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b810ea0 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.269+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b810ea0 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b815970 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x7f063011d060 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b80c710 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563d7b810370 con 0x563d7b810ea0 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:51.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b814290 con 0x563d7b80c710 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b814680 con 0x563d7b80c710 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b814680 con 0x563d7b815970 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:51.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 zone default found 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 4 Realm: () 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 zonegroup default 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.273+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b818960 con 0x7f063011d060 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81a350 con 0x563d7b815970 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81a6f0 con 0x563d7b815970 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 started sync module instance, tier type = 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8197f0 con 0x563d7b810ea0 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822065085408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b819450 con 0x563d7b810ea0 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81b5f0 con 0x563d7b80c710 2024-09-10T06:22:51.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822065085408] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822065090880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81ba10 con 0x563d7b80c710 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.277+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81c2e0 con 0x563d7b815970 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822065090880] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822065092208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81c6d0 con 0x563d7b815970 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81d090 con 0x563d7b810ea0 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822065099904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81dd50 con 0x563d7b810ea0 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.281+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e710 con 0x563d7b80c710 2024-09-10T06:22:51.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822065092208] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822065099904] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822065093392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81d9b0 con 0x563d7b80c710 2024-09-10T06:22:51.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81ee40 con 0x7f063011d060 2024-09-10T06:22:51.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822065093392] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.285+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822065105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81ee00 con 0x7f063011d060 2024-09-10T06:22:51.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81f850 con 0x7f063011d060 2024-09-10T06:22:51.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822065107872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81fc70 con 0x7f063011d060 2024-09-10T06:22:51.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8206b0 con 0x7f063011d060 2024-09-10T06:22:51.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822065105200] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.289+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822065107872] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822065111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81f7c0 con 0x7f063011d060 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=0 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=1 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=2 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=3 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=4 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=5 2024-09-10T06:22:51.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=6 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822065111424] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 20 add_watcher() i=7 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b8237b0 con 0x563d7b80c710 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822065103456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b820c30 con 0x563d7b80c710 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822065103456] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.293+0000 7f04fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 5 note: GC not initialized 2024-09-10T06:22:51.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f04f97e2640 20 reqs_thread_entry: start 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 Filter name: none 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f046affd640 20 reqs_thread_entry: start 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563d7b846700 con 0x563d7b80c710 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:51.299 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:51.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f04fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822065103456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b845570 con 0x563d7b80c710 2024-09-10T06:22:51.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94822065103456] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822065085408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x563d7b810ea0 2024-09-10T06:22:51.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94822065085408] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 20 remove_watcher() i=0 2024-09-10T06:22:51.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 2 removed watcher, disabling cache 2024-09-10T06:22:51.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.297+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822065090880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x563d7b80c710 2024-09-10T06:22:51.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.301+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94822065090880] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.301+0000 7f0646ea69c0 20 remove_watcher() i=1 2024-09-10T06:22:51.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.301+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822065092208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81b140 con 0x563d7b815970 2024-09-10T06:22:51.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f06441ab640 1 -- 172.21.15.117:0/4263111556 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94822065092208] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0634037040 con 0x563d7b815970 2024-09-10T06:22:51.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 20 remove_watcher() i=2 2024-09-10T06:22:51.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822065099904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x563d7b810ea0 2024-09-10T06:22:51.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f06449ac640 1 -- 172.21.15.117:0/4263111556 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94822065099904] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063011a030 con 0x563d7b810ea0 2024-09-10T06:22:51.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 20 remove_watcher() i=3 2024-09-10T06:22:51.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822065093392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x563d7b80c710 2024-09-10T06:22:51.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94822065093392] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x563d7b80c710 2024-09-10T06:22:51.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 20 remove_watcher() i=4 2024-09-10T06:22:51.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.305+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822065105200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x7f063011d060 2024-09-10T06:22:51.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94822065105200] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f0646ea69c0 20 remove_watcher() i=5 2024-09-10T06:22:51.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822065107872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e930 con 0x7f063011d060 2024-09-10T06:22:51.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94822065107872] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f0646ea69c0 20 remove_watcher() i=6 2024-09-10T06:22:51.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.309+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822065111424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563d7b81e260 con 0x7f063011d060 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94822065111424] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f063c00a4d0 con 0x7f063011d060 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 20 remove_watcher() i=7 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f063011d060 msgr2=0x7f06300e11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f063011d060 0x7f06300e11c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b80c710 msgr2=0x563d7b80eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b80c710 0x563d7b80eba0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b810ea0 msgr2=0x563d7b813290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b810ea0 0x563d7b813290 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b815970 msgr2=0x563d7b817e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b815970 0x563d7b817e10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0514039a70 msgr2=0x7f051403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0514039a70 0x7f051403bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f063400ffd0 tx=0x7f0634010000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 msgr2=0x563d7b801670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f06451ad640 1 -- 172.21.15.117:0/4263111556 reap_dead start 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06300cdfb0 tx=0x7f06300cdf40 comp rx=0 tx=0).stop 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 shutdown_connections 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/4263111556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7fb340 0x563d7b801670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 >> 172.21.15.117:0/4263111556 conn(0x563d7b7f6760 msgr2=0x563d7b7f4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 shutdown_connections 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/4263111556 wait complete. 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 msgr2=0x7f051c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 0x7f051c03bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x563d7b7d77a0 tx=0x7f063400f000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 msgr2=0x563d7b7edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06300cfb30 tx=0x7f06300cfe90 comp rx=0 tx=0).stop 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 shutdown_connections 2024-09-10T06:22:51.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f051c039a70 0x7f051c03bf30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/2810912003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b7edb90 0x563d7b7edfb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 >> 172.21.15.117:0/2810912003 conn(0x563d7b7e3540 msgr2=0x563d7b7e3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 shutdown_connections 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/2810912003 wait complete. 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b6e06b0 msgr2=0x563d7b7d6e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563d7b6e06b0 0x563d7b7d6e10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b7d9640 msgr2=0x563d7b7dba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563d7b7d9640 0x563d7b7dba30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b7dd560 msgr2=0x563d7b7df950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563d7b7dd560 0x563d7b7df950 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f052c039a70 msgr2=0x7f052c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f052c039a70 0x7f052c03bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0634001e40 tx=0x7f06340013a0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 msgr2=0x563d7b7cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 --2- 172.21.15.117:0/3027115714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d7b6dd520 0x563d7b7cfca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0630018f70 tx=0x7f06300180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f06451ad640 1 -- 172.21.15.117:0/3027115714 reap_dead start 2024-09-10T06:22:51.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 shutdown_connections 2024-09-10T06:22:51.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 >> 172.21.15.117:0/3027115714 conn(0x563d7b6d9040 msgr2=0x563d7b7c2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 shutdown_connections 2024-09-10T06:22:51.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.313+0000 7f0646ea69c0 1 -- 172.21.15.117:0/3027115714 wait complete. 2024-09-10T06:22:51.325 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:51.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T06:22:51.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T06:22:51.326 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T06:22:51.397 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.397 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f331a3729c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55babbab4560 0x55babbab6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f331a3729c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55babb9659c0 con 0x55babbab0370 2024-09-10T06:22:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f331a3729c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55babb9b56d0 con 0x55babbab4560 2024-09-10T06:22:51.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317677640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55babbab4560 0x55babbab6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317e78640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55babbab0370 0x55babbab0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44198/0 (socket says 172.21.15.117:44198) 2024-09-10T06:22:51.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317e78640 1 -- 172.21.15.117:0/2056882521 learned_addr learned my addr 172.21.15.117:0/2056882521 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317677640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55babbab4560 0x55babbab6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41918/0 (socket says 172.21.15.117:41918) 2024-09-10T06:22:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317677640 1 -- 172.21.15.117:0/2056882521 >> v1:172.21.15.84:6789/0 conn(0x55babbab0370 legacy=0x55babbab0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.397+0000 7f3317677640 1 -- 172.21.15.117:0/2056882521 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babb959ca0 con 0x55babbab4560 2024-09-10T06:22:51.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f3317677640 1 --2- 172.21.15.117:0/2056882521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab4560 0x55babbab6950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f330000a420 tx=0x7f330001b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88a50e41f62d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f3316e76640 1 -- 172.21.15.117:0/2056882521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33000af070 con 0x55babbab4560 2024-09-10T06:22:51.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f3316e76640 1 -- 172.21.15.117:0/2056882521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33000aa530 con 0x55babbab4560 2024-09-10T06:22:51.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f3316e76640 1 -- 172.21.15.117:0/2056882521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33000aa850 con 0x55babbab4560 2024-09-10T06:22:51.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 -- 172.21.15.117:0/2056882521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab4560 msgr2=0x55babbab6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 --2- 172.21.15.117:0/2056882521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab4560 0x55babbab6950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f330000a420 tx=0x7f330001b060 comp rx=0 tx=0).stop 2024-09-10T06:22:51.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 -- 172.21.15.117:0/2056882521 shutdown_connections 2024-09-10T06:22:51.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 --2- 172.21.15.117:0/2056882521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab4560 0x55babbab6950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 -- 172.21.15.117:0/2056882521 >> 172.21.15.117:0/2056882521 conn(0x55babbaabe90 msgr2=0x55babbaae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 -- 172.21.15.117:0/2056882521 shutdown_connections 2024-09-10T06:22:51.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.401+0000 7f331a3729c0 1 -- 172.21.15.117:0/2056882521 wait complete. 2024-09-10T06:22:51.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f331a3729c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f331a3729c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55babb9b9680 con 0x55babbab0370 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41934/0 (socket says 172.21.15.117:41934) 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f3317e78640 1 -- 172.21.15.117:0/2953494729 learned_addr learned my addr 172.21.15.117:0/2953494729 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.413+0000 7f3317e78640 1 -- 172.21.15.117:0/2953494729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babb934da0 con 0x55babbab0370 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 --2- 172.21.15.117:0/2953494729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3308001e00 tx=0x7f330800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c621f6dea73c528 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3205e0b640 1 -- 172.21.15.117:0/2953494729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308012020 con 0x55babbab0370 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3205e0b640 1 -- 172.21.15.117:0/2953494729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330800e690 con 0x55babbab0370 2024-09-10T06:22:51.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3205e0b640 1 -- 172.21.15.117:0/2953494729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330800ea10 con 0x55babbab0370 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/2953494729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 msgr2=0x55babbb9b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 --2- 172.21.15.117:0/2953494729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3308001e00 tx=0x7f330800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/2953494729 shutdown_connections 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 --2- 172.21.15.117:0/2953494729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbb9b6f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/2953494729 >> 172.21.15.117:0/2953494729 conn(0x55babbaabe90 msgr2=0x55babbb97390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/2953494729 shutdown_connections 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/2953494729 wait complete. 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbba3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55babb95ba50 con 0x55babbab0370 2024-09-10T06:22:51.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbba3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbba3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41942/0 (socket says 172.21.15.117:41942) 2024-09-10T06:22:51.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 -- 172.21.15.117:0/1613456274 learned_addr learned my addr 172.21.15.117:0/1613456274 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babbba43f0 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f3317e78640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbba3e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55babbb9c6e0 tx=0x7f3308000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f31fffff640 1 -- 172.21.15.117:0/1613456274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308012030 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babbba4680 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f31fffff640 1 -- 172.21.15.117:0/1613456274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330801a750 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f31fffff640 1 -- 172.21.15.117:0/1613456274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330801aa30 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.417+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babbba5030 con 0x55babbab0370 2024-09-10T06:22:51.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f31fffff640 1 -- 172.21.15.117:0/1613456274 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3308015020 con 0x55babbab0370 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f31fffff640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3200039a70 0x7f320003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f31fffff640 1 -- 172.21.15.117:0/1613456274 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3308020030 con 0x55babbab0370 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317677640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3200039a70 0x7f320003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbab4560 0x55babbbab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbab540 con 0x55babbab4560 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3318679640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbab4560 0x55babbbab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317677640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3200039a70 0x7f320003bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33000ac000 tx=0x7f33000a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3318679640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbab4560 0x55babbbab000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3318679640 1 -- 172.21.15.117:0/1613456274 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33100083f0 con 0x55babbab4560 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbab8e0 con 0x55babbab4560 2024-09-10T06:22:51.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3318679640 1 -- 172.21.15.117:0/1613456274 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33100083f0 con 0x55babbab4560 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbad6f0 0x55babbbafae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbb01b0 con 0x55babbbad6f0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317e78640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbad6f0 0x55babbbafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317e78640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbad6f0 0x55babbbafae0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317e78640 1 -- 172.21.15.117:0/1613456274 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3308008030 con 0x55babbbad6f0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbac560 con 0x55babbab4560 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3318679640 1 -- 172.21.15.117:0/1613456274 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33100083f0 con 0x55babbab4560 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbb15f0 0x55babbbb39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbb4150 con 0x55babbbb15f0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317677640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbb15f0 0x55babbbb39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317677640 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbb15f0 0x55babbbb39e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.421+0000 7f3317677640 1 -- 172.21.15.117:0/1613456274 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33000b2070 con 0x55babbbb15f0 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55babb9c6450 con 0x55babbbc1c20 2024-09-10T06:22:51.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41950/0 (socket says 172.21.15.117:41950) 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317e78640 1 -- 172.21.15.117:0/3213820630 learned_addr learned my addr 172.21.15.117:0/3213820630 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317e78640 1 -- 172.21.15.117:0/3213820630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babbbc2680 con 0x55babbbc1c20 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317e78640 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f330804ebf0 tx=0x7f330800c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 -- 172.21.15.117:0/3213820630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330800d7b0 con 0x55babbbc1c20 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babbbc2ee0 con 0x55babbbc1c20 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 -- 172.21.15.117:0/3213820630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330800dae0 con 0x55babbbc1c20 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 -- 172.21.15.117:0/3213820630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330800ddc0 con 0x55babbbc1c20 2024-09-10T06:22:51.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babbbc3450 con 0x55babbbc1c20 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 -- 172.21.15.117:0/3213820630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f330804d040 con 0x55babbbc1c20 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 0x7f31f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f31fd7fa640 1 -- 172.21.15.117:0/3213820630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f330804a040 con 0x55babbbc1c20 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f3317677640 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 0x7f31f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.425+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55babbb9bf40 con 0x55babbbcf2b0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317677640 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 0x7f31f003bf30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33000ad040 tx=0x7f3300005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41964/0 (socket says 172.21.15.117:41964) 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 -- 172.21.15.117:0/588657130 learned_addr learned my addr 172.21.15.117:0/588657130 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 -- 172.21.15.117:0/588657130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babbbcfc80 con 0x55babbbcf2b0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- 172.21.15.117:0/588657130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3308021040 tx=0x7f33080407c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62ef2fa2feb33fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f6ffd640 1 -- 172.21.15.117:0/588657130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330805f020 con 0x55babbbcf2b0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f6ffd640 1 -- 172.21.15.117:0/588657130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3308037020 con 0x55babbbcf2b0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f6ffd640 1 -- 172.21.15.117:0/588657130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33080503f0 con 0x55babbbcf2b0 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/588657130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 msgr2=0x55babbbcf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 --2- 172.21.15.117:0/588657130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3308021040 tx=0x7f33080407c0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/588657130 shutdown_connections 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 --2- 172.21.15.117:0/588657130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbcf690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/588657130 >> 172.21.15.117:0/588657130 conn(0x55babbbca6d0 msgr2=0x55babbbc8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/588657130 shutdown_connections 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/588657130 wait complete. 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 Processor -- start 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- start start 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55babbbce080 con 0x55babbbcf2b0 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41980/0 (socket says 172.21.15.117:41980) 2024-09-10T06:22:51.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 learned_addr learned my addr 172.21.15.117:0/4004719672 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babbbd5b40 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f3317e78640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f330800b710 tx=0x7f3308038ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f57fa640 1 -- 172.21.15.117:0/4004719672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308073070 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55babbbd5b40 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babbbd6110 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f57fa640 1 -- 172.21.15.117:0/4004719672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3308037020 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.429+0000 7f31f57fa640 1 -- 172.21.15.117:0/4004719672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3308024420 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f31f57fa640 1 -- 172.21.15.117:0/4004719672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3308076070 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f31f57fa640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31e0039a70 0x7f31e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f31f57fa640 1 -- 172.21.15.117:0/4004719672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3308005050 con 0x55babbbcf2b0 2024-09-10T06:22:51.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3317677640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31e0039a70 0x7f31e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbbe0850 0x55babbbe2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe3430 con 0x55babbbe0850 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbbe0850 0x55babbbe2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3317677640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31e0039a70 0x7f31e003bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33000aafd0 tx=0x7f33000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbbe0850 0x55babbbe2ce0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33100083f0 con 0x55babbbe0850 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 realm 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe3840 con 0x55babbbe0850 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33100083f0 con 0x55babbbe0850 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe4110 con 0x55babbbe0850 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33100083f0 con 0x55babbbe0850 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33100083f0 con 0x55babbbe0850 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbe5210 0x55babbbe7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe7c50 con 0x55babbbe5210 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3317e78640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbe5210 0x55babbbe7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3317e78640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbe5210 0x55babbbe7600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.433+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f331a3729c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f331a3729c0 20 searching for the correct realm 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbe9b30 0x55babbbebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbec5e0 con 0x55babbbe9b30 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317677640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbe9b30 0x55babbbebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317677640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbe9b30 0x55babbbebf60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbec5e0 con 0x55babbbe5210 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317e78640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3308078060 0x7f3308041040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbec5e0 con 0x7f3308078060 2024-09-10T06:22:51.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3308078060 0x7f3308041040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3308078060 0x7f3308041040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33100083f0 con 0x7f3308078060 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33100083f0 con 0x55babbbe0850 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.437+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe5210 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe5210 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.441+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe5210 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe5210 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe9b30 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.445+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x7f3308078060 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe0850 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe44b0 con 0x55babbbe5210 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:51.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe84a0 con 0x55babbbe0850 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe8890 con 0x55babbbe0850 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbe8890 con 0x55babbbe9b30 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:51.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 zone default found 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 4 Realm: () 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 zonegroup default 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbeca60 con 0x7f3308078060 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbee580 con 0x55babbbe9b30 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbee9e0 con 0x55babbbe9b30 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 started sync module instance, tier type = 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.449+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbed8f0 con 0x55babbbe5210 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94260502125792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbed550 con 0x55babbbe5210 2024-09-10T06:22:51.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbef8f0 con 0x55babbbe0850 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94260502125792] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94260502131776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbef860 con 0x55babbbe0850 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.453+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf0680 con 0x55babbbe9b30 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94260502131776] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94260502133984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf0a70 con 0x55babbbe9b30 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf1430 con 0x55babbbe5210 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94260502139088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf1cd0 con 0x55babbbe5210 2024-09-10T06:22:51.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf26d0 con 0x55babbbe0850 2024-09-10T06:22:51.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94260502133984] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.457+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94260502139088] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94260502135040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf1820 con 0x55babbbe0850 2024-09-10T06:22:51.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf2f70 con 0x7f3308078060 2024-09-10T06:22:51.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94260502135040] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94260502143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf1820 con 0x7f3308078060 2024-09-10T06:22:51.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.461+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf3440 con 0x7f3308078060 2024-09-10T06:22:51.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94260502146864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf38b0 con 0x7f3308078060 2024-09-10T06:22:51.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf4370 con 0x7f3308078060 2024-09-10T06:22:51.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94260502143456] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94260502146864] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94260502150720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf3400 con 0x7f3308078060 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=0 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=1 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=2 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=3 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=4 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=5 2024-09-10T06:22:51.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.465+0000 7f331a3729c0 20 add_watcher() i=6 2024-09-10T06:22:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94260502150720] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 add_watcher() i=7 2024-09-10T06:22:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf7470 con 0x55babbbe0850 2024-09-10T06:22:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94260502145216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf48f0 con 0x55babbbe0850 2024-09-10T06:22:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94260502145216] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f31cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 5 note: GC not initialized 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f31ccfe1640 20 reqs_thread_entry: start 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 Filter name: none 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f31467fc640 20 reqs_thread_entry: start 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1a840 con 0x55babbbe0850 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1a260 con 0x55babbbe5210 2024-09-10T06:22:51.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.469+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbc20e80 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94260502333712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1c6e0 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94260502135040 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f3310010040 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f31f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94260502135040 notifier 4311 bl.length()=567 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f31f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f31f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f31f6ffd640 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f31dc003eb0 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify cookie 94260502333712 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94260502333712 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f331000ae20 con 0x55babbbe0850 2024-09-10T06:22:51.477 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:51.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f31cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94260502145216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1c6e0 con 0x55babbbe0850 2024-09-10T06:22:51.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94260502145216] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.473+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94260502125792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1c6e0 con 0x55babbbe5210 2024-09-10T06:22:51.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94260502125792] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f331a3729c0 20 remove_watcher() i=0 2024-09-10T06:22:51.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f331a3729c0 2 removed watcher, disabling cache 2024-09-10T06:22:51.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94260502131776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1c6e0 con 0x55babbbe0850 2024-09-10T06:22:51.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94260502131776] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f331a3729c0 20 remove_watcher() i=1 2024-09-10T06:22:51.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.477+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94260502133984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbc1c6e0 con 0x55babbbe9b30 2024-09-10T06:22:51.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f3317677640 1 -- 172.21.15.117:0/4004719672 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94260502133984] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33000c9070 con 0x55babbbe9b30 2024-09-10T06:22:51.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 20 remove_watcher() i=2 2024-09-10T06:22:51.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94260502139088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf28c0 con 0x55babbbe5210 2024-09-10T06:22:51.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f3317e78640 1 -- 172.21.15.117:0/4004719672 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94260502139088] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3308075030 con 0x55babbbe5210 2024-09-10T06:22:51.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 20 remove_watcher() i=3 2024-09-10T06:22:51.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94260502135040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbef440 con 0x55babbbe0850 2024-09-10T06:22:51.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94260502135040] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x55babbbe0850 2024-09-10T06:22:51.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 20 remove_watcher() i=4 2024-09-10T06:22:51.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.481+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94260502143456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf10d0 con 0x7f3308078060 2024-09-10T06:22:51.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.485+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94260502143456] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.485+0000 7f331a3729c0 20 remove_watcher() i=5 2024-09-10T06:22:51.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.485+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94260502146864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbef440 con 0x7f3308078060 2024-09-10T06:22:51.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94260502146864] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 20 remove_watcher() i=6 2024-09-10T06:22:51.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94260502150720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55babbbf10d0 con 0x7f3308078060 2024-09-10T06:22:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94260502150720] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310026040 con 0x7f3308078060 2024-09-10T06:22:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 20 remove_watcher() i=7 2024-09-10T06:22:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3308078060 msgr2=0x7f3308041040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3308078060 0x7f3308041040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbbe0850 msgr2=0x55babbbe2ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbbe0850 0x55babbbe2ce0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbe5210 msgr2=0x55babbbe7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbe5210 0x55babbbe7600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbe9b30 msgr2=0x55babbbebf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbe9b30 0x55babbbebf60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31e0039a70 msgr2=0x7f31e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31e0039a70 0x7f31e003bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33000aafd0 tx=0x7f33000a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 msgr2=0x55babbbd55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f330800b710 tx=0x7f3308038ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f3318679640 1 -- 172.21.15.117:0/4004719672 reap_dead start 2024-09-10T06:22:51.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 shutdown_connections 2024-09-10T06:22:51.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/4004719672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbcf2b0 0x55babbbd55e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 >> 172.21.15.117:0/4004719672 conn(0x55babbbca6d0 msgr2=0x55babbbc88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 shutdown_connections 2024-09-10T06:22:51.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/4004719672 wait complete. 2024-09-10T06:22:51.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 msgr2=0x7f31f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 0x7f31f003bf30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33000ad040 tx=0x7f3300005d90 comp rx=0 tx=0).stop 2024-09-10T06:22:51.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 msgr2=0x55babbbc2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f330804ebf0 tx=0x7f330800c610 comp rx=0 tx=0).stop 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 shutdown_connections 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f31f0039a70 0x7f31f003bf30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/3213820630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbbc1c20 0x55babbbc2040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 >> 172.21.15.117:0/3213820630 conn(0x55babbbb75d0 msgr2=0x55babbbb79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 shutdown_connections 2024-09-10T06:22:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/3213820630 wait complete. 2024-09-10T06:22:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbab4560 msgr2=0x55babbbab000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55babbab4560 0x55babbbab000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbad6f0 msgr2=0x55babbbafae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55babbbad6f0 0x55babbbafae0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbb15f0 msgr2=0x55babbbb39e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55babbbb15f0 0x55babbbb39e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3200039a70 msgr2=0x7f320003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3200039a70 0x7f320003bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33000ac000 tx=0x7f33000a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 msgr2=0x55babbba3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 --2- 172.21.15.117:0/1613456274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55babbab0370 0x55babbba3e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55babbb9c6e0 tx=0x7f3308000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f3318679640 1 -- 172.21.15.117:0/1613456274 reap_dead start 2024-09-10T06:22:51.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 shutdown_connections 2024-09-10T06:22:51.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 >> 172.21.15.117:0/1613456274 conn(0x55babbaabe90 msgr2=0x55babbb95e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 shutdown_connections 2024-09-10T06:22:51.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.489+0000 7f331a3729c0 1 -- 172.21.15.117:0/1613456274 wait complete. 2024-09-10T06:22:51.506 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:51.506 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.507 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185d3f59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c6af9fe590 0x55c6af9fd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185d3f59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c6af93b9c0 con 0x55c6af9fe060 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185d3f59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c6af98b6d0 con 0x55c6af9fe590 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185a6fa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c6af9fe590 0x55c6af9fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185a6fa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c6af9fe590 0x55c6af9fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41992/0 (socket says 172.21.15.117:41992) 2024-09-10T06:22:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185a6fa640 1 -- 172.21.15.117:0/2428612015 learned_addr learned my addr 172.21.15.117:0/2428612015 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185a6fa640 1 -- 172.21.15.117:0/2428612015 >> v1:172.21.15.84:6789/0 conn(0x55c6af9fe060 legacy=0x55c6af9fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.577+0000 7f185a6fa640 1 -- 172.21.15.117:0/2428612015 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6af92fca0 con 0x55c6af9fe590 2024-09-10T06:22:51.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185a6fa640 1 --2- 172.21.15.117:0/2428612015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe590 0x55c6af9fd110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f185000a5c0 tx=0x7f185001b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3749332870e0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f1859ef9640 1 -- 172.21.15.117:0/2428612015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18500aa540 con 0x55c6af9fe590 2024-09-10T06:22:51.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f1859ef9640 1 -- 172.21.15.117:0/2428612015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18500af070 con 0x55c6af9fe590 2024-09-10T06:22:51.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f1859ef9640 1 -- 172.21.15.117:0/2428612015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18500aa830 con 0x55c6af9fe590 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2428612015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe590 msgr2=0x55c6af9fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2428612015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe590 0x55c6af9fd110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f185000a5c0 tx=0x7f185001b2e0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2428612015 shutdown_connections 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2428612015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe590 0x55c6af9fd110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2428612015 >> 172.21.15.117:0/2428612015 conn(0x55c6afa83040 msgr2=0x55c6afa85460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2428612015 shutdown_connections 2024-09-10T06:22:51.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.581+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2428612015 wait complete. 2024-09-10T06:22:51.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185d3f59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185d3f59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6af98f680 con 0x55c6af9fe060 2024-09-10T06:22:51.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41996/0 (socket says 172.21.15.117:41996) 2024-09-10T06:22:51.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185aefb640 1 -- 172.21.15.117:0/1748025724 learned_addr learned my addr 172.21.15.117:0/1748025724 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185aefb640 1 -- 172.21.15.117:0/1748025724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6af90ada0 con 0x55c6af9fe060 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.593+0000 7f185aefb640 1 --2- 172.21.15.117:0/1748025724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1854001690 tx=0x7f1854001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773164543aa0006f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1748e09640 1 -- 172.21.15.117:0/1748025724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854016070 con 0x55c6af9fe060 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1748e09640 1 -- 172.21.15.117:0/1748025724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185400f640 con 0x55c6af9fe060 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1748e09640 1 -- 172.21.15.117:0/1748025724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185400f960 con 0x55c6af9fe060 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1748025724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 msgr2=0x55c6afb74cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1748025724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1854001690 tx=0x7f1854001b50 comp rx=0 tx=0).stop 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1748025724 shutdown_connections 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1748025724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb74cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1748025724 >> 172.21.15.117:0/1748025724 conn(0x55c6afa83040 msgr2=0x55c6afb70960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1748025724 shutdown_connections 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1748025724 wait complete. 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6af931a50 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb7c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:41998/0 (socket says 172.21.15.117:41998) 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185aefb640 1 -- 172.21.15.117:0/116278500 learned_addr learned my addr 172.21.15.117:0/116278500 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185aefb640 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6afb7c840 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185aefb640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb7c2e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55c6afb75cb0 tx=0x7f1854001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1747606640 1 -- 172.21.15.117:0/116278500 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854021020 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6afb7cad0 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1747606640 1 -- 172.21.15.117:0/116278500 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854011570 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f1747606640 1 -- 172.21.15.117:0/116278500 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854016040 con 0x55c6af9fe060 2024-09-10T06:22:51.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.597+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6afb7d480 con 0x55c6af9fe060 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f1747606640 1 -- 172.21.15.117:0/116278500 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1854024020 con 0x55c6af9fe060 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f1747606640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1740039a70 0x7f174003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f1747606640 1 -- 172.21.15.117:0/116278500 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f185404fa80 con 0x55c6af9fe060 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185a6fa640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1740039a70 0x7f174003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6af9fe590 0x55c6afb83450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afb83990 con 0x55c6af9fe590 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185b6fc640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6af9fe590 0x55c6afb83450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185a6fa640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1740039a70 0x7f174003bf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18500ae000 tx=0x7f18500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185b6fc640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6af9fe590 0x55c6afb83450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185b6fc640 1 -- 172.21.15.117:0/116278500 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6af9fe590 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afb83dc0 con 0x55c6af9fe590 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185b6fc640 1 -- 172.21.15.117:0/116278500 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6af9fe590 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afb85bd0 0x55c6afb87fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afb88690 con 0x55c6afb85bd0 2024-09-10T06:22:51.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185aefb640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afb85bd0 0x55c6afb87fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185aefb640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afb85bd0 0x55c6afb87fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185aefb640 1 -- 172.21.15.117:0/116278500 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f185400f070 con 0x55c6afb85bd0 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afb84a40 con 0x55c6af9fe590 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185b6fc640 1 -- 172.21.15.117:0/116278500 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6af9fe590 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afb89ad0 0x55c6afb8bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afb8c630 con 0x55c6afb89ad0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185a6fa640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afb89ad0 0x55c6afb8bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185a6fa640 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afb89ad0 0x55c6afb8bec0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185a6fa640 1 -- 172.21.15.117:0/116278500 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afb89ad0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.601+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6af99c450 con 0x55c6afb9a0d0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42010/0 (socket says 172.21.15.117:42010) 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185aefb640 1 -- 172.21.15.117:0/1982606809 learned_addr learned my addr 172.21.15.117:0/1982606809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185aefb640 1 -- 172.21.15.117:0/1982606809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6afb9ab30 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185aefb640 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f185404e050 tx=0x7f1854010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 -- 172.21.15.117:0/1982606809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854011ce0 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6afb9b390 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6afb9b900 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 -- 172.21.15.117:0/1982606809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854034070 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 -- 172.21.15.117:0/1982606809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185403e060 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 -- 172.21.15.117:0/1982606809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f18540104d0 con 0x55c6afb9a0d0 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 0x7f173403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f1744e01640 1 -- 172.21.15.117:0/1982606809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1854013030 con 0x55c6afb9a0d0 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185a6fa640 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 0x7f173403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185a6fa640 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 0x7f173403bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f185001b320 tx=0x7f1850005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.605+0000 7f185d3f59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6afb754f0 con 0x55c6afba78c0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42012/0 (socket says 172.21.15.117:42012) 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 -- 172.21.15.117:0/931354506 learned_addr learned my addr 172.21.15.117:0/931354506 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 -- 172.21.15.117:0/931354506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6afba8270 con 0x55c6afba78c0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- 172.21.15.117:0/931354506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1854049010 tx=0x7f18540474d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf7dca4558fad12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173e7fc640 1 -- 172.21.15.117:0/931354506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f185405e070 con 0x55c6afba78c0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173e7fc640 1 -- 172.21.15.117:0/931354506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185404dca0 con 0x55c6afba78c0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173e7fc640 1 -- 172.21.15.117:0/931354506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854030410 con 0x55c6afba78c0 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/931354506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 msgr2=0x55c6afba7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/931354506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1854049010 tx=0x7f18540474d0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/931354506 shutdown_connections 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/931354506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afba7ca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/931354506 >> 172.21.15.117:0/931354506 conn(0x55c6afba2c80 msgr2=0x55c6afba0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/931354506 shutdown_connections 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/931354506 wait complete. 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 Processor -- start 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- start start 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afbadb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6afba6630 con 0x55c6afba78c0 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afbadb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afbadb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42018/0 (socket says 172.21.15.117:42018) 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 learned_addr learned my addr 172.21.15.117:0/2255489359 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6afbae0f0 con 0x55c6afba78c0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185aefb640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afbadb90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1854047a20 tx=0x7f1854011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173cff9640 1 -- 172.21.15.117:0/2255489359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854073070 con 0x55c6afba78c0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6afbae0f0 con 0x55c6afba78c0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6afbae0f0 con 0x55c6afba78c0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173cff9640 1 -- 172.21.15.117:0/2255489359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854030800 con 0x55c6afba78c0 2024-09-10T06:22:51.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.609+0000 7f173cff9640 1 -- 172.21.15.117:0/2255489359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854030b00 con 0x55c6afba78c0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f173cff9640 1 -- 172.21.15.117:0/2255489359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1854076070 con 0x55c6afba78c0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f173cff9640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1724039a70 0x7f172403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f173cff9640 1 -- 172.21.15.117:0/2255489359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f185406b070 con 0x55c6afba78c0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185a6fa640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1724039a70 0x7f172403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6afbb8d10 0x55c6afbbb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbb8f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6afbb8d10 0x55c6afbbb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185a6fa640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1724039a70 0x7f172403bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c10 tx=0x7f18500c2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6afbb8d10 0x55c6afbbb1a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 realm 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbbd00 con 0x55c6afbb8d10 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc5d0 con 0x55c6afbb8d10 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afbbd460 0x55c6afbbf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbff90 con 0x55c6afbbd460 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185aefb640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afbbd460 0x55c6afbbf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185aefb640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afbbd460 0x55c6afbbf850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 20 searching for the correct realm 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afbc1f30 0x55c6afbc43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc4aa0 con 0x55c6afbc1f30 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185a6fa640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afbc1f30 0x55c6afbc43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.613+0000 7f185a6fa640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afbc1f30 0x55c6afbc43d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc4aa0 con 0x55c6afbbd460 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185aefb640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1854078060 0x7f185405a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc4aa0 con 0x7f1854078060 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1854078060 0x7f185405a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1854078060 0x7f185405a9b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c0083f0 con 0x7f1854078060 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c0083f0 con 0x55c6afbb8d10 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.617+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbbd460 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbbd460 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.621+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbbd460 2024-09-10T06:22:51.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbbd460 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbc1f30 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.625+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x7f1854078060 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbb8d10 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbbc970 con 0x55c6afbbd460 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:51.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc0850 con 0x55c6afbb8d10 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc0c40 con 0x55c6afbb8d10 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc0c40 con 0x55c6afbc1f30 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 zone default found 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 4 Realm: () 2024-09-10T06:22:51.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 zonegroup default 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc4f20 con 0x7f1854078060 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc6910 con 0x55c6afbc1f30 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc6cb0 con 0x55c6afbc1f30 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 started sync module instance, tier type = 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc5db0 con 0x55c6afbbd460 2024-09-10T06:22:51.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94311840244128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc5a10 con 0x55c6afbbd460 2024-09-10T06:22:51.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.629+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc7a80 con 0x55c6afbb8d10 2024-09-10T06:22:51.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.633+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94311840244128] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.633+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.633+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94311840248000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc7e70 con 0x55c6afbb8d10 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.633+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc8830 con 0x55c6afbc1f30 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94311840248000] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94311840252800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc8c20 con 0x55c6afbc1f30 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc95e0 con 0x55c6afbbd460 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94311840256304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc9550 con 0x55c6afbbd460 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca500 con 0x55c6afbb8d10 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94311840252800] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94311840256304] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94311840258512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca4c0 con 0x55c6afbb8d10 2024-09-10T06:22:51.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.637+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcada0 con 0x7f1854078060 2024-09-10T06:22:51.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.641+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94311840258512] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.641+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.641+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94311840260080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca4c0 con 0x7f1854078060 2024-09-10T06:22:51.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.641+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcb280 con 0x7f1854078060 2024-09-10T06:22:51.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94311840263504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcb6f0 con 0x7f1854078060 2024-09-10T06:22:51.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcc1b0 con 0x7f1854078060 2024-09-10T06:22:51.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94311840260080] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94311840263504] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94311840267392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcc170 con 0x7f1854078060 2024-09-10T06:22:51.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=0 2024-09-10T06:22:51.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=1 2024-09-10T06:22:51.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=2 2024-09-10T06:22:51.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=3 2024-09-10T06:22:51.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=4 2024-09-10T06:22:51.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=5 2024-09-10T06:22:51.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.645+0000 7f185d3f59c0 20 add_watcher() i=6 2024-09-10T06:22:51.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94311840267392] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 add_watcher() i=7 2024-09-10T06:22:51.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:51.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcf1a0 con 0x55c6afbb8d10 2024-09-10T06:22:51.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94311840262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbcc620 con 0x55c6afbb8d10 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94311840262304] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f17117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 5 note: GC not initialized 2024-09-10T06:22:51.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f168bfff640 20 reqs_thread_entry: start 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 Filter name: none 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f1689ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbf2240 con 0x55c6afbb8d10 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.649+0000 7f185d3f59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:51.654 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f17117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94311840262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbf1090 con 0x55c6afbb8d10 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94311840262304] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94311840244128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca8a0 con 0x55c6afbbd460 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94311840244128] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185d3f59c0 20 remove_watcher() i=0 2024-09-10T06:22:51.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185d3f59c0 2 removed watcher, disabling cache 2024-09-10T06:22:51.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.653+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94311840248000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca8a0 con 0x55c6afbb8d10 2024-09-10T06:22:51.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.657+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94311840248000] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.657+0000 7f185d3f59c0 20 remove_watcher() i=1 2024-09-10T06:22:51.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.657+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94311840252800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc70c0 con 0x55c6afbc1f30 2024-09-10T06:22:51.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185a6fa640 1 -- 172.21.15.117:0/2255489359 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94311840252800] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18500aaa10 con 0x55c6afbc1f30 2024-09-10T06:22:51.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185d3f59c0 20 remove_watcher() i=2 2024-09-10T06:22:51.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94311840256304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca8a0 con 0x55c6afbbd460 2024-09-10T06:22:51.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185aefb640 1 -- 172.21.15.117:0/2255489359 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94311840256304] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1854075030 con 0x55c6afbbd460 2024-09-10T06:22:51.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185d3f59c0 20 remove_watcher() i=3 2024-09-10T06:22:51.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.661+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94311840258512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc70c0 con 0x55c6afbb8d10 2024-09-10T06:22:51.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94311840258512] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x55c6afbb8d10 2024-09-10T06:22:51.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185d3f59c0 20 remove_watcher() i=4 2024-09-10T06:22:51.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94311840260080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc9130 con 0x7f1854078060 2024-09-10T06:22:51.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94311840260080] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185d3f59c0 20 remove_watcher() i=5 2024-09-10T06:22:51.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.665+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94311840263504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbca8a0 con 0x7f1854078060 2024-09-10T06:22:51.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.669+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94311840263504] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.669+0000 7f185d3f59c0 20 remove_watcher() i=6 2024-09-10T06:22:51.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.669+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94311840267392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6afbc70c0 con 0x7f1854078060 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94311840267392] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f184c026040 con 0x7f1854078060 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 20 remove_watcher() i=7 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1854078060 msgr2=0x7f185405a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1854078060 0x7f185405a9b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6afbb8d10 msgr2=0x55c6afbbb1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6afbb8d10 0x55c6afbbb1a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afbbd460 msgr2=0x55c6afbbf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afbbd460 0x55c6afbbf850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afbc1f30 msgr2=0x55c6afbc43d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afbc1f30 0x55c6afbc43d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1724039a70 msgr2=0x7f172403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1724039a70 0x7f172403bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c10 tx=0x7f18500c2040 comp rx=0 tx=0).stop 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 reap_dead start 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 msgr2=0x55c6afbadb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/2255489359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afba78c0 0x55c6afbadb90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1854047a20 tx=0x7f1854011ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185b6fc640 1 -- 172.21.15.117:0/2255489359 reap_dead start 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 shutdown_connections 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 >> 172.21.15.117:0/2255489359 conn(0x55c6afba2c80 msgr2=0x55c6afba0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 shutdown_connections 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/2255489359 wait complete. 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 msgr2=0x7f173403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 0x7f173403bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f185001b320 tx=0x7f1850005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 msgr2=0x55c6afb9a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f185404e050 tx=0x7f1854010da0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 shutdown_connections 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1734039a70 0x7f173403bf30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/1982606809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6afb9a0d0 0x55c6afb9a4f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 >> 172.21.15.117:0/1982606809 conn(0x55c6afb8fa80 msgr2=0x55c6afb8fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 shutdown_connections 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/1982606809 wait complete. 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6af9fe590 msgr2=0x55c6afb83450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c6af9fe590 0x55c6afb83450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afb85bd0 msgr2=0x55c6afb87fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c6afb85bd0 0x55c6afb87fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afb89ad0 msgr2=0x55c6afb8bec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c6afb89ad0 0x55c6afb8bec0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1740039a70 msgr2=0x7f174003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1740039a70 0x7f174003bf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18500ae000 tx=0x7f18500a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 msgr2=0x55c6afb7c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 --2- 172.21.15.117:0/116278500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6af9fe060 0x55c6afb7c2e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55c6afb75cb0 tx=0x7f1854001260 comp rx=0 tx=0).stop 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185b6fc640 1 -- 172.21.15.117:0/116278500 reap_dead start 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 shutdown_connections 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 >> 172.21.15.117:0/116278500 conn(0x55c6afa83040 msgr2=0x55c6afb6f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 shutdown_connections 2024-09-10T06:22:51.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.673+0000 7f185d3f59c0 1 -- 172.21.15.117:0/116278500 wait complete. 2024-09-10T06:22:51.684 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:51.684 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T06:22:51.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T06:22:51.685 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T06:22:51.759 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.759 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df36909c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56412a9e88c0 0x56412a9eacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df36909c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56412a8969c0 con 0x56412a9e4770 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df36909c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56412a8e66d0 con 0x56412a9e88c0 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df0995640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56412a9e88c0 0x56412a9eacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df0995640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56412a9e88c0 0x56412a9eacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42034/0 (socket says 172.21.15.117:42034) 2024-09-10T06:22:51.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df0995640 1 -- 172.21.15.117:0/3009937114 learned_addr learned my addr 172.21.15.117:0/3009937114 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df0995640 1 -- 172.21.15.117:0/3009937114 >> v1:172.21.15.84:6789/0 conn(0x56412a9e4770 legacy=0x56412a9e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.757+0000 7f5df0995640 1 -- 172.21.15.117:0/3009937114 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412a88aca0 con 0x56412a9e88c0 2024-09-10T06:22:51.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df0995640 1 --2- 172.21.15.117:0/3009937114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e88c0 0x56412a9eacb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a5c0 tx=0x7f5de801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425b3e1bdf29511c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5de3fff640 1 -- 172.21.15.117:0/3009937114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de80a9590 con 0x56412a9e88c0 2024-09-10T06:22:51.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5de3fff640 1 -- 172.21.15.117:0/3009937114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de80ae070 con 0x56412a9e88c0 2024-09-10T06:22:51.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5de3fff640 1 -- 172.21.15.117:0/3009937114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de80a9880 con 0x56412a9e88c0 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 -- 172.21.15.117:0/3009937114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e88c0 msgr2=0x56412a9eacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 --2- 172.21.15.117:0/3009937114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e88c0 0x56412a9eacb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5de800a5c0 tx=0x7f5de801b3d0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 -- 172.21.15.117:0/3009937114 shutdown_connections 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 --2- 172.21.15.117:0/3009937114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e88c0 0x56412a9eacb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 -- 172.21.15.117:0/3009937114 >> 172.21.15.117:0/3009937114 conn(0x56412a958080 msgr2=0x56412a958490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 -- 172.21.15.117:0/3009937114 shutdown_connections 2024-09-10T06:22:51.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.761+0000 7f5df36909c0 1 -- 172.21.15.117:0/3009937114 wait complete. 2024-09-10T06:22:51.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.773+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.773+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56412a8ea680 con 0x56412a9e4770 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42050/0 (socket says 172.21.15.117:42050) 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 -- 172.21.15.117:0/546975341 learned_addr learned my addr 172.21.15.117:0/546975341 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 -- 172.21.15.117:0/546975341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412a865da0 con 0x56412a9e4770 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- 172.21.15.117:0/546975341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dec001680 tx=0x7f5dec001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113bfd9eae1fbea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5cdf606640 1 -- 172.21.15.117:0/546975341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec016070 con 0x56412a9e4770 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5cdf606640 1 -- 172.21.15.117:0/546975341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec00f660 con 0x56412a9e4770 2024-09-10T06:22:51.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5cdf606640 1 -- 172.21.15.117:0/546975341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec00f980 con 0x56412a9e4770 2024-09-10T06:22:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- 172.21.15.117:0/546975341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 msgr2=0x56412aacf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 --2- 172.21.15.117:0/546975341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5dec001680 tx=0x7f5dec001b40 comp rx=0 tx=0).stop 2024-09-10T06:22:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- 172.21.15.117:0/546975341 shutdown_connections 2024-09-10T06:22:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 --2- 172.21.15.117:0/546975341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aacf9b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- 172.21.15.117:0/546975341 >> 172.21.15.117:0/546975341 conn(0x56412a958080 msgr2=0x56412aacb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- 172.21.15.117:0/546975341 shutdown_connections 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- 172.21.15.117:0/546975341 wait complete. 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aad7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df36909c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56412a88ca50 con 0x56412a9e4770 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aad7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aad7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42064/0 (socket says 172.21.15.117:42064) 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 -- 172.21.15.117:0/2556726725 learned_addr learned my addr 172.21.15.117:0/2556726725 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412aad75b0 con 0x56412a9e4770 2024-09-10T06:22:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.777+0000 7f5df1196640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aad7050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x56412aad09a0 tx=0x7f5dec000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 -- 172.21.15.117:0/2556726725 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec016040 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56412aad7840 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412aad81f0 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 -- 172.21.15.117:0/2556726725 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec022070 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 -- 172.21.15.117:0/2556726725 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec0062b0 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 -- 172.21.15.117:0/2556726725 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5dec0114c0 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd8039a70 0x7f5cd803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5cdde03640 1 -- 172.21.15.117:0/2556726725 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dec04fbb0 con 0x56412a9e4770 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df0995640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd8039a70 0x7f5cd803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412a9e88c0 0x56412aade1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412aade700 con 0x56412a9e88c0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1997640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412a9e88c0 0x56412aade1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df0995640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd8039a70 0x7f5cd803bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ad000 tx=0x7f5de80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1997640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412a9e88c0 0x56412aade1c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1997640 1 -- 172.21.15.117:0/2556726725 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40083f0 con 0x56412a9e88c0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412aadeb00 con 0x56412a9e88c0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1997640 1 -- 172.21.15.117:0/2556726725 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5de40083f0 con 0x56412a9e88c0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412aae0910 0x56412aae2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412aae33d0 con 0x56412aae0910 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1196640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412aae0910 0x56412aae2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1196640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412aae0910 0x56412aae2d00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1196640 1 -- 172.21.15.117:0/2556726725 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5dec00f070 con 0x56412aae0910 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412aadf780 con 0x56412a9e88c0 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.781+0000 7f5df1997640 1 -- 172.21.15.117:0/2556726725 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5de40083f0 con 0x56412a9e88c0 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412aae4810 0x56412aae6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412aae7370 con 0x56412aae4810 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df0995640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412aae4810 0x56412aae6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df0995640 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412aae4810 0x56412aae6c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df0995640 1 -- 172.21.15.117:0/2556726725 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412aae4810 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56412a8f7450 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42074/0 (socket says 172.21.15.117:42074) 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df1196640 1 -- 172.21.15.117:0/1162778973 learned_addr learned my addr 172.21.15.117:0/1162778973 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df1196640 1 -- 172.21.15.117:0/1162778973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412aaf5870 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df1196640 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0411c0 tx=0x7f5dec01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5cd6ffd640 1 -- 172.21.15.117:0/1162778973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec026de0 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56412aaf60d0 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5cd6ffd640 1 -- 172.21.15.117:0/1162778973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec026580 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5cd6ffd640 1 -- 172.21.15.117:0/1162778973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec0268a0 con 0x56412aaf4e10 2024-09-10T06:22:51.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.785+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412aaf6640 con 0x56412aaf4e10 2024-09-10T06:22:51.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd6ffd640 1 -- 172.21.15.117:0/1162778973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5dec037060 con 0x56412aaf4e10 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd6ffd640 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 0x7f5cc803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd6ffd640 1 -- 172.21.15.117:0/1162778973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dec03d800 con 0x56412aaf4e10 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df0995640 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 0x7f5cc803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56412aad0200 con 0x56412ab02570 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df0995640 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 0x7f5cc803be90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5de8000c10 tx=0x7f5de8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42082/0 (socket says 172.21.15.117:42082) 2024-09-10T06:22:51.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 -- 172.21.15.117:0/515815312 learned_addr learned my addr 172.21.15.117:0/515815312 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 -- 172.21.15.117:0/515815312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412ab02f20 con 0x56412ab02570 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 --2- 172.21.15.117:0/515815312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5dec04efd0 tx=0x7f5dec04e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c499737dda77f4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd4ff9640 1 -- 172.21.15.117:0/515815312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec050e60 con 0x56412ab02570 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd4ff9640 1 -- 172.21.15.117:0/515815312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec011ce0 con 0x56412ab02570 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5cd4ff9640 1 -- 172.21.15.117:0/515815312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec030cd0 con 0x56412ab02570 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- 172.21.15.117:0/515815312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 msgr2=0x56412ab02950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 --2- 172.21.15.117:0/515815312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5dec04efd0 tx=0x7f5dec04e740 comp rx=0 tx=0).stop 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- 172.21.15.117:0/515815312 shutdown_connections 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 --2- 172.21.15.117:0/515815312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab02950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- 172.21.15.117:0/515815312 >> 172.21.15.117:0/515815312 conn(0x56412aafd930 msgr2=0x56412aafbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- 172.21.15.117:0/515815312 shutdown_connections 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- 172.21.15.117:0/515815312 wait complete. 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 Processor -- start 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- start start 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df36909c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56412ab012e0 con 0x56412ab02570 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42090/0 (socket says 172.21.15.117:42090) 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.789+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 learned_addr learned my addr 172.21.15.117:0/989642863 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412ab08da0 con 0x56412ab02570 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df1196640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5dec026aa0 tx=0x7f5dec046e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 -- 172.21.15.117:0/989642863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec06b020 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 -- 172.21.15.117:0/989642863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec010820 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 -- 172.21.15.117:0/989642863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dec04f150 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56412ab08da0 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412ab08da0 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 -- 172.21.15.117:0/989642863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5dec06e020 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cbc039a20 0x7f5cbc03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5cc6ffd640 1 -- 172.21.15.117:0/989642863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5dec061030 con 0x56412ab02570 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df0995640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cbc039a20 0x7f5cbc03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412ab13840 0x56412ab15cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab16420 con 0x56412ab13840 2024-09-10T06:22:51.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df1997640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412ab13840 0x56412ab15cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df0995640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cbc039a20 0x7f5cbc03bee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56412aae7750 tx=0x7f5de80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df1997640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412ab13840 0x56412ab15cd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40083f0 con 0x56412ab13840 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 20 realm 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.793+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab16830 con 0x56412ab13840 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40083f0 con 0x56412ab13840 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab17100 con 0x56412ab13840 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40083f0 con 0x56412ab13840 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5de40083f0 con 0x56412ab13840 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412ab18200 0x56412ab1a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1ac00 con 0x56412ab18200 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412ab18200 0x56412ab1a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412ab18200 0x56412ab1a5f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 20 searching for the correct realm 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412ab1cae0 0x56412ab1ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1f590 con 0x56412ab1cae0 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df0995640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412ab1cae0 0x56412ab1ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df0995640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412ab1cae0 0x56412ab1ef10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1f590 con 0x56412ab18200 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5dec070020 0x7f5dec0468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1f590 con 0x7f5dec070020 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5dec070020 0x7f5dec0468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5dec070020 0x7f5dec0468b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40083f0 con 0x7f5dec070020 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.797+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40083f0 con 0x56412ab13840 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab18200 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab18200 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.801+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab18200 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.805+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab18200 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab1cae0 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x7f5dec070020 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab13840 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56412ab174a0 con 0x56412ab18200 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1b450 con 0x56412ab13840 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1b840 con 0x56412ab13840 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1b840 con 0x56412ab1cae0 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 zone default found 2024-09-10T06:22:51.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 4 Realm: () 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 zonegroup default 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab1fa10 con 0x7f5dec070020 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab21560 con 0x56412ab1cae0 2024-09-10T06:22:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab219f0 con 0x56412ab1cae0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 started sync module instance, tier type = 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.809+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab208a0 con 0x56412ab18200 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837889174672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab20500 con 0x56412ab18200 2024-09-10T06:22:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab22920 con 0x56412ab13840 2024-09-10T06:22:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837889174672] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837889180784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab22d40 con 0x56412ab13840 2024-09-10T06:22:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.813+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab23590 con 0x56412ab1cae0 2024-09-10T06:22:51.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837889183344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab23e30 con 0x56412ab1cae0 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab24850 con 0x56412ab18200 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837889190976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab25510 con 0x56412ab18200 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab25ed0 con 0x56412ab13840 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.817+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837889190976] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.821+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837889180784] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.821+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837889183344] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.821+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.821+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837889186176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab229a0 con 0x56412ab13840 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.821+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab262c0 con 0x7f5dec070020 2024-09-10T06:22:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.825+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837889186176] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837889194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab26180 con 0x7f5dec070020 2024-09-10T06:22:51.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab26b40 con 0x7f5dec070020 2024-09-10T06:22:51.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837889194992] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837889192032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab26b40 con 0x7f5dec070020 2024-09-10T06:22:51.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.829+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab27500 con 0x7f5dec070020 2024-09-10T06:22:51.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837889192032] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837889198192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab27500 con 0x7f5dec070020 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=0 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=1 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=2 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=3 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=4 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=5 2024-09-10T06:22:51.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=6 2024-09-10T06:22:51.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837889198192] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 20 add_watcher() i=7 2024-09-10T06:22:51.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:51.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.833+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab2a870 con 0x56412ab13840 2024-09-10T06:22:51.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837889213024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab27670 con 0x56412ab13840 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837889213024] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5ca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 5 note: GC not initialized 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5ca67e4640 20 reqs_thread_entry: start 2024-09-10T06:22:51.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 Filter name: none 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5c17fff640 20 reqs_thread_entry: start 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4df40 con 0x56412ab13840 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4d960 con 0x56412ab18200 2024-09-10T06:22:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab54580 con 0x56412ab13840 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94837889384464 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4fde0 con 0x56412ab13840 2024-09-10T06:22:51.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94837889186176 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5de4010040 con 0x56412ab13840 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5cd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94837889186176 notifier 4325 bl.length()=567 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5cd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5cd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify cookie 94837889384464 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.837+0000 7f5cd4ff9640 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5cb4003eb0 con 0x56412ab13840 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94837889384464 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5de400adc0 con 0x56412ab13840 2024-09-10T06:22:51.844 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:51.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5ca77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:51.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837889213024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4fde0 con 0x56412ab13840 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94837889213024] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837889174672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4fde0 con 0x56412ab18200 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94837889174672] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df36909c0 20 remove_watcher() i=0 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df36909c0 2 removed watcher, disabling cache 2024-09-10T06:22:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.841+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837889180784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4fde0 con 0x56412ab13840 2024-09-10T06:22:51.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94837889180784] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df36909c0 20 remove_watcher() i=1 2024-09-10T06:22:51.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837889183344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab4fde0 con 0x56412ab1cae0 2024-09-10T06:22:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df0995640 1 -- 172.21.15.117:0/989642863 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94837889183344] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de80a9a70 con 0x56412ab1cae0 2024-09-10T06:22:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df36909c0 20 remove_watcher() i=2 2024-09-10T06:22:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.845+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837889190976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab2a260 con 0x56412ab18200 2024-09-10T06:22:51.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df1196640 1 -- 172.21.15.117:0/989642863 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94837889190976] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec064070 con 0x56412ab18200 2024-09-10T06:22:51.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df36909c0 20 remove_watcher() i=3 2024-09-10T06:22:51.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837889186176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab20c90 con 0x56412ab13840 2024-09-10T06:22:51.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94837889186176] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x56412ab13840 2024-09-10T06:22:51.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df36909c0 20 remove_watcher() i=4 2024-09-10T06:22:51.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.849+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837889194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab22470 con 0x7f5dec070020 2024-09-10T06:22:51.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94837889194992] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df36909c0 20 remove_watcher() i=5 2024-09-10T06:22:51.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837889192032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab2a260 con 0x7f5dec070020 2024-09-10T06:22:51.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94837889192032] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df36909c0 20 remove_watcher() i=6 2024-09-10T06:22:51.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.853+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837889198192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56412ab20c90 con 0x7f5dec070020 2024-09-10T06:22:51.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94837889198192] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de4026040 con 0x7f5dec070020 2024-09-10T06:22:51.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 20 remove_watcher() i=7 2024-09-10T06:22:51.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5dec070020 msgr2=0x7f5dec0468b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5dec070020 0x7f5dec0468b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412ab13840 msgr2=0x56412ab15cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412ab13840 0x56412ab15cd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412ab18200 msgr2=0x56412ab1a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412ab18200 0x56412ab1a5f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412ab1cae0 msgr2=0x56412ab1ef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412ab1cae0 0x56412ab1ef10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cbc039a20 msgr2=0x7f5cbc03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cbc039a20 0x7f5cbc03bee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56412aae7750 tx=0x7f5de80c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 msgr2=0x56412ab08840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df1997640 1 -- 172.21.15.117:0/989642863 reap_dead start 2024-09-10T06:22:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5dec026aa0 tx=0x7f5dec046e30 comp rx=0 tx=0).stop 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 shutdown_connections 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/989642863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412ab02570 0x56412ab08840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 >> 172.21.15.117:0/989642863 conn(0x56412aafd930 msgr2=0x56412aafbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 shutdown_connections 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/989642863 wait complete. 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 msgr2=0x7f5cc803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 0x7f5cc803be90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5de8000c10 tx=0x7f5de8005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 msgr2=0x56412aaf5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0411c0 tx=0x7f5dec01c650 comp rx=0 tx=0).stop 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 shutdown_connections 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cc80399d0 0x7f5cc803be90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/1162778973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412aaf4e10 0x56412aaf5230 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 >> 172.21.15.117:0/1162778973 conn(0x56412aaea7c0 msgr2=0x56412aaeaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 shutdown_connections 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/1162778973 wait complete. 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412a9e88c0 msgr2=0x56412aade1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56412a9e88c0 0x56412aade1c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412aae0910 msgr2=0x56412aae2d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56412aae0910 0x56412aae2d00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412aae4810 msgr2=0x56412aae6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56412aae4810 0x56412aae6c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd8039a70 msgr2=0x7f5cd803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5cd8039a70 0x7f5cd803bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ad000 tx=0x7f5de80a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 msgr2=0x56412aad7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 --2- 172.21.15.117:0/2556726725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56412a9e4770 0x56412aad7050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x56412aad09a0 tx=0x7f5dec000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df1997640 1 -- 172.21.15.117:0/2556726725 reap_dead start 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 shutdown_connections 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 >> 172.21.15.117:0/2556726725 conn(0x56412a958080 msgr2=0x56412aaca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 shutdown_connections 2024-09-10T06:22:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.857+0000 7f5df36909c0 1 -- 172.21.15.117:0/2556726725 wait complete. 2024-09-10T06:22:51.868 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:51.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:51.869 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:51.938 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:51.938 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:51.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f35574529c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d7f403a8c0 0x55d7f403ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f35574529c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7f3eea9c0 con 0x55d7f3faa770 2024-09-10T06:22:51.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f35574529c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55d7f3f3a6d0 con 0x55d7f403a8c0 2024-09-10T06:22:51.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f3554757640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d7f403a8c0 0x55d7f403ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f3554757640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d7f403a8c0 0x55d7f403ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42106/0 (socket says 172.21.15.117:42106) 2024-09-10T06:22:51.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f3554757640 1 -- 172.21.15.117:0/2818445186 learned_addr learned my addr 172.21.15.117:0/2818445186 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f3554757640 1 -- 172.21.15.117:0/2818445186 >> v1:172.21.15.84:6789/0 conn(0x55d7f3faa770 legacy=0x55d7f40391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.937+0000 7f3554757640 1 -- 172.21.15.117:0/2818445186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f3edeca0 con 0x55d7f403a8c0 2024-09-10T06:22:51.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f3554757640 1 --2- 172.21.15.117:0/2818445186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f403a8c0 0x55d7f403ccb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f354800a5c0 tx=0x7f354801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ad8690980836a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f3553f56640 1 -- 172.21.15.117:0/2818445186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35480b1070 con 0x55d7f403a8c0 2024-09-10T06:22:51.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f3553f56640 1 -- 172.21.15.117:0/2818445186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35480a8070 con 0x55d7f403a8c0 2024-09-10T06:22:51.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f3553f56640 1 -- 172.21.15.117:0/2818445186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35480ac5b0 con 0x55d7f403a8c0 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 -- 172.21.15.117:0/2818445186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f403a8c0 msgr2=0x55d7f403ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 --2- 172.21.15.117:0/2818445186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f403a8c0 0x55d7f403ccb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f354800a5c0 tx=0x7f354801b340 comp rx=0 tx=0).stop 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 -- 172.21.15.117:0/2818445186 shutdown_connections 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 --2- 172.21.15.117:0/2818445186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f403a8c0 0x55d7f403ccb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 -- 172.21.15.117:0/2818445186 >> 172.21.15.117:0/2818445186 conn(0x55d7f4030e90 msgr2=0x55d7f40332b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 -- 172.21.15.117:0/2818445186 shutdown_connections 2024-09-10T06:22:51.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.941+0000 7f35574529c0 1 -- 172.21.15.117:0/2818445186 wait complete. 2024-09-10T06:22:51.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.953+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.953+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.953+0000 7f35574529c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.953+0000 7f35574529c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3f3e680 con 0x55d7f3faa770 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42118/0 (socket says 172.21.15.117:42118) 2024-09-10T06:22:51.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 -- 172.21.15.117:0/3269523497 learned_addr learned my addr 172.21.15.117:0/3269523497 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 -- 172.21.15.117:0/3269523497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f3eb9da0 con 0x55d7f3faa770 2024-09-10T06:22:51.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- 172.21.15.117:0/3269523497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f354400b2d0 tx=0x7f354400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a624ce8c5c581014 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3442e0d640 1 -- 172.21.15.117:0/3269523497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354400a040 con 0x55d7f3faa770 2024-09-10T06:22:51.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3442e0d640 1 -- 172.21.15.117:0/3269523497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354400f750 con 0x55d7f3faa770 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3442e0d640 1 -- 172.21.15.117:0/3269523497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354400fa70 con 0x55d7f3faa770 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/3269523497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 msgr2=0x55d7f40366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 --2- 172.21.15.117:0/3269523497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f354400b2d0 tx=0x7f354400b790 comp rx=0 tx=0).stop 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/3269523497 shutdown_connections 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 --2- 172.21.15.117:0/3269523497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f40366a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/3269523497 >> 172.21.15.117:0/3269523497 conn(0x55d7f4030e90 msgr2=0x55d7f411d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/3269523497 shutdown_connections 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/3269523497 wait complete. 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f412b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3ee0a50 con 0x55d7f3faa770 2024-09-10T06:22:51.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f412b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f412b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42124/0 (socket says 172.21.15.117:42124) 2024-09-10T06:22:51.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 -- 172.21.15.117:0/42511138 learned_addr learned my addr 172.21.15.117:0/42511138 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f412b6f0 con 0x55d7f3faa770 2024-09-10T06:22:51.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f3554f58640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f412b190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3544000c10 tx=0x7f3544000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f344160a640 1 -- 172.21.15.117:0/42511138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354401c9f0 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f412b980 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f412c330 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f344160a640 1 -- 172.21.15.117:0/42511138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354401cb90 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.957+0000 7f344160a640 1 -- 172.21.15.117:0/42511138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354402c060 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f344160a640 1 -- 172.21.15.117:0/42511138 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3544017050 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f344160a640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f343c039a70 0x7f343c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f344160a640 1 -- 172.21.15.117:0/42511138 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3544015020 con 0x55d7f3faa770 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554757640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f343c039a70 0x7f343c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f403a8c0 0x55d7f4132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4132840 con 0x55d7f403a8c0 2024-09-10T06:22:51.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3555759640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f403a8c0 0x55d7f4132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554757640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f343c039a70 0x7f343c03bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35480ae000 tx=0x7f35480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3555759640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f403a8c0 0x55d7f4132300 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3555759640 1 -- 172.21.15.117:0/42511138 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f403a8c0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4132c90 con 0x55d7f403a8c0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3555759640 1 -- 172.21.15.117:0/42511138 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f403a8c0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f4134aa0 0x55d7f4136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4137580 con 0x55d7f4134aa0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554f58640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f4134aa0 0x55d7f4136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554f58640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f4134aa0 0x55d7f4136e90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554f58640 1 -- 172.21.15.117:0/42511138 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3544046420 con 0x55d7f4134aa0 2024-09-10T06:22:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4133940 con 0x55d7f403a8c0 2024-09-10T06:22:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3555759640 1 -- 172.21.15.117:0/42511138 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f403a8c0 2024-09-10T06:22:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f41389e0 0x55d7f413add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f413b510 con 0x55d7f41389e0 2024-09-10T06:22:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.961+0000 7f3554757640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f41389e0 0x55d7f413add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554757640 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f41389e0 0x55d7f413add0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554757640 1 -- 172.21.15.117:0/42511138 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35480b4040 con 0x55d7f41389e0 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7f3f4b450 con 0x55d7f4149010 2024-09-10T06:22:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42138/0 (socket says 172.21.15.117:42138) 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554f58640 1 -- 172.21.15.117:0/794058280 learned_addr learned my addr 172.21.15.117:0/794058280 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554f58640 1 -- 172.21.15.117:0/794058280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f4149a70 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f3554f58640 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f354402fda0 tx=0x7f354400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f343a7fc640 1 -- 172.21.15.117:0/794058280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354402fb70 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f414a2d0 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f343a7fc640 1 -- 172.21.15.117:0/794058280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3544044040 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f414a840 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f343a7fc640 1 -- 172.21.15.117:0/794058280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3544050ce0 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.965+0000 7f343a7fc640 1 -- 172.21.15.117:0/794058280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f354400e370 con 0x55d7f4149010 2024-09-10T06:22:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f343a7fc640 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 0x7f342c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f343a7fc640 1 -- 172.21.15.117:0/794058280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3544038070 con 0x55d7f4149010 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554757640 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 0x7f342c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554757640 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 0x7f342c03bee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55d7f412c650 tx=0x7f3548005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7f4036ef0 con 0x55d7f4156780 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42142/0 (socket says 172.21.15.117:42142) 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 -- 172.21.15.117:0/4224963573 learned_addr learned my addr 172.21.15.117:0/4224963573 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 -- 172.21.15.117:0/4224963573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f4157170 con 0x55d7f4156780 2024-09-10T06:22:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 --2- 172.21.15.117:0/4224963573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f354402ff20 tx=0x7f3544031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b1fe0446732470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f342bfff640 1 -- 172.21.15.117:0/4224963573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354403c420 con 0x55d7f4156780 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f342bfff640 1 -- 172.21.15.117:0/4224963573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354403c5e0 con 0x55d7f4156780 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f342bfff640 1 -- 172.21.15.117:0/4224963573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3544031cd0 con 0x55d7f4156780 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- 172.21.15.117:0/4224963573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 msgr2=0x55d7f4156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 --2- 172.21.15.117:0/4224963573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f354402ff20 tx=0x7f3544031b90 comp rx=0 tx=0).stop 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- 172.21.15.117:0/4224963573 shutdown_connections 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 --2- 172.21.15.117:0/4224963573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f4156b80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- 172.21.15.117:0/4224963573 >> 172.21.15.117:0/4224963573 conn(0x55d7f4151b40 msgr2=0x55d7f414fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- 172.21.15.117:0/4224963573 shutdown_connections 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- 172.21.15.117:0/4224963573 wait complete. 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 Processor -- start 2024-09-10T06:22:51.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- start start 2024-09-10T06:22:51.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f35574529c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7f41554f0 con 0x55d7f4156780 2024-09-10T06:22:51.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42148/0 (socket says 172.21.15.117:42148) 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 learned_addr learned my addr 172.21.15.117:0/3376118791 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.969+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f415cfd0 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3554f58640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f354402ff20 tx=0x7f3544010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 -- 172.21.15.117:0/3376118791 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3544072020 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f415cfd0 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 -- 172.21.15.117:0/3376118791 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354400e840 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 -- 172.21.15.117:0/3376118791 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354406a040 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f415cfd0 con 0x55d7f4156780 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 -- 172.21.15.117:0/3376118791 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3544075020 con 0x55d7f4156780 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3420039a20 0x7f342003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f342a7fc640 1 -- 172.21.15.117:0/3376118791 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f3544078ab0 con 0x55d7f4156780 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3554757640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3420039a20 0x7f342003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f4167bc0 0x55d7f416a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416a7a0 con 0x55d7f4167bc0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f4167bc0 0x55d7f416a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f4167bc0 0x55d7f416a050 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3554757640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3420039a20 0x7f342003bee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f354801b380 tx=0x7f35480a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 realm 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416abb0 con 0x55d7f4167bc0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b480 con 0x55d7f4167bc0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f416c350 0x55d7f416e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416ee80 con 0x55d7f416c350 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3554f58640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f416c350 0x55d7f416e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.973+0000 7f3554f58640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f416c350 0x55d7f416e740 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f35574529c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f35574529c0 20 searching for the correct realm 2024-09-10T06:22:51.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f4170e20 0x55d7f41732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4173990 con 0x55d7f4170e20 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554757640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f4170e20 0x55d7f41732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554757640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f4170e20 0x55d7f41732c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4173990 con 0x55d7f416c350 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554f58640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3544077020 0x7f35440193e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4173990 con 0x7f3544077020 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3544077020 0x7f35440193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3544077020 0x7f35440193e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.977+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f416c350 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f416c350 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.981+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f416c350 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:51.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f416c350 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.985+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4170e20 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x7f3544077020 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f4167bc0 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416b820 con 0x55d7f416c350 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416f740 con 0x55d7f4167bc0 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416fb30 con 0x55d7f4167bc0 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f416fb30 con 0x55d7f4170e20 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 zone default found 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 4 Realm: () 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 zonegroup default 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4173e10 con 0x7f3544077020 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175800 con 0x55d7f4170e20 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175ba0 con 0x55d7f4170e20 2024-09-10T06:22:52.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.989+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4174ca0 con 0x55d7f416c350 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94386001498256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f41763f0 con 0x55d7f416c350 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4176c40 con 0x55d7f4167bc0 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94386001498256] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94386001502016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4176c40 con 0x55d7f4167bc0 2024-09-10T06:22:52.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.993+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4177600 con 0x55d7f4170e20 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94386001506640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4177ed0 con 0x55d7f4170e20 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f41788f0 con 0x55d7f416c350 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94386001511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4179190 con 0x55d7f416c350 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4179b90 con 0x55d7f4167bc0 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:51.997+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94386001511392] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.001+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94386001502016] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.001+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94386001506640] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.001+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.001+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94386001508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f41796a0 con 0x55d7f4167bc0 2024-09-10T06:22:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.001+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4179190 con 0x7f3544077020 2024-09-10T06:22:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.005+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94386001508896] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.009+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.009+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94386001504144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4179190 con 0x7f3544077020 2024-09-10T06:22:52.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.009+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417a3b0 con 0x7f3544077020 2024-09-10T06:22:52.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.013+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94386001504144] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94386001513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417a5b0 con 0x7f3544077020 2024-09-10T06:22:52.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417ae00 con 0x7f3544077020 2024-09-10T06:22:52.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94386001520528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417b1a0 con 0x7f3544077020 2024-09-10T06:22:52.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=0 2024-09-10T06:22:52.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=1 2024-09-10T06:22:52.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=2 2024-09-10T06:22:52.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=3 2024-09-10T06:22:52.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=4 2024-09-10T06:22:52.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.017+0000 7f35574529c0 20 add_watcher() i=5 2024-09-10T06:22:52.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94386001513696] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 add_watcher() i=6 2024-09-10T06:22:52.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94386001520528] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 add_watcher() i=7 2024-09-10T06:22:52.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417a0e0 con 0x55d7f4167bc0 2024-09-10T06:22:52.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94386001521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f417a0e0 con 0x55d7f4167bc0 2024-09-10T06:22:52.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94386001521712] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f340afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 5 note: GC not initialized 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f3409fe3640 20 reqs_thread_entry: start 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 Filter name: none 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f337b7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.021+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7f41a1350 con 0x55d7f4167bc0 2024-09-10T06:22:52.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:52.027 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f340afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94386001521712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f41a01a0 con 0x55d7f4167bc0 2024-09-10T06:22:52.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94386001521712] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94386001498256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f419fcf0 con 0x55d7f416c350 2024-09-10T06:22:52.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94386001498256] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 20 remove_watcher() i=0 2024-09-10T06:22:52.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.025+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94386001502016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175090 con 0x55d7f4167bc0 2024-09-10T06:22:52.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94386001502016] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f35574529c0 20 remove_watcher() i=1 2024-09-10T06:22:52.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94386001506640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175090 con 0x55d7f4170e20 2024-09-10T06:22:52.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f3554757640 1 -- 172.21.15.117:0/3376118791 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94386001506640] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35480d9070 con 0x55d7f4170e20 2024-09-10T06:22:52.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f35574529c0 20 remove_watcher() i=2 2024-09-10T06:22:52.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.029+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94386001511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175f40 con 0x55d7f416c350 2024-09-10T06:22:52.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f3554f58640 1 -- 172.21.15.117:0/3376118791 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94386001511392] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3544046420 con 0x55d7f416c350 2024-09-10T06:22:52.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f35574529c0 20 remove_watcher() i=3 2024-09-10T06:22:52.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94386001508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175f40 con 0x55d7f4167bc0 2024-09-10T06:22:52.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94386001508896] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x55d7f4167bc0 2024-09-10T06:22:52.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f35574529c0 20 remove_watcher() i=4 2024-09-10T06:22:52.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.033+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94386001504144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4177a20 con 0x7f3544077020 2024-09-10T06:22:52.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94386001504144] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f35574529c0 20 remove_watcher() i=5 2024-09-10T06:22:52.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94386001513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4175f40 con 0x7f3544077020 2024-09-10T06:22:52.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94386001513696] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f35574529c0 20 remove_watcher() i=6 2024-09-10T06:22:52.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94386001520528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7f4176790 con 0x7f3544077020 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.037+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94386001520528] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f354c00a4d0 con 0x7f3544077020 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 20 remove_watcher() i=7 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3544077020 msgr2=0x7f35440193e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3544077020 0x7f35440193e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f4167bc0 msgr2=0x55d7f416a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f4167bc0 0x55d7f416a050 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f416c350 msgr2=0x55d7f416e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f416c350 0x55d7f416e740 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f4170e20 msgr2=0x55d7f41732c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f4170e20 0x55d7f41732c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3420039a20 msgr2=0x7f342003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3420039a20 0x7f342003bee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f354801b380 tx=0x7f35480a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 msgr2=0x55d7f415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f3555759640 1 -- 172.21.15.117:0/3376118791 reap_dead start 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f354402ff20 tx=0x7f3544010ea0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 shutdown_connections 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/3376118791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4156780 0x55d7f415ca70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 >> 172.21.15.117:0/3376118791 conn(0x55d7f4151b40 msgr2=0x55d7f414fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 shutdown_connections 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/3376118791 wait complete. 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 msgr2=0x7f342c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 0x7f342c03bee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55d7f412c650 tx=0x7f3548005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 msgr2=0x55d7f4149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f354402fda0 tx=0x7f354400ee50 comp rx=0 tx=0).stop 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 shutdown_connections 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f342c039a20 0x7f342c03bee0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/794058280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f4149010 0x55d7f4149430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 >> 172.21.15.117:0/794058280 conn(0x55d7f413e9c0 msgr2=0x55d7f413eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 shutdown_connections 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/794058280 wait complete. 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f403a8c0 msgr2=0x55d7f4132300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d7f403a8c0 0x55d7f4132300 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f4134aa0 msgr2=0x55d7f4136e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d7f4134aa0 0x55d7f4136e90 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f41389e0 msgr2=0x55d7f413add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d7f41389e0 0x55d7f413add0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f343c039a70 msgr2=0x7f343c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f343c039a70 0x7f343c03bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35480ae000 tx=0x7f35480a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 msgr2=0x55d7f412b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 --2- 172.21.15.117:0/42511138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7f3faa770 0x55d7f412b190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3544000c10 tx=0x7f3544000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f3555759640 1 -- 172.21.15.117:0/42511138 reap_dead start 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 shutdown_connections 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 >> 172.21.15.117:0/42511138 conn(0x55d7f4030e90 msgr2=0x55d7f40353c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 shutdown_connections 2024-09-10T06:22:52.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.041+0000 7f35574529c0 1 -- 172.21.15.117:0/42511138 wait complete. 2024-09-10T06:22:52.052 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T06:22:52.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T06:22:52.052 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-10T06:22:52.126 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:52.127 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ec64b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55793a55c850 0x55793a55ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ec64b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55793a40a9c0 con 0x55793a558700 2024-09-10T06:22:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ec64b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55793a45a6d0 con 0x55793a55c850 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99e9950640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55793a55c850 0x55793a55ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ea151640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55793a558700 0x55793a558ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44222/0 (socket says 172.21.15.117:44222) 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99e9950640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55793a55c850 0x55793a55ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42158/0 (socket says 172.21.15.117:42158) 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99ea151640 1 -- 172.21.15.117:0/1891050773 learned_addr learned my addr 172.21.15.117:0/1891050773 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99e9950640 1 -- 172.21.15.117:0/1891050773 >> v1:172.21.15.84:6789/0 conn(0x55793a558700 legacy=0x55793a558ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.125+0000 7f99e9950640 1 -- 172.21.15.117:0/1891050773 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a3feca0 con 0x55793a55c850 2024-09-10T06:22:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99e9950640 1 --2- 172.21.15.117:0/1891050773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a55c850 0x55793a55ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99d400a480 tx=0x7f99d401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1a8ed9b6c944af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99e914f640 1 -- 172.21.15.117:0/1891050773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d40aa570 con 0x55793a55c850 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99e914f640 1 -- 172.21.15.117:0/1891050773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d40af070 con 0x55793a55c850 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99e914f640 1 -- 172.21.15.117:0/1891050773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d40aa860 con 0x55793a55c850 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1891050773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a55c850 msgr2=0x55793a55ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1891050773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a55c850 0x55793a55ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99d400a480 tx=0x7f99d401b310 comp rx=0 tx=0).stop 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1891050773 shutdown_connections 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1891050773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a55c850 0x55793a55ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1891050773 >> 172.21.15.117:0/1891050773 conn(0x55793a4cc010 msgr2=0x55793a4cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1891050773 shutdown_connections 2024-09-10T06:22:52.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.129+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1891050773 wait complete. 2024-09-10T06:22:52.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55793a45e680 con 0x55793a558700 2024-09-10T06:22:52.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42174/0 (socket says 172.21.15.117:42174) 2024-09-10T06:22:52.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 -- 172.21.15.117:0/2332596125 learned_addr learned my addr 172.21.15.117:0/2332596125 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 -- 172.21.15.117:0/2332596125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a3d9da0 con 0x55793a558700 2024-09-10T06:22:52.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 --2- 172.21.15.117:0/2332596125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0017b0 tx=0x7f99dc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df478dfe28749c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f98d8608640 1 -- 172.21.15.117:0/2332596125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc0044f0 con 0x55793a558700 2024-09-10T06:22:52.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f98d8608640 1 -- 172.21.15.117:0/2332596125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0046b0 con 0x55793a558700 2024-09-10T06:22:52.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f98d8608640 1 -- 172.21.15.117:0/2332596125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc004a10 con 0x55793a558700 2024-09-10T06:22:52.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2332596125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 msgr2=0x55793a643a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/2332596125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0017b0 tx=0x7f99dc001c70 comp rx=0 tx=0).stop 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2332596125 shutdown_connections 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/2332596125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a643a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2332596125 >> 172.21.15.117:0/2332596125 conn(0x55793a4cc010 msgr2=0x55793a63f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2332596125 shutdown_connections 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2332596125 wait complete. 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a64b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ec64b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55793a400a50 con 0x55793a558700 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a64b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a64b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42178/0 (socket says 172.21.15.117:42178) 2024-09-10T06:22:52.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.145+0000 7f99ea151640 1 -- 172.21.15.117:0/1123289415 learned_addr learned my addr 172.21.15.117:0/1123289415 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea151640 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a64b680 con 0x55793a558700 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea151640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a64b120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0012f0 tx=0x7f99dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 -- 172.21.15.117:0/1123289415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc013820 con 0x55793a558700 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55793a64b910 con 0x55793a558700 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 -- 172.21.15.117:0/1123289415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0139c0 con 0x55793a558700 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793a64c2c0 con 0x55793a558700 2024-09-10T06:22:52.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 -- 172.21.15.117:0/1123289415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc013ca0 con 0x55793a558700 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 -- 172.21.15.117:0/1123289415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99dc010070 con 0x55793a558700 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98d0039a70 0x7f98d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f98d6e05640 1 -- 172.21.15.117:0/1123289415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f99dc018070 con 0x55793a558700 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99e9950640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98d0039a70 0x7f98d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a55c850 0x55793a652290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6527d0 con 0x55793a55c850 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea952640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a55c850 0x55793a652290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99e9950640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98d0039a70 0x7f98d003bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f99d40ae000 tx=0x7f99d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea952640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a55c850 0x55793a652290 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea952640 1 -- 172.21.15.117:0/1123289415 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a55c850 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a64c630 con 0x55793a55c850 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea952640 1 -- 172.21.15.117:0/1123289415 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a55c850 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a654a70 0x55793a656e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a657530 con 0x55793a654a70 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.149+0000 7f99ea151640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a654a70 0x55793a656e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a654a70 0x55793a656e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 -- 172.21.15.117:0/1123289415 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a654a70 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a653910 con 0x55793a55c850 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea952640 1 -- 172.21.15.117:0/1123289415 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a55c850 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a658970 0x55793a65ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a65b4f0 con 0x55793a658970 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99e9950640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a658970 0x55793a65ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99e9950640 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a658970 0x55793a65ad60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99e9950640 1 -- 172.21.15.117:0/1123289415 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a658970 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55793a46b450 con 0x55793a668fb0 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42180/0 (socket says 172.21.15.117:42180) 2024-09-10T06:22:52.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 -- 172.21.15.117:0/1682107122 learned_addr learned my addr 172.21.15.117:0/1682107122 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 -- 172.21.15.117:0/1682107122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a669a10 con 0x55793a668fb0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ea151640 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0104d0 tx=0x7f99dc029f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f98cffff640 1 -- 172.21.15.117:0/1682107122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc047070 con 0x55793a668fb0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55793a66a270 con 0x55793a668fb0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f98cffff640 1 -- 172.21.15.117:0/1682107122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0123c0 con 0x55793a668fb0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f98cffff640 1 -- 172.21.15.117:0/1682107122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc012570 con 0x55793a668fb0 2024-09-10T06:22:52.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.153+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793a66a7e0 con 0x55793a668fb0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cffff640 1 -- 172.21.15.117:0/1682107122 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99dc012710 con 0x55793a668fb0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cffff640 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 0x7f98c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cffff640 1 -- 172.21.15.117:0/1682107122 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f99dc005070 con 0x55793a668fb0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99e9950640 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 0x7f98c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99e9950640 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 0x7f98c403bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99d40aa650 tx=0x7f99d4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55793a6442d0 con 0x55793a6766f0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42192/0 (socket says 172.21.15.117:42192) 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ea151640 1 -- 172.21.15.117:0/2426151319 learned_addr learned my addr 172.21.15.117:0/2426151319 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ea151640 1 -- 172.21.15.117:0/2426151319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a6770e0 con 0x55793a6766f0 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ea151640 1 --2- 172.21.15.117:0/2426151319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f99dc02bff0 tx=0x7f99dc0354b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8297a26057ee613f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cdffb640 1 -- 172.21.15.117:0/2426151319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc04e120 con 0x55793a6766f0 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cdffb640 1 -- 172.21.15.117:0/2426151319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc04b3f0 con 0x55793a6766f0 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f98cdffb640 1 -- 172.21.15.117:0/2426151319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc014cb0 con 0x55793a6766f0 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2426151319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 msgr2=0x55793a676af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/2426151319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f99dc02bff0 tx=0x7f99dc0354b0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2426151319 shutdown_connections 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/2426151319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a676af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2426151319 >> 172.21.15.117:0/2426151319 conn(0x55793a671b10 msgr2=0x55793a66fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2426151319 shutdown_connections 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/2426151319 wait complete. 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 Processor -- start 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.157+0000 7f99ec64b9c0 1 -- start start 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55793a6754c0 con 0x55793a6766f0 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42196/0 (socket says 172.21.15.117:42196) 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 learned_addr learned my addr 172.21.15.117:0/1139984436 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793a67cf60 con 0x55793a6766f0 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea151640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99dc01d760 tx=0x7f99dc045f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 -- 172.21.15.117:0/1139984436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc04e120 con 0x55793a6766f0 2024-09-10T06:22:52.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55793a67cf60 con 0x55793a6766f0 2024-09-10T06:22:52.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 -- 172.21.15.117:0/1139984436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc06b070 con 0x55793a6766f0 2024-09-10T06:22:52.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793a67cf60 con 0x55793a6766f0 2024-09-10T06:22:52.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 -- 172.21.15.117:0/1139984436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc007340 con 0x55793a6766f0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 -- 172.21.15.117:0/1139984436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99dc041d10 con 0x55793a6766f0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98b4039a70 0x7f98b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f98bbfff640 1 -- 172.21.15.117:0/1139984436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f99dc071b20 con 0x55793a6766f0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99e9950640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98b4039a70 0x7f98b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a687bd0 0x55793a68a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68a7b0 con 0x55793a687bd0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea952640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a687bd0 0x55793a68a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99e9950640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98b4039a70 0x7f98b403bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99d40cd040 tx=0x7f99d40a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea952640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a687bd0 0x55793a68a060 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a687bd0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 20 realm 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.161+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68abc0 con 0x55793a687bd0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a687bd0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b490 con 0x55793a687bd0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a687bd0 2024-09-10T06:22:52.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a687bd0 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a68c590 0x55793a68e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68efd0 con 0x55793a68c590 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a68c590 0x55793a68e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a68c590 0x55793a68e980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 20 searching for the correct realm 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a690eb0 0x55793a6932e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a693960 con 0x55793a690eb0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99e9950640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a690eb0 0x55793a6932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99e9950640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a690eb0 0x55793a6932e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a693960 con 0x55793a68c590 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f99dc066050 0x7f99dc0648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68efd0 con 0x7f99dc066050 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f99dc066050 0x7f99dc0648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f99dc066050 0x7f99dc0648a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e40083f0 con 0x7f99dc066050 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.165+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e40083f0 con 0x55793a687bd0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a68c590 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a68c590 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.169+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a68c590 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.173+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a68c590 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a690eb0 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a687bd0 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55793a68b830 con 0x55793a68c590 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68f480 con 0x55793a687bd0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68f870 con 0x55793a687bd0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a68f870 con 0x55793a690eb0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 zone default found 2024-09-10T06:22:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 4 Realm: () 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 zonegroup default 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.177+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a690190 con 0x7f99dc066050 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6957d0 con 0x55793a690eb0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a695b70 con 0x55793a690eb0 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a694c70 con 0x55793a68c590 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93979159384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a694c70 con 0x55793a68c590 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696530 con 0x55793a687bd0 2024-09-10T06:22:52.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93979159384208] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93979159382224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696530 con 0x55793a687bd0 2024-09-10T06:22:52.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.181+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696ef0 con 0x55793a690eb0 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.185+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93979159382224] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93979159388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6964a0 con 0x55793a690eb0 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a697c30 con 0x55793a68c590 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93979159394112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6984d0 con 0x55793a68c590 2024-09-10T06:22:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a698ed0 con 0x55793a687bd0 2024-09-10T06:22:52.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93979159394112] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.189+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93979159388288] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.193+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.193+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93979159392912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a698020 con 0x55793a687bd0 2024-09-10T06:22:52.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.193+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a699770 con 0x7f99dc066050 2024-09-10T06:22:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93979159392912] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93979159398880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a698020 con 0x7f99dc066050 2024-09-10T06:22:52.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a699c00 con 0x7f99dc066050 2024-09-10T06:22:52.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93979159402256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a69a020 con 0x7f99dc066050 2024-09-10T06:22:52.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.197+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a69ab00 con 0x7f99dc066050 2024-09-10T06:22:52.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93979159398880] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93979159402256] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93979159406000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6990a0 con 0x7f99dc066050 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=0 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=1 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=2 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=3 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=4 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=5 2024-09-10T06:22:52.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.201+0000 7f99ec64b9c0 20 add_watcher() i=6 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93979159406000] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 add_watcher() i=7 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a69daf0 con 0x55793a687bd0 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93979159403312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a69af70 con 0x55793a687bd0 2024-09-10T06:22:52.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93979159403312] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f98a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 5 note: GC not initialized 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f989b7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 Filter name: none 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f98997fa640 20 reqs_thread_entry: start 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c10a0 con 0x55793a687bd0 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:52.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:52.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:52.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T06:22:52.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c1b10 con 0x7f99dc066050 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.205+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c78e0 con 0x55793a687bd0 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93979159589712 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c2fd0 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 93979159392912 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f99e4010040 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f98cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93979159392912 notifier 4339 bl.length()=678 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f98cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f98cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify cookie 93979159589712 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f98cdffb640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f98b0003eb0 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 93979159589712 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99e400aad0 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c7350 con 0x7f99dc066050 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.209+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93979159589712 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c2b20 con 0x55793a690eb0 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 93979159388288 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55793a3feca0 con 0x55793a690eb0 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f98cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 93979159388288 notifier 4339 bl.length()=177 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f98cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f98cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f98cdffb640 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f98b0003eb0 con 0x55793a690eb0 2024-09-10T06:22:52.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 notify.2 [notify cookie 93979159589712 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== watch-notify(notify_complete (2) cookie 93979159589712 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99d40e3570 con 0x55793a690eb0 2024-09-10T06:22:52.216 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T06:22:52.210760Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f98a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93979159403312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a6c2f50 con 0x55793a687bd0 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93979159403312] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93979159384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a699b30 con 0x55793a68c590 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93979159384208] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ec64b9c0 20 remove_watcher() i=0 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ec64b9c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.213+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93979159382224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a695090 con 0x55793a687bd0 2024-09-10T06:22:52.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93979159382224] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99ec64b9c0 20 remove_watcher() i=1 2024-09-10T06:22:52.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93979159388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a699b30 con 0x55793a690eb0 2024-09-10T06:22:52.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99e9950640 1 -- 172.21.15.117:0/1139984436 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93979159388288] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d40a8070 con 0x55793a690eb0 2024-09-10T06:22:52.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99ec64b9c0 20 remove_watcher() i=2 2024-09-10T06:22:52.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.217+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93979159394112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696080 con 0x55793a68c590 2024-09-10T06:22:52.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ea151640 1 -- 172.21.15.117:0/1139984436 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93979159394112] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc01b030 con 0x55793a68c590 2024-09-10T06:22:52.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ec64b9c0 20 remove_watcher() i=3 2024-09-10T06:22:52.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93979159392912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a699b30 con 0x55793a687bd0 2024-09-10T06:22:52.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93979159392912] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x55793a687bd0 2024-09-10T06:22:52.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ec64b9c0 20 remove_watcher() i=4 2024-09-10T06:22:52.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93979159398880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696080 con 0x7f99dc066050 2024-09-10T06:22:52.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.221+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93979159398880] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.225+0000 7f99ec64b9c0 20 remove_watcher() i=5 2024-09-10T06:22:52.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.225+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93979159402256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a697290 con 0x7f99dc066050 2024-09-10T06:22:52.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.225+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93979159402256] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.225+0000 7f99ec64b9c0 20 remove_watcher() i=6 2024-09-10T06:22:52.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.225+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93979159406000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55793a696080 con 0x7f99dc066050 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93979159406000] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99e4026040 con 0x7f99dc066050 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 20 remove_watcher() i=7 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f99dc066050 msgr2=0x7f99dc0648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f99dc066050 0x7f99dc0648a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a687bd0 msgr2=0x55793a68a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a687bd0 0x55793a68a060 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a68c590 msgr2=0x55793a68e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a68c590 0x55793a68e980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a690eb0 msgr2=0x55793a6932e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a690eb0 0x55793a6932e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98b4039a70 msgr2=0x7f98b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98b4039a70 0x7f98b403bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99d40cd040 tx=0x7f99d40a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ea952640 1 -- 172.21.15.117:0/1139984436 reap_dead start 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 msgr2=0x55793a67ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f99dc01d760 tx=0x7f99dc045f70 comp rx=0 tx=0).stop 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 shutdown_connections 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1139984436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a6766f0 0x55793a67ca00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 >> 172.21.15.117:0/1139984436 conn(0x55793a671b10 msgr2=0x55793a66fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 shutdown_connections 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1139984436 wait complete. 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 msgr2=0x7f98c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 0x7f98c403bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99d40aa650 tx=0x7f99d4005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 msgr2=0x55793a6693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0104d0 tx=0x7f99dc029f90 comp rx=0 tx=0).stop 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 shutdown_connections 2024-09-10T06:22:52.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98c4039a70 0x7f98c403bf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1682107122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a668fb0 0x55793a6693d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 >> 172.21.15.117:0/1682107122 conn(0x55793a65e960 msgr2=0x55793a65ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 shutdown_connections 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1682107122 wait complete. 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a55c850 msgr2=0x55793a652290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55793a55c850 0x55793a652290 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a654a70 msgr2=0x55793a656e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55793a654a70 0x55793a656e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a658970 msgr2=0x55793a65ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55793a658970 0x55793a65ad60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98d0039a70 msgr2=0x7f98d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f98d0039a70 0x7f98d003bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f99d40ae000 tx=0x7f99d40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 msgr2=0x55793a64b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 --2- 172.21.15.117:0/1123289415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55793a558700 0x55793a64b120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0012f0 tx=0x7f99dc000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ea952640 1 -- 172.21.15.117:0/1123289415 reap_dead start 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 shutdown_connections 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 >> 172.21.15.117:0/1123289415 conn(0x55793a4cc010 msgr2=0x55793a63e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 shutdown_connections 2024-09-10T06:22:52.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.229+0000 7f99ec64b9c0 1 -- 172.21.15.117:0/1123289415 wait complete. 2024-09-10T06:22:52.240 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T06:22:52.210760Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:52.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:52.240 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:52.309 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:52.309 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:52.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7ea075d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b1225d6370 0x55b1225d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7ea075d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b12248b9c0 con 0x55b1225d9550 2024-09-10T06:22:52.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7ea075d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55b1224db6d0 con 0x55b1225d6370 2024-09-10T06:22:52.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7e9e263640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b1225d6370 0x55b1225d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7e9e263640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b1225d6370 0x55b1225d6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42206/0 (socket says 172.21.15.117:42206) 2024-09-10T06:22:52.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7e9e263640 1 -- 172.21.15.117:0/713689607 learned_addr learned my addr 172.21.15.117:0/713689607 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7e9e263640 1 -- 172.21.15.117:0/713689607 >> v1:172.21.15.84:6789/0 conn(0x55b1225d9550 legacy=0x55b1225db940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.309+0000 7f7e9e263640 1 -- 172.21.15.117:0/713689607 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12247fca0 con 0x55b1225d6370 2024-09-10T06:22:52.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7e9e263640 1 --2- 172.21.15.117:0/713689607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1225d6750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800a750 tx=0x7f7e8801d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba201ecebd0fa0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7e9d261640 1 -- 172.21.15.117:0/713689607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880b1070 con 0x55b1225d6370 2024-09-10T06:22:52.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7e9d261640 1 -- 172.21.15.117:0/713689607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880a5e50 con 0x55b1225d6370 2024-09-10T06:22:52.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7e9d261640 1 -- 172.21.15.117:0/713689607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e8800a350 con 0x55b1225d6370 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/713689607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 msgr2=0x55b1225d6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/713689607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1225d6750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800a750 tx=0x7f7e8801d200 comp rx=0 tx=0).stop 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/713689607 shutdown_connections 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/713689607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1225d6750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/713689607 >> 172.21.15.117:0/713689607 conn(0x55b1225d1e90 msgr2=0x55b1225d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/713689607 shutdown_connections 2024-09-10T06:22:52.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.313+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/713689607 wait complete. 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7ea075d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7ea075d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b1224df680 con 0x55b1225d6370 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42220/0 (socket says 172.21.15.117:42220) 2024-09-10T06:22:52.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7e9e263640 1 -- 172.21.15.117:0/4103518508 learned_addr learned my addr 172.21.15.117:0/4103518508 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7e9e263640 1 -- 172.21.15.117:0/4103518508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12245ada0 con 0x55b1225d6370 2024-09-10T06:22:52.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7e9e263640 1 --2- 172.21.15.117:0/4103518508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e880af040 tx=0x7f7e88003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ac135fdfc4003 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7d8b616640 1 -- 172.21.15.117:0/4103518508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880b1050 con 0x55b1225d6370 2024-09-10T06:22:52.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7d8b616640 1 -- 172.21.15.117:0/4103518508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880bd070 con 0x55b1225d6370 2024-09-10T06:22:52.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.325+0000 7f7d8b616640 1 -- 172.21.15.117:0/4103518508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880086d0 con 0x55b1225d6370 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4103518508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 msgr2=0x55b1226c0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4103518508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e880af040 tx=0x7f7e88003030 comp rx=0 tx=0).stop 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4103518508 shutdown_connections 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4103518508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c0690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4103518508 >> 172.21.15.117:0/4103518508 conn(0x55b1225d1e90 msgr2=0x55b1226bc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4103518508 shutdown_connections 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4103518508 wait complete. 2024-09-10T06:22:52.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b122481a50 con 0x55b1225d6370 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42222/0 (socket says 172.21.15.117:42222) 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9e263640 1 -- 172.21.15.117:0/2847089708 learned_addr learned my addr 172.21.15.117:0/2847089708 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9e263640 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1226c8130 con 0x55b1225d6370 2024-09-10T06:22:52.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9e263640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c7bd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e8801d030 tx=0x7f7e88019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 -- 172.21.15.117:0/2847089708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880b89e0 con 0x55b1225d6370 2024-09-10T06:22:52.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1226c83c0 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1226c8d70 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 -- 172.21.15.117:0/2847089708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880bd050 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 -- 172.21.15.117:0/2847089708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880b8cb0 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 -- 172.21.15.117:0/2847089708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e880ac400 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d84039a70 0x7f7d8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7d89e13640 1 -- 172.21.15.117:0/2847089708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7e880ed510 con 0x55b1225d6370 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7e9da62640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d84039a70 0x7f7d8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b1225d9550 0x55b1226ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.329+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1226cf280 con 0x55b1225d9550 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b1225d9550 0x55b1226ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9da62640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d84039a70 0x7f7d8403bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001670 tx=0x7f7e98006670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b1225d9550 0x55b1226ced40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9ea64640 1 -- 172.21.15.117:0/2847089708 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e900083f0 con 0x55b1225d9550 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1226cf6f0 con 0x55b1225d9550 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9ea64640 1 -- 172.21.15.117:0/2847089708 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e900083f0 con 0x55b1225d9550 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b1226d1500 0x55b1226d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1226d3fc0 con 0x55b1226d1500 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b1226d1500 0x55b1226d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b1226d1500 0x55b1226d38f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 -- 172.21.15.117:0/2847089708 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e880db040 con 0x55b1226d1500 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1226d03a0 con 0x55b1225d9550 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9ea64640 1 -- 172.21.15.117:0/2847089708 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e900083f0 con 0x55b1225d9550 2024-09-10T06:22:52.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b1226d5400 0x55b1226d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1226d7f60 con 0x55b1226d5400 2024-09-10T06:22:52.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9da62640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b1226d5400 0x55b1226d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9da62640 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b1226d5400 0x55b1226d77f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9da62640 1 -- 172.21.15.117:0/2847089708 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e9800f030 con 0x55b1226d5400 2024-09-10T06:22:52.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7ea075d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b1224ec450 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42228/0 (socket says 172.21.15.117:42228) 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.333+0000 7f7e9e263640 1 -- 172.21.15.117:0/1808752077 learned_addr learned my addr 172.21.15.117:0/1808752077 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 -- 172.21.15.117:0/1808752077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1226e6480 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7e880eba50 tx=0x7f7e880ac850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 -- 172.21.15.117:0/1808752077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880c9580 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1226e6ce0 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 -- 172.21.15.117:0/1808752077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880b2040 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 -- 172.21.15.117:0/1808752077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880c1c30 con 0x55b1226e5a20 2024-09-10T06:22:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1226e7250 con 0x55b1226e5a20 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 -- 172.21.15.117:0/1808752077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e880c0560 con 0x55b1226e5a20 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 0x7f7d7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d82ffd640 1 -- 172.21.15.117:0/1808752077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7e880e5070 con 0x55b1226e5a20 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9da62640 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 0x7f7d7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9da62640 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 0x7f7d7403bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55b1226d8360 tx=0x7f7e98011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7ea075d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b1226c0e20 con 0x55b1226f2180 2024-09-10T06:22:52.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42244/0 (socket says 172.21.15.117:42244) 2024-09-10T06:22:52.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 -- 172.21.15.117:0/2864842055 learned_addr learned my addr 172.21.15.117:0/2864842055 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 -- 172.21.15.117:0/2864842055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1226f2b30 con 0x55b1226f2180 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7e9e263640 1 --2- 172.21.15.117:0/2864842055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e880d2fd0 tx=0x7f7e880d0740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d186cd7e8c46b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d80ff9640 1 -- 172.21.15.117:0/2864842055 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880c1910 con 0x55b1226f2180 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d80ff9640 1 -- 172.21.15.117:0/2864842055 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880c1dd0 con 0x55b1226f2180 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.337+0000 7f7d80ff9640 1 -- 172.21.15.117:0/2864842055 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880d0340 con 0x55b1226f2180 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2864842055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 msgr2=0x55b1226f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2864842055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e880d2fd0 tx=0x7f7e880d0740 comp rx=0 tx=0).stop 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2864842055 shutdown_connections 2024-09-10T06:22:52.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2864842055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226f2560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2864842055 >> 172.21.15.117:0/2864842055 conn(0x55b1226ee5b0 msgr2=0x55b1226ec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2864842055 shutdown_connections 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2864842055 wait complete. 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 Processor -- start 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- start start 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226fd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b1226f3010 con 0x55b1226f2180 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7e9e263640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42260/0 (socket says 172.21.15.117:42260) 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 learned_addr learned my addr 172.21.15.117:0/4260038082 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1226fdde0 con 0x55b1226f2180 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7e9e263640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226fd880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e880ed480 tx=0x7f7e880f1f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7d72ffd640 1 -- 172.21.15.117:0/4260038082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e88111070 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1226fdde0 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1226fdde0 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7d72ffd640 1 -- 172.21.15.117:0/4260038082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e880c1910 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7d72ffd640 1 -- 172.21.15.117:0/4260038082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e880c1dd0 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.341+0000 7f7d72ffd640 1 -- 172.21.15.117:0/4260038082 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e88114070 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7d72ffd640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d68039a20 0x7f7d6803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7d72ffd640 1 -- 172.21.15.117:0/4260038082 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7e88109070 con 0x55b1226f2180 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d68039a20 0x7f7d6803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b122708ac0 0x55b12270af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12270b6a0 con 0x55b122708ac0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b122708ac0 0x55b12270af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d68039a20 0x7f7d6803bee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001f00 tx=0x7f7e98012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b122708ac0 0x55b12270af50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e900083f0 con 0x55b122708ac0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 realm 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12270bab0 con 0x55b122708ac0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e900083f0 con 0x55b122708ac0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c380 con 0x55b122708ac0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e900083f0 con 0x55b122708ac0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e900083f0 con 0x55b122708ac0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b12270d210 0x55b12270f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12270fd40 con 0x55b12270d210 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b12270d210 0x55b12270f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b12270d210 0x55b12270f600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 20 searching for the correct realm 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b122711ce0 0x55b122714180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b122714850 con 0x55b122711ce0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b122711ce0 0x55b122714180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b122711ce0 0x55b122714180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b122714850 con 0x55b12270d210 2024-09-10T06:22:52.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7e88116060 0x7f7e88008050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b122714850 con 0x7f7e88116060 2024-09-10T06:22:52.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.345+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7e88116060 0x7f7e88008050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7e88116060 0x7f7e88008050 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e900083f0 con 0x7f7e88116060 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e900083f0 con 0x55b122708ac0 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b12270d210 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.349+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b12270d210 2024-09-10T06:22:52.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b12270d210 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.353+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b12270d210 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122711ce0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x7f7e88116060 2024-09-10T06:22:52.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b122708ac0 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b12270c720 con 0x55b12270d210 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b122710600 con 0x55b122708ac0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1227109f0 con 0x55b122708ac0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1227109f0 con 0x55b122711ce0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 zone default found 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 4 Realm: () 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 zonegroup default 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.357+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b122714cd0 con 0x7f7e88116060 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1227166c0 con 0x55b122711ce0 2024-09-10T06:22:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b122716a60 con 0x55b122711ce0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122715b60 con 0x55b12270d210 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94219275427664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227157c0 con 0x55b12270d210 2024-09-10T06:22:52.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122717990 con 0x55b122708ac0 2024-09-10T06:22:52.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.361+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94219275427664] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94219275433184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122717900 con 0x55b122708ac0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122718740 con 0x55b122711ce0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94219275433184] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94219275435392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122718b30 con 0x55b122711ce0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.365+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227194f0 con 0x55b12270d210 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94219275440496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122719c00 con 0x55b12270d210 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271a720 con 0x55b122708ac0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94219275435392] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94219275440496] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94219275444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271a6e0 con 0x55b122708ac0 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271afc0 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.369+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94219275444720] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94219275436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271ab90 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271b440 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94219275436448] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94219275445984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271b620 con 0x7f7e88116060 2024-09-10T06:22:52.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.373+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271be70 con 0x7f7e88116060 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94219275445984] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94219275450368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271c230 con 0x7f7e88116060 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=0 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=1 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=2 2024-09-10T06:22:52.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=3 2024-09-10T06:22:52.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=4 2024-09-10T06:22:52.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=5 2024-09-10T06:22:52.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=6 2024-09-10T06:22:52.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94219275450368] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 20 add_watcher() i=7 2024-09-10T06:22:52.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b12271ac10 con 0x55b122708ac0 2024-09-10T06:22:52.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.377+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94219275451584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b12271ac10 con 0x55b122708ac0 2024-09-10T06:22:52.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94219275451584] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7d537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 5 note: GC not initialized 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7d527e4640 20 reqs_thread_entry: start 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 Filter name: none 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7cc3fff640 20 reqs_thread_entry: start 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b122742420 con 0x55b122708ac0 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T06:22:52.385 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T06:22:52.210760Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7d537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94219275451584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122740ed0 con 0x55b122708ac0 2024-09-10T06:22:52.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94219275451584] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.381+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94219275427664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227401e0 con 0x55b12270d210 2024-09-10T06:22:52.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94219275427664] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7ea075d9c0 20 remove_watcher() i=0 2024-09-10T06:22:52.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7ea075d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94219275433184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227401e0 con 0x55b122708ac0 2024-09-10T06:22:52.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94219275433184] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7ea075d9c0 20 remove_watcher() i=1 2024-09-10T06:22:52.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.385+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94219275435392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227401e0 con 0x55b122711ce0 2024-09-10T06:22:52.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7e9da62640 1 -- 172.21.15.117:0/4260038082 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94219275435392] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e98021040 con 0x55b122711ce0 2024-09-10T06:22:52.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7ea075d9c0 20 remove_watcher() i=2 2024-09-10T06:22:52.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94219275440496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227174e0 con 0x55b12270d210 2024-09-10T06:22:52.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7e9e263640 1 -- 172.21.15.117:0/4260038082 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94219275440496] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e88113030 con 0x55b12270d210 2024-09-10T06:22:52.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7ea075d9c0 20 remove_watcher() i=3 2024-09-10T06:22:52.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.389+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94219275444720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122717d80 con 0x55b122708ac0 2024-09-10T06:22:52.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94219275444720] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x55b122708ac0 2024-09-10T06:22:52.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7ea075d9c0 20 remove_watcher() i=4 2024-09-10T06:22:52.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94219275436448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122719170 con 0x7f7e88116060 2024-09-10T06:22:52.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94219275436448] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7ea075d9c0 20 remove_watcher() i=5 2024-09-10T06:22:52.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.393+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94219275445984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1227174e0 con 0x7f7e88116060 2024-09-10T06:22:52.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94219275445984] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 20 remove_watcher() i=6 2024-09-10T06:22:52.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94219275450368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b122718230 con 0x7f7e88116060 2024-09-10T06:22:52.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94219275450368] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e90026040 con 0x7f7e88116060 2024-09-10T06:22:52.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 20 remove_watcher() i=7 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7e88116060 msgr2=0x7f7e88008050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7e88116060 0x7f7e88008050 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b122708ac0 msgr2=0x55b12270af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b122708ac0 0x55b12270af50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b12270d210 msgr2=0x55b12270f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b12270d210 0x55b12270f600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b122711ce0 msgr2=0x55b122714180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b122711ce0 0x55b122714180 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d68039a20 msgr2=0x7f7d6803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d68039a20 0x7f7d6803bee0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001f00 tx=0x7f7e98012000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 msgr2=0x55b1226fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/4260038082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226f2180 0x55b1226fd880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e880ed480 tx=0x7f7e880f1f30 comp rx=0 tx=0).stop 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7e9ea64640 1 -- 172.21.15.117:0/4260038082 reap_dead start 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 shutdown_connections 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 >> 172.21.15.117:0/4260038082 conn(0x55b1226ee5b0 msgr2=0x55b1226ec7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 shutdown_connections 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/4260038082 wait complete. 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 msgr2=0x7f7d7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 0x7f7d7403bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55b1226d8360 tx=0x7f7e98011000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 msgr2=0x55b1226e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7e880eba50 tx=0x7f7e880ac850 comp rx=0 tx=0).stop 2024-09-10T06:22:52.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 shutdown_connections 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d74039ac0 0x7f7d7403bf80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/1808752077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1226e5a20 0x55b1226e5e40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 >> 172.21.15.117:0/1808752077 conn(0x55b1226db3d0 msgr2=0x55b1226db7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 shutdown_connections 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/1808752077 wait complete. 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b1225d9550 msgr2=0x55b1226ced40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b1225d9550 0x55b1226ced40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b1226d1500 msgr2=0x55b1226d38f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b1226d1500 0x55b1226d38f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b1226d5400 msgr2=0x55b1226d77f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b1226d5400 0x55b1226d77f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d84039a70 msgr2=0x7f7d8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7d84039a70 0x7f7d8403bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e98001670 tx=0x7f7e98006670 comp rx=0 tx=0).stop 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 msgr2=0x55b1226c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.397+0000 7f7ea075d9c0 1 --2- 172.21.15.117:0/2847089708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b1225d6370 0x55b1226c7bd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e8801d030 tx=0x7f7e88019fa0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.401+0000 7f7e9ea64640 1 -- 172.21.15.117:0/2847089708 reap_dead start 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.401+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 shutdown_connections 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.401+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 >> 172.21.15.117:0/2847089708 conn(0x55b1225d1e90 msgr2=0x55b1226bada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.401+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 shutdown_connections 2024-09-10T06:22:52.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.401+0000 7f7ea075d9c0 1 -- 172.21.15.117:0/2847089708 wait complete. 2024-09-10T06:22:52.411 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T06:22:52.210760Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T06:22:52.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T06:22:52.411 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-10T06:22:52.489 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:52.489 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:52.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc50168f9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x561bb27628c0 0x561bb2764cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc50168f9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561bb26129c0 con 0x561bb26d2770 2024-09-10T06:22:52.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc50168f9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x561bb26626d0 con 0x561bb27628c0 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe994640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x561bb27628c0 0x561bb2764cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4ff195640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x561bb26d2770 0x561bb27611a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44240/0 (socket says 172.21.15.117:44240) 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe994640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x561bb27628c0 0x561bb2764cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42274/0 (socket says 172.21.15.117:42274) 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4ff195640 1 -- 172.21.15.117:0/1938116881 learned_addr learned my addr 172.21.15.117:0/1938116881 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe994640 1 -- 172.21.15.117:0/1938116881 >> v1:172.21.15.84:6789/0 conn(0x561bb26d2770 legacy=0x561bb27611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe994640 1 -- 172.21.15.117:0/1938116881 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb2606ca0 con 0x561bb27628c0 2024-09-10T06:22:52.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe994640 1 --2- 172.21.15.117:0/1938116881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb27628c0 0x561bb2764cb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a480 tx=0x7fc4e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63bba2a3d8a57e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe193640 1 -- 172.21.15.117:0/1938116881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e80af070 con 0x561bb27628c0 2024-09-10T06:22:52.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe193640 1 -- 172.21.15.117:0/1938116881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e80aa530 con 0x561bb27628c0 2024-09-10T06:22:52.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.489+0000 7fc4fe193640 1 -- 172.21.15.117:0/1938116881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e80aa830 con 0x561bb27628c0 2024-09-10T06:22:52.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1938116881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb27628c0 msgr2=0x561bb2764cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1938116881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb27628c0 0x561bb2764cb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a480 tx=0x7fc4e801b280 comp rx=0 tx=0).stop 2024-09-10T06:22:52.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1938116881 shutdown_connections 2024-09-10T06:22:52.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1938116881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb27628c0 0x561bb2764cb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1938116881 >> 172.21.15.117:0/1938116881 conn(0x561bb2758e90 msgr2=0x561bb275b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1938116881 shutdown_connections 2024-09-10T06:22:52.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.493+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1938116881 wait complete. 2024-09-10T06:22:52.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc50168f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc50168f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561bb2666680 con 0x561bb26d2770 2024-09-10T06:22:52.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42276/0 (socket says 172.21.15.117:42276) 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc4ff195640 1 -- 172.21.15.117:0/17135485 learned_addr learned my addr 172.21.15.117:0/17135485 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc4ff195640 1 -- 172.21.15.117:0/17135485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb25e1da0 con 0x561bb26d2770 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc4ff195640 1 --2- 172.21.15.117:0/17135485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00017b0 tx=0x7fc4f0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90f216e5c7e942b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc3ed60a640 1 -- 172.21.15.117:0/17135485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f00044f0 con 0x561bb26d2770 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc3ed60a640 1 -- 172.21.15.117:0/17135485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f00046b0 con 0x561bb26d2770 2024-09-10T06:22:52.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.505+0000 7fc3ed60a640 1 -- 172.21.15.117:0/17135485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0004a10 con 0x561bb26d2770 2024-09-10T06:22:52.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/17135485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 msgr2=0x561bb2849930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/17135485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00017b0 tx=0x7fc4f0001c70 comp rx=0 tx=0).stop 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/17135485 shutdown_connections 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/17135485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2849930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/17135485 >> 172.21.15.117:0/17135485 conn(0x561bb2758e90 msgr2=0x561bb28455d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/17135485 shutdown_connections 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/17135485 wait complete. 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2850fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561bb2608a50 con 0x561bb26d2770 2024-09-10T06:22:52.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2850fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2850fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42282/0 (socket says 172.21.15.117:42282) 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4ff195640 1 -- 172.21.15.117:0/1855308331 learned_addr learned my addr 172.21.15.117:0/1855308331 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4ff195640 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb2851530 con 0x561bb26d2770 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4ff195640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2850fd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00012f0 tx=0x7fc4f0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 -- 172.21.15.117:0/1855308331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0013820 con 0x561bb26d2770 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bb28517c0 con 0x561bb26d2770 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 -- 172.21.15.117:0/1855308331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f00139c0 con 0x561bb26d2770 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb2852170 con 0x561bb26d2770 2024-09-10T06:22:52.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 -- 172.21.15.117:0/1855308331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0013ca0 con 0x561bb26d2770 2024-09-10T06:22:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 -- 172.21.15.117:0/1855308331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc4f0010070 con 0x561bb26d2770 2024-09-10T06:22:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3e4039a70 0x7fc3e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc3ebe07640 1 -- 172.21.15.117:0/1855308331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc4f0018070 con 0x561bb26d2770 2024-09-10T06:22:52.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc4fe994640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3e4039a70 0x7fc3e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.509+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb27628c0 0x561bb2858140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2858680 con 0x561bb27628c0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff996640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb27628c0 0x561bb2858140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4fe994640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3e4039a70 0x7fc3e403bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80ac000 tx=0x7fc4e80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff996640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb27628c0 0x561bb2858140 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff996640 1 -- 172.21.15.117:0/1855308331 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb27628c0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28524e0 con 0x561bb27628c0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff996640 1 -- 172.21.15.117:0/1855308331 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb27628c0 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb285a970 0x561bb285cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb285d450 con 0x561bb285a970 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb285a970 0x561bb285cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb285a970 0x561bb285cd60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 -- 172.21.15.117:0/1855308331 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4f001b030 con 0x561bb285a970 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28597e0 con 0x561bb27628c0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff996640 1 -- 172.21.15.117:0/1855308331 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb27628c0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb285e8b0 0x561bb2860ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28613a0 con 0x561bb285e8b0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4fe994640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb285e8b0 0x561bb2860ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4fe994640 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb285e8b0 0x561bb2860ca0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4fe994640 1 -- 172.21.15.117:0/1855308331 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4e80a8070 con 0x561bb285e8b0 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc50168f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561bb2673450 con 0x561bb286ee20 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42286/0 (socket says 172.21.15.117:42286) 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.513+0000 7fc4ff195640 1 -- 172.21.15.117:0/2283084088 learned_addr learned my addr 172.21.15.117:0/2283084088 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4ff195640 1 -- 172.21.15.117:0/2283084088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb286f880 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4ff195640 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc4f004e930 tx=0x7fc4f004ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 -- 172.21.15.117:0/2283084088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0047070 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 -- 172.21.15.117:0/2283084088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f001d560 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 -- 172.21.15.117:0/2283084088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f00123c0 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bb28700e0 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb2870650 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 -- 172.21.15.117:0/2283084088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc4f004a070 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 0x7fc3d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc3e9602640 1 -- 172.21.15.117:0/2283084088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc4f0051b80 con 0x561bb286ee20 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4fe994640 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 0x7fc3d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc50168f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561bb284a180 con 0x561bb287c570 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4fe994640 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 0x7fc3d803bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8017e90 tx=0x7fc4e8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42292/0 (socket says 172.21.15.117:42292) 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.517+0000 7fc4ff195640 1 -- 172.21.15.117:0/1384649413 learned_addr learned my addr 172.21.15.117:0/1384649413 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 -- 172.21.15.117:0/1384649413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb287cf60 con 0x561bb287c570 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 --2- 172.21.15.117:0/1384649413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00297f0 tx=0x7fc4f001d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a6cda4df755314 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e2ffd640 1 -- 172.21.15.117:0/1384649413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0061070 con 0x561bb287c570 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e2ffd640 1 -- 172.21.15.117:0/1384649413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f004b8f0 con 0x561bb287c570 2024-09-10T06:22:52.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e2ffd640 1 -- 172.21.15.117:0/1384649413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0056040 con 0x561bb287c570 2024-09-10T06:22:52.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1384649413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 msgr2=0x561bb287c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1384649413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00297f0 tx=0x7fc4f001d8f0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1384649413 shutdown_connections 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1384649413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb287c970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1384649413 >> 172.21.15.117:0/1384649413 conn(0x561bb2877990 msgr2=0x561bb2875bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1384649413 shutdown_connections 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1384649413 wait complete. 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 Processor -- start 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- start start 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb28828c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561bb287b340 con 0x561bb287c570 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb28828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb28828c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42302/0 (socket says 172.21.15.117:42302) 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 learned_addr learned my addr 172.21.15.117:0/3372006020 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb2882e20 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc4ff195640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb28828c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc4f001de00 tx=0x7fc4f0017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e17fa640 1 -- 172.21.15.117:0/3372006020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0061070 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bb2882e20 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb28833f0 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e17fa640 1 -- 172.21.15.117:0/3372006020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0051e50 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.521+0000 7fc3e17fa640 1 -- 172.21.15.117:0/3372006020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f004b8f0 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc3e17fa640 1 -- 172.21.15.117:0/3372006020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc4f0070020 con 0x561bb287c570 2024-09-10T06:22:52.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc3e17fa640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3c8039a70 0x7fc3c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc3e17fa640 1 -- 172.21.15.117:0/3372006020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fc4f006e020 con 0x561bb287c570 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3c8039a70 0x7fc3c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb288da90 0x561bb288ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2890670 con 0x561bb288da90 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb288da90 0x561bb288ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3c8039a70 0x7fc3c803bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80aafd0 tx=0x7fc4e80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb288da90 0x561bb288ff20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb288da90 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 realm 2024-09-10T06:22:52.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2890a80 con 0x561bb288da90 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb288da90 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2891350 con 0x561bb288da90 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb288da90 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb288da90 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb2892450 0x561bb2894840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2894e90 con 0x561bb2892450 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff195640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb2892450 0x561bb2894840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff195640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb2892450 0x561bb2894840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 20 searching for the correct realm 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb28969d0 0x561bb2898e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28994c0 con 0x561bb28969d0 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb28969d0 0x561bb2898e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb28969d0 0x561bb2898e40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28994c0 con 0x561bb2892450 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.525+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff195640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc4f004c060 0x7fc4f0049720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fc4f007d040 con 0x7fc4f004c060 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc4f004c060 0x7fc4f0049720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc4f004c060 0x7fc4f0049720 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f80083f0 con 0x7fc4f004c060 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f80083f0 con 0x561bb288da90 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb2892450 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.529+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb2892450 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.533+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb2892450 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb2892450 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb28969d0 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x7fc4f004c060 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb2892450 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.537+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28916f0 con 0x561bb288da90 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2895340 con 0x561bb288da90 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2895340 con 0x561bb28969d0 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 zone default found 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 4 Realm: () 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 zonegroup default 2024-09-10T06:22:52.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb2895c60 con 0x7fc4f004c060 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb289b330 con 0x561bb28969d0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb289b6d0 con 0x561bb28969d0 2024-09-10T06:22:52.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289a7d0 con 0x561bb2892450 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676959472848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289a7d0 con 0x561bb2892450 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.541+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289c090 con 0x561bb288da90 2024-09-10T06:22:52.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.545+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676959472848] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.545+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.545+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676959470640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289c090 con 0x561bb288da90 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.545+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289ca50 con 0x561bb28969d0 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676959470640] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676959476704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289c000 con 0x561bb28969d0 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289d790 con 0x561bb2892450 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676959482528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289e030 con 0x561bb2892450 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.549+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289ea30 con 0x561bb288da90 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.553+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676959482528] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.553+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676959476704] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.557+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.557+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676959481328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289db80 con 0x561bb288da90 2024-09-10T06:22:52.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.557+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289f2d0 con 0x7fc4f004c060 2024-09-10T06:22:52.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.557+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676959481328] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676959487296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289db80 con 0x7fc4f004c060 2024-09-10T06:22:52.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289f730 con 0x7fc4f004c060 2024-09-10T06:22:52.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676959487296] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.561+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676959489120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289f730 con 0x7fc4f004c060 2024-09-10T06:22:52.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28a00f0 con 0x7fc4f004c060 2024-09-10T06:22:52.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676959493184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28a0510 con 0x7fc4f004c060 2024-09-10T06:22:52.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=0 2024-09-10T06:22:52.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=1 2024-09-10T06:22:52.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=2 2024-09-10T06:22:52.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=3 2024-09-10T06:22:52.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=4 2024-09-10T06:22:52.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=5 2024-09-10T06:22:52.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676959489120] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.565+0000 7fc50168f9c0 20 add_watcher() i=6 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676959493184] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 add_watcher() i=7 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb289f280 con 0x561bb288da90 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676959490688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28a0a60 con 0x561bb288da90 2024-09-10T06:22:52.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676959490688] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc3b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 5 note: GC not initialized 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc3b4fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 Filter name: none 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc32e7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c6c00 con 0x561bb288da90 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T06:22:52.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:52.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:52.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28cd6d0 con 0x561bb288da90 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.569+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94676959678784 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c8dc0 con 0x561bb288da90 2024-09-10T06:22:52.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94676959481328 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fc4f8010040 con 0x561bb288da90 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94676959481328 notifier 4353 bl.length()=567 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(64 notify.4 [notify cookie 94676959678784 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e2ffd640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc3c4003eb0 con 0x561bb288da90 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94676959678784 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4f800ada0 con 0x561bb288da90 2024-09-10T06:22:52.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28cd140 con 0x7fc4f004c060 2024-09-10T06:22:52.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc50168f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94676959678784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c77f0 con 0x561bb28969d0 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 94676959476704 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7fc4e80e2040 con 0x561bb28969d0 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94676959476704 notifier 4353 bl.length()=170 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 notify.2 [notify cookie 94676959678784 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc3e27fc640 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc3340032d0 con 0x561bb28969d0 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== watch-notify(notify_complete (2) cookie 94676959678784 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561bb2606ca0 con 0x561bb28969d0 2024-09-10T06:22:52.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.573+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.579 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc3b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676959490688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c48e0 con 0x561bb288da90 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94676959490688] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676959472848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c48e0 con 0x561bb2892450 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94676959472848] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc50168f9c0 20 remove_watcher() i=0 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc50168f9c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.577+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676959470640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c48e0 con 0x561bb288da90 2024-09-10T06:22:52.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94676959470640] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 20 remove_watcher() i=1 2024-09-10T06:22:52.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676959476704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb28c48e0 con 0x561bb28969d0 2024-09-10T06:22:52.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc4fe994640 1 -- 172.21.15.117:0/3372006020 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94676959476704] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e80d9070 con 0x561bb28969d0 2024-09-10T06:22:52.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 20 remove_watcher() i=2 2024-09-10T06:22:52.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676959482528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289bbe0 con 0x561bb2892450 2024-09-10T06:22:52.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc4ff195640 1 -- 172.21.15.117:0/3372006020 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94676959482528] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f0059040 con 0x561bb2892450 2024-09-10T06:22:52.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 20 remove_watcher() i=3 2024-09-10T06:22:52.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.581+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676959481328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289bbe0 con 0x561bb288da90 2024-09-10T06:22:52.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94676959481328] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x561bb288da90 2024-09-10T06:22:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc50168f9c0 20 remove_watcher() i=4 2024-09-10T06:22:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676959487296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289cdf0 con 0x7fc4f004c060 2024-09-10T06:22:52.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94676959487296] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc50168f9c0 20 remove_watcher() i=5 2024-09-10T06:22:52.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.585+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676959489120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289bbe0 con 0x7fc4f004c060 2024-09-10T06:22:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94676959489120] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 20 remove_watcher() i=6 2024-09-10T06:22:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676959493184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561bb289ec60 con 0x7fc4f004c060 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94676959493184] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4f8026040 con 0x7fc4f004c060 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 20 remove_watcher() i=7 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc4f004c060 msgr2=0x7fc4f0049720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc4f004c060 0x7fc4f0049720 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb288da90 msgr2=0x561bb288ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb288da90 0x561bb288ff20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb2892450 msgr2=0x561bb2894840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb2892450 0x561bb2894840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb28969d0 msgr2=0x561bb2898e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb28969d0 0x561bb2898e40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3c8039a70 msgr2=0x7fc3c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3c8039a70 0x7fc3c803bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80aafd0 tx=0x7fc4e80a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 msgr2=0x561bb28828c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/3372006020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb287c570 0x561bb28828c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc4f001de00 tx=0x7fc4f0017ed0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 reap_dead start 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc4ff996640 1 -- 172.21.15.117:0/3372006020 reap_dead start 2024-09-10T06:22:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 shutdown_connections 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 >> 172.21.15.117:0/3372006020 conn(0x561bb2877990 msgr2=0x561bb2875ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 shutdown_connections 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/3372006020 wait complete. 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 msgr2=0x7fc3d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 0x7fc3d803bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8017e90 tx=0x7fc4e8005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 msgr2=0x561bb286f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc4f004e930 tx=0x7fc4f004ede0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 shutdown_connections 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3d8039a70 0x7fc3d803bf30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/2283084088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb286ee20 0x561bb286f240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 >> 172.21.15.117:0/2283084088 conn(0x561bb28647d0 msgr2=0x561bb2864bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 shutdown_connections 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.589+0000 7fc50168f9c0 1 -- 172.21.15.117:0/2283084088 wait complete. 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb27628c0 msgr2=0x561bb2858140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561bb27628c0 0x561bb2858140 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb285a970 msgr2=0x561bb285cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561bb285a970 0x561bb285cd60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb285e8b0 msgr2=0x561bb2860ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561bb285e8b0 0x561bb2860ca0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3e4039a70 msgr2=0x7fc3e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc3e4039a70 0x7fc3e403bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80ac000 tx=0x7fc4e80a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 msgr2=0x561bb2850fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 --2- 172.21.15.117:0/1855308331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561bb26d2770 0x561bb2850fd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00012f0 tx=0x7fc4f0000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc4ff996640 1 -- 172.21.15.117:0/1855308331 reap_dead start 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 shutdown_connections 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 >> 172.21.15.117:0/1855308331 conn(0x561bb2758e90 msgr2=0x561bb2844060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 shutdown_connections 2024-09-10T06:22:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.593+0000 7fc50168f9c0 1 -- 172.21.15.117:0/1855308331 wait complete. 2024-09-10T06:22:52.603 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T06:22:52.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T06:22:52.603 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-10T06:22:52.677 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:52.677 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:52.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d4ced9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x559b2044a560 0x559b2044c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d4ced9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b202fb9c0 con 0x559b20446370 2024-09-10T06:22:52.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d4ced9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x559b2034b6d0 con 0x559b2044a560 2024-09-10T06:22:52.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d1ff2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x559b2044a560 0x559b2044c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d27f3640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x559b20446370 0x559b20446750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44252/0 (socket says 172.21.15.117:44252) 2024-09-10T06:22:52.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d27f3640 1 -- 172.21.15.117:0/3622873814 learned_addr learned my addr 172.21.15.117:0/3622873814 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:52.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3622873814 >> v1:172.21.15.84:6789/0 conn(0x559b20446370 legacy=0x559b20446750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.677+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3622873814 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b202efca0 con 0x559b2044a560 2024-09-10T06:22:52.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/3622873814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b2044a560 0x559b2044c950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c800a480 tx=0x7f73c801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7d67f914774575 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d17f1640 1 -- 172.21.15.117:0/3622873814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c80aa570 con 0x559b2044a560 2024-09-10T06:22:52.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d17f1640 1 -- 172.21.15.117:0/3622873814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c80af070 con 0x559b2044a560 2024-09-10T06:22:52.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d17f1640 1 -- 172.21.15.117:0/3622873814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c80aa860 con 0x559b2044a560 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3622873814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b2044a560 msgr2=0x559b2044c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3622873814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b2044a560 0x559b2044c950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c800a480 tx=0x7f73c801b310 comp rx=0 tx=0).stop 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3622873814 shutdown_connections 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3622873814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b2044a560 0x559b2044c950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3622873814 >> 172.21.15.117:0/3622873814 conn(0x559b20441e90 msgr2=0x559b204442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3622873814 shutdown_connections 2024-09-10T06:22:52.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.681+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3622873814 wait complete. 2024-09-10T06:22:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d4ced9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d4ced9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b2034f680 con 0x559b20446370 2024-09-10T06:22:52.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42330/0 (socket says 172.21.15.117:42330) 2024-09-10T06:22:52.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d27f3640 1 -- 172.21.15.117:0/4125196630 learned_addr learned my addr 172.21.15.117:0/4125196630 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d27f3640 1 -- 172.21.15.117:0/4125196630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b202cada0 con 0x559b20446370 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f73d27f3640 1 --2- 172.21.15.117:0/4125196630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0017b0 tx=0x7f73cc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bdf0426edbd181 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f72c0608640 1 -- 172.21.15.117:0/4125196630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc0044f0 con 0x559b20446370 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f72c0608640 1 -- 172.21.15.117:0/4125196630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc0046b0 con 0x559b20446370 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.693+0000 7f72c0608640 1 -- 172.21.15.117:0/4125196630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc004a10 con 0x559b20446370 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/4125196630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 msgr2=0x559b203bb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/4125196630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0017b0 tx=0x7f73cc001c70 comp rx=0 tx=0).stop 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/4125196630 shutdown_connections 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/4125196630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b203bb260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/4125196630 >> 172.21.15.117:0/4125196630 conn(0x559b20441e90 msgr2=0x559b2052d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/4125196630 shutdown_connections 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/4125196630 wait complete. 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b2053c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b202f1a50 con 0x559b20446370 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b2053c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b2053c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42332/0 (socket says 172.21.15.117:42332) 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d27f3640 1 -- 172.21.15.117:0/896266753 learned_addr learned my addr 172.21.15.117:0/896266753 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d27f3640 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2053c5e0 con 0x559b20446370 2024-09-10T06:22:52.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d27f3640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b2053c080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0012f0 tx=0x7f73cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f72bee05640 1 -- 172.21.15.117:0/896266753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc013820 con 0x559b20446370 2024-09-10T06:22:52.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f72bee05640 1 -- 172.21.15.117:0/896266753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc0139c0 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f72bee05640 1 -- 172.21.15.117:0/896266753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc013ca0 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2053c870 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2053d220 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.697+0000 7f72bee05640 1 -- 172.21.15.117:0/896266753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f73cc010070 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f72bee05640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72b8039ac0 0x7f72b803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f72bee05640 1 -- 172.21.15.117:0/896266753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f73cc018070 con 0x559b20446370 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72b8039ac0 0x7f72b803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b2044a560 0x559b205431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20543730 con 0x559b2044a560 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b2044a560 0x559b205431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72b8039ac0 0x7f72b803bf80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ae000 tx=0x7f73c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b2044a560 0x559b205431f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d2ff4640 1 -- 172.21.15.117:0/896266753 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73c40083f0 con 0x559b2044a560 2024-09-10T06:22:52.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2053d590 con 0x559b2044a560 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d2ff4640 1 -- 172.21.15.117:0/896266753 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73c40083f0 con 0x559b2044a560 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b205459d0 0x559b20547dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20548490 con 0x559b205459d0 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d27f3640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b205459d0 0x559b20547dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d27f3640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b205459d0 0x559b20547dc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d27f3640 1 -- 172.21.15.117:0/896266753 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73cc01b030 con 0x559b205459d0 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20544870 con 0x559b2044a560 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d2ff4640 1 -- 172.21.15.117:0/896266753 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73c40083f0 con 0x559b2044a560 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b205498d0 0x559b2054bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2054c450 con 0x559b205498d0 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b205498d0 0x559b2054bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b205498d0 0x559b2054bcc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d1ff2640 1 -- 172.21.15.117:0/896266753 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73c80a8070 con 0x559b205498d0 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.701+0000 7f73d4ced9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b2035c450 con 0x559b20559f10 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42348/0 (socket says 172.21.15.117:42348) 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 -- 172.21.15.117:0/297256706 learned_addr learned my addr 172.21.15.117:0/297256706 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 -- 172.21.15.117:0/297256706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2055a970 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73cc04ebe0 tx=0x7f73cc010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 -- 172.21.15.117:0/297256706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc047070 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2055b1d0 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2055b740 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 -- 172.21.15.117:0/297256706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc028ca0 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 -- 172.21.15.117:0/297256706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc01da10 con 0x559b20559f10 2024-09-10T06:22:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 -- 172.21.15.117:0/297256706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f73cc04a070 con 0x559b20559f10 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 0x7f72ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f72b7fff640 1 -- 172.21.15.117:0/297256706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f73cc005070 con 0x559b20559f10 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 0x7f72ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d4ced9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b203bbab0 con 0x559b205666a0 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 0x7f72ac03bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f73c80aa650 tx=0x7f73c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42364/0 (socket says 172.21.15.117:42364) 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 -- 172.21.15.117:0/2767881114 learned_addr learned my addr 172.21.15.117:0/2767881114 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.705+0000 7f73d27f3640 1 -- 172.21.15.117:0/2767881114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b20567050 con 0x559b205666a0 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 --2- 172.21.15.117:0/2767881114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f73cc010b20 tx=0x7f73cc04cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acadf19eed1256d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72b5ffb640 1 -- 172.21.15.117:0/2767881114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc028890 con 0x559b205666a0 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72b5ffb640 1 -- 172.21.15.117:0/2767881114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc0283d0 con 0x559b205666a0 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72b5ffb640 1 -- 172.21.15.117:0/2767881114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc04c440 con 0x559b205666a0 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/2767881114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 msgr2=0x559b20566a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/2767881114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f73cc010b20 tx=0x7f73cc04cde0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/2767881114 shutdown_connections 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/2767881114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b20566a80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/2767881114 >> 172.21.15.117:0/2767881114 conn(0x559b20562ad0 msgr2=0x559b20560d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/2767881114 shutdown_connections 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/2767881114 wait complete. 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 Processor -- start 2024-09-10T06:22:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- start start 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b20567530 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42372/0 (socket says 172.21.15.117:42372) 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 learned_addr learned my addr 172.21.15.117:0/3500095445 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2056def0 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d27f3640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f73cc012b40 tx=0x7f73cc059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72a3fff640 1 -- 172.21.15.117:0/3500095445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc01d350 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2056def0 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2056def0 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72a3fff640 1 -- 172.21.15.117:0/3500095445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc01d4f0 con 0x559b205666a0 2024-09-10T06:22:52.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.709+0000 7f72a3fff640 1 -- 172.21.15.117:0/3500095445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73cc050900 con 0x559b205666a0 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f72a3fff640 1 -- 172.21.15.117:0/3500095445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f73cc063030 con 0x559b205666a0 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f72a3fff640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f729c039a70 0x7f729c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f72a3fff640 1 -- 172.21.15.117:0/3500095445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f73cc061020 con 0x559b205666a0 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f729c039a70 0x7f729c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b20578a90 0x559b2057af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2057b670 con 0x559b20578a90 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b20578a90 0x559b2057af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f729c039a70 0x7f729c03bf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f73c80cd040 tx=0x7f73c80a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b20578a90 0x559b2057af20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73c40083f0 con 0x559b20578a90 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 realm 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2057ba80 con 0x559b20578a90 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73c40083f0 con 0x559b20578a90 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c350 con 0x559b20578a90 2024-09-10T06:22:52.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73c40083f0 con 0x559b20578a90 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73c40083f0 con 0x559b20578a90 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b2057d450 0x559b2057f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2057fe90 con 0x559b2057d450 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b2057d450 0x559b2057f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b2057d450 0x559b2057f840 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 20 searching for the correct realm 2024-09-10T06:22:52.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b20581d70 0x559b205841a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b20584820 con 0x559b20581d70 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b20581d70 0x559b205841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b20581d70 0x559b205841a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b20584820 con 0x559b2057d450 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f73cc04c060 0x7f73cc037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.713+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b20584820 con 0x7f73cc04c060 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f73cc04c060 0x7f73cc037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f73cc04c060 0x7f73cc037910 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c40083f0 con 0x7f73cc04c060 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c40083f0 con 0x559b20578a90 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b2057d450 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.717+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b2057d450 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.721+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b2057d450 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b2057d450 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20581d70 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x7f73cc04c060 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b20578a90 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2057c6f0 con 0x559b2057d450 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.725+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b205806e0 con 0x559b20578a90 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20580ad0 con 0x559b20578a90 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20580ad0 con 0x559b20581d70 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 zone default found 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 4 Realm: () 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 zonegroup default 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20584ca0 con 0x7f73cc04c060 2024-09-10T06:22:52.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20586790 con 0x559b20581d70 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b20586c20 con 0x559b20581d70 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20585b30 con 0x559b2057d450 2024-09-10T06:22:52.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94124750954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20585790 con 0x559b2057d450 2024-09-10T06:22:52.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20587b50 con 0x559b20578a90 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.729+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94124750954272] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94124750960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20587f70 con 0x559b20578a90 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20588840 con 0x559b20581d70 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94124750960288] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.733+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94124750961648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20588c30 con 0x559b20581d70 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205895f0 con 0x559b2057d450 2024-09-10T06:22:52.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94124750967376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20589e90 con 0x559b2057d450 2024-09-10T06:22:52.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058a850 con 0x559b20578a90 2024-09-10T06:22:52.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94124750967376] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94124750961648] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94124750971808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20589e90 con 0x559b20578a90 2024-09-10T06:22:52.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.737+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058a7c0 con 0x7f73cc04c060 2024-09-10T06:22:52.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.741+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94124750971808] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.741+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.741+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94124750969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20589e00 con 0x7f73cc04c060 2024-09-10T06:22:52.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.741+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058b680 con 0x7f73cc04c060 2024-09-10T06:22:52.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.741+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94124750969312] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94124750973872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058b680 con 0x7f73cc04c060 2024-09-10T06:22:52.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058c040 con 0x7f73cc04c060 2024-09-10T06:22:52.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94124750977936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058c460 con 0x7f73cc04c060 2024-09-10T06:22:52.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=0 2024-09-10T06:22:52.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=1 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=2 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=3 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=4 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=5 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94124750973872] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.745+0000 7f73d4ced9c0 20 add_watcher() i=6 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94124750977936] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 add_watcher() i=7 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2058c460 con 0x559b20578a90 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94124750978992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2058c3d0 con 0x559b20578a90 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94124750978992] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f7288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 5 note: GC not initialized 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f72037fe640 20 reqs_thread_entry: start 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 Filter name: none 2024-09-10T06:22:52.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f72017fa640 20 reqs_thread_entry: start 2024-09-10T06:22:52.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:52.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b205b2b60 con 0x559b20578a90 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b205b25b0 con 0x559b20578a90 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.749+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b96a0 con 0x559b20578a90 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94124751163664 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b205b4f30 con 0x559b20578a90 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== watch-notify(notify (1) cookie 94124750971808 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f73c4010040 con 0x559b20578a90 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94124750971808 notifier 4360 bl.length()=732 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b5ffb640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7298003eb0 con 0x559b20578a90 2024-09-10T06:22:52.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify cookie 94124751163664 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94124751163664 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f73c400aaf0 con 0x559b20578a90 2024-09-10T06:22:52.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b4f30 con 0x559b20578a90 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94124751163664 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b205b4f30 con 0x559b2057d450 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== watch-notify(notify (1) cookie 94124750954272 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x559b2055b1d0 con 0x559b2057d450 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94124750954272 notifier 4360 bl.length()=166 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T06:22:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b57fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T06:22:52.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.0 [notify cookie 94124751163664 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f72b57fa640 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7208003410 con 0x559b2057d450 2024-09-10T06:22:52.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.753+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== watch-notify(notify_complete (2) cookie 94124751163664 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b2055a970 con 0x559b2057d450 2024-09-10T06:22:52.759 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"H1A1yNSIWjNyq8cwA2HYZo8urbibueDIxXuh9xee","active":true,"create_date":"2024-09-10T06:22:52.754806Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f7288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94124750978992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b0890 con 0x559b20578a90 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94124750978992] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94124750954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b0890 con 0x559b2057d450 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94124750954272] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d4ced9c0 20 remove_watcher() i=0 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d4ced9c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.757+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94124750960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20585f20 con 0x559b20578a90 2024-09-10T06:22:52.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94124750960288] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 20 remove_watcher() i=1 2024-09-10T06:22:52.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94124750961648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b0890 con 0x559b20581d70 2024-09-10T06:22:52.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d1ff2640 1 -- 172.21.15.117:0/3500095445 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94124750961648] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80a8070 con 0x559b20581d70 2024-09-10T06:22:52.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 20 remove_watcher() i=2 2024-09-10T06:22:52.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94124750967376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205876a0 con 0x559b2057d450 2024-09-10T06:22:52.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d27f3640 1 -- 172.21.15.117:0/3500095445 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94124750967376] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc049030 con 0x559b2057d450 2024-09-10T06:22:52.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 20 remove_watcher() i=3 2024-09-10T06:22:52.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.761+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94124750971808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20585f20 con 0x559b20578a90 2024-09-10T06:22:52.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94124750971808] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x559b20578a90 2024-09-10T06:22:52.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d4ced9c0 20 remove_watcher() i=4 2024-09-10T06:22:52.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94124750969312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205b0890 con 0x7f73cc04c060 2024-09-10T06:22:52.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94124750969312] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d4ced9c0 20 remove_watcher() i=5 2024-09-10T06:22:52.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.765+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94124750973872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b20589250 con 0x7f73cc04c060 2024-09-10T06:22:52.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94124750973872] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 20 remove_watcher() i=6 2024-09-10T06:22:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94124750977936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b205876a0 con 0x7f73cc04c060 2024-09-10T06:22:52.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94124750977936] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4026040 con 0x7f73cc04c060 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 20 remove_watcher() i=7 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f73cc04c060 msgr2=0x7f73cc037910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f73cc04c060 0x7f73cc037910 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b20578a90 msgr2=0x559b2057af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b20578a90 0x559b2057af20 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b2057d450 msgr2=0x559b2057f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b2057d450 0x559b2057f840 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b20581d70 msgr2=0x559b205841a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b20581d70 0x559b205841a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f729c039a70 msgr2=0x7f729c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f729c039a70 0x7f729c03bf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f73c80cd040 tx=0x7f73c80a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 msgr2=0x559b2056d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d2ff4640 1 -- 172.21.15.117:0/3500095445 reap_dead start 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f73cc012b40 tx=0x7f73cc059000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 shutdown_connections 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/3500095445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b205666a0 0x559b2056d990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 >> 172.21.15.117:0/3500095445 conn(0x559b20562ad0 msgr2=0x559b20560ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 shutdown_connections 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/3500095445 wait complete. 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 msgr2=0x7f72ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 0x7f72ac03bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f73c80aa650 tx=0x7f73c8005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 msgr2=0x559b2055a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73cc04ebe0 tx=0x7f73cc010ef0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 shutdown_connections 2024-09-10T06:22:52.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72ac039a70 0x7f72ac03bf30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/297256706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20559f10 0x559b2055a330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 >> 172.21.15.117:0/297256706 conn(0x559b2054f8c0 msgr2=0x559b2054fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 shutdown_connections 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.769+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/297256706 wait complete. 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b2044a560 msgr2=0x559b205431f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559b2044a560 0x559b205431f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b205459d0 msgr2=0x559b20547dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559b205459d0 0x559b20547dc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b205498d0 msgr2=0x559b2054bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559b205498d0 0x559b2054bcc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72b8039ac0 msgr2=0x7f72b803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72b8039ac0 0x7f72b803bf80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ae000 tx=0x7f73c80a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 msgr2=0x559b2053c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 --2- 172.21.15.117:0/896266753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b20446370 0x559b2053c080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0012f0 tx=0x7f73cc000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d2ff4640 1 -- 172.21.15.117:0/896266753 reap_dead start 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 shutdown_connections 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 >> 172.21.15.117:0/896266753 conn(0x559b20441e90 msgr2=0x559b2052be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 shutdown_connections 2024-09-10T06:22:52.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.773+0000 7f73d4ced9c0 1 -- 172.21.15.117:0/896266753 wait complete. 2024-09-10T06:22:52.783 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'H1A1yNSIWjNyq8cwA2HYZo8urbibueDIxXuh9xee', 'active': True, 'create_date': '2024-09-10T06:22:52.754806Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T06:22:52.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T06:22:52.784 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-10T06:22:52.860 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:52.860 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:52.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d9b7d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56065b55d850 0x56065b55fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d9b7d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56065b40b9c0 con 0x56065b559700 2024-09-10T06:22:52.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d9b7d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56065b45b6d0 con 0x56065b55d850 2024-09-10T06:22:52.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d7683640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x56065b559700 0x56065b559ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44262/0 (socket says 172.21.15.117:44262) 2024-09-10T06:22:52.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d7683640 1 -- 172.21.15.117:0/1647474094 learned_addr learned my addr 172.21.15.117:0/1647474094 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:52.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.857+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1647474094 >> v2:172.21.15.84:3300/0 conn(0x56065b55d850 0x56065b55fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6e82640 1 -- 172.21.15.117:0/1647474094 >> v1:172.21.15.84:6789/0 conn(0x56065b559700 legacy=0x56065b559ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6e82640 1 -- 172.21.15.117:0/1647474094 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b3ffca0 con 0x56065b55d850 2024-09-10T06:22:52.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1647474094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b55d850 0x56065b55fc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f83c400a480 tx=0x7f83c401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bda9397c6b684b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6681640 1 -- 172.21.15.117:0/1647474094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c40aa570 con 0x56065b55d850 2024-09-10T06:22:52.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6681640 1 -- 172.21.15.117:0/1647474094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c40af070 con 0x56065b55d850 2024-09-10T06:22:52.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d6681640 1 -- 172.21.15.117:0/1647474094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c40aa860 con 0x56065b55d850 2024-09-10T06:22:52.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1647474094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b55d850 msgr2=0x56065b55fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1647474094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b55d850 0x56065b55fc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f83c400a480 tx=0x7f83c401b310 comp rx=0 tx=0).stop 2024-09-10T06:22:52.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1647474094 shutdown_connections 2024-09-10T06:22:52.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1647474094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b55d850 0x56065b55fc40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1647474094 >> 172.21.15.117:0/1647474094 conn(0x56065b4cd010 msgr2=0x56065b4cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1647474094 shutdown_connections 2024-09-10T06:22:52.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.861+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1647474094 wait complete. 2024-09-10T06:22:52.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56065b45f680 con 0x56065b559700 2024-09-10T06:22:52.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42398/0 (socket says 172.21.15.117:42398) 2024-09-10T06:22:52.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d7683640 1 -- 172.21.15.117:0/677752720 learned_addr learned my addr 172.21.15.117:0/677752720 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d7683640 1 -- 172.21.15.117:0/677752720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b3dada0 con 0x56065b559700 2024-09-10T06:22:52.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d7683640 1 --2- 172.21.15.117:0/677752720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83c8001e50 tx=0x7f83c8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188d95e18ca01285 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f82c4e11640 1 -- 172.21.15.117:0/677752720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c8012020 con 0x56065b559700 2024-09-10T06:22:52.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f82c4e11640 1 -- 172.21.15.117:0/677752720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c800e7c0 con 0x56065b559700 2024-09-10T06:22:52.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f82c4e11640 1 -- 172.21.15.117:0/677752720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c800eaa0 con 0x56065b559700 2024-09-10T06:22:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/677752720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 msgr2=0x56065b644a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.877+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/677752720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f83c8001e50 tx=0x7f83c8001e80 comp rx=0 tx=0).stop 2024-09-10T06:22:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/677752720 shutdown_connections 2024-09-10T06:22:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/677752720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b644a50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/677752720 >> 172.21.15.117:0/677752720 conn(0x56065b4cd010 msgr2=0x56065b6406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/677752720 shutdown_connections 2024-09-10T06:22:52.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/677752720 wait complete. 2024-09-10T06:22:52.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b64c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56065b401a50 con 0x56065b559700 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b64c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b64c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42400/0 (socket says 172.21.15.117:42400) 2024-09-10T06:22:52.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d7683640 1 -- 172.21.15.117:0/2932391069 learned_addr learned my addr 172.21.15.117:0/2932391069 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d7683640 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b64c650 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d7683640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b64c0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56065b645a40 tx=0x7f83c8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 -- 172.21.15.117:0/2932391069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c8012030 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56065b64c8e0 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 -- 172.21.15.117:0/2932391069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c801a680 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 -- 172.21.15.117:0/2932391069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c801a960 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065b64d290 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 -- 172.21.15.117:0/2932391069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83c8015020 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82bc039a70 0x7f82bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f82c360e640 1 -- 172.21.15.117:0/2932391069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f83c8020070 con 0x56065b559700 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.881+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82bc039a70 0x7f82bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b55d850 0x56065b653260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6537a0 con 0x56065b55d850 2024-09-10T06:22:52.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7e84640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b55d850 0x56065b653260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82bc039a70 0x7f82bc03bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ae000 tx=0x7f83c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7e84640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b55d850 0x56065b653260 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7e84640 1 -- 172.21.15.117:0/2932391069 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b55d850 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b64d5d0 con 0x56065b55d850 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7e84640 1 -- 172.21.15.117:0/2932391069 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b55d850 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b655a10 0x56065b657e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6584f0 con 0x56065b655a10 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b655a10 0x56065b657e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b655a10 0x56065b657e00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 -- 172.21.15.117:0/2932391069 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83c8008030 con 0x56065b655a10 2024-09-10T06:22:52.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6548b0 con 0x56065b55d850 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7e84640 1 -- 172.21.15.117:0/2932391069 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b55d850 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b659950 0x56065b65bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b65c480 con 0x56065b659950 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b659950 0x56065b65bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b659950 0x56065b65bd40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d6e82640 1 -- 172.21.15.117:0/2932391069 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b659950 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d9b7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56065b46c450 con 0x56065b669f40 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42404/0 (socket says 172.21.15.117:42404) 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.885+0000 7f83d7683640 1 -- 172.21.15.117:0/2973204792 learned_addr learned my addr 172.21.15.117:0/2973204792 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 -- 172.21.15.117:0/2973204792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b66a9a0 con 0x56065b669f40 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83c802c890 tx=0x7f83c800d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 -- 172.21.15.117:0/2973204792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c80502c0 con 0x56065b669f40 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56065b66b200 con 0x56065b669f40 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 -- 172.21.15.117:0/2973204792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c8016b00 con 0x56065b669f40 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 -- 172.21.15.117:0/2973204792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c8016de0 con 0x56065b669f40 2024-09-10T06:22:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065b66b770 con 0x56065b669f40 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 -- 172.21.15.117:0/2973204792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83c8009070 con 0x56065b669f40 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 0x7f82b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f82c0e09640 1 -- 172.21.15.117:0/2973204792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f83c8005050 con 0x56065b669f40 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 0x7f82b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d6e82640 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 0x7f82b003bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56065b653be0 tx=0x7f83c4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d9b7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56065b6452a0 con 0x56065b676680 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42414/0 (socket says 172.21.15.117:42414) 2024-09-10T06:22:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 -- 172.21.15.117:0/2791226462 learned_addr learned my addr 172.21.15.117:0/2791226462 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.889+0000 7f83d7683640 1 -- 172.21.15.117:0/2791226462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b677030 con 0x56065b676680 2024-09-10T06:22:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 --2- 172.21.15.117:0/2791226462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83c8048170 tx=0x7f83c8047b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7373997b86f64ede server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82ba7fc640 1 -- 172.21.15.117:0/2791226462 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c8057040 con 0x56065b676680 2024-09-10T06:22:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82ba7fc640 1 -- 172.21.15.117:0/2791226462 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c8060070 con 0x56065b676680 2024-09-10T06:22:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82ba7fc640 1 -- 172.21.15.117:0/2791226462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c804ab50 con 0x56065b676680 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2791226462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 msgr2=0x56065b676a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2791226462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f83c8048170 tx=0x7f83c8047b40 comp rx=0 tx=0).stop 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2791226462 shutdown_connections 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2791226462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b676a60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2791226462 >> 172.21.15.117:0/2791226462 conn(0x56065b672ab0 msgr2=0x56065b670cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2791226462 shutdown_connections 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2791226462 wait complete. 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 Processor -- start 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- start start 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56065b677510 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42428/0 (socket says 172.21.15.117:42428) 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 learned_addr learned my addr 172.21.15.117:0/1299615735 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065b67df70 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d7683640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83c8048170 tx=0x7f83c8012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82b8ff9640 1 -- 172.21.15.117:0/1299615735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c804ab50 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56065b67df70 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065b67df70 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82b8ff9640 1 -- 172.21.15.117:0/1299615735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c806b070 con 0x56065b676680 2024-09-10T06:22:52.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.893+0000 7f82b8ff9640 1 -- 172.21.15.117:0/1299615735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c804ad30 con 0x56065b676680 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f82b8ff9640 1 -- 172.21.15.117:0/1299615735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83c804d2f0 con 0x56065b676680 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f82b8ff9640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82a00399d0 0x7f82a003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f82b8ff9640 1 -- 172.21.15.117:0/1299615735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f83c805f180 con 0x56065b676680 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82a00399d0 0x7f82a003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b688b50 0x56065b68afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b68b730 con 0x56065b688b50 2024-09-10T06:22:52.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b688b50 0x56065b68afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82a00399d0 0x7f82a003be90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83c400a480 tx=0x7f83c40a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b688b50 0x56065b68afe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 realm 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b68bb90 con 0x56065b688b50 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c460 con 0x56065b688b50 2024-09-10T06:22:52.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b68d560 0x56065b68f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b68ffa0 con 0x56065b68d560 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b68d560 0x56065b68f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b68d560 0x56065b68f950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 20 searching for the correct realm 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b691e80 0x56065b6942b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b694930 con 0x56065b691e80 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b691e80 0x56065b6942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b691e80 0x56065b6942b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b694930 con 0x56065b68d560 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f83c8067040 0x7f83c805ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b694930 con 0x7f83c8067040 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.897+0000 7f83d7e84640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f83c8067040 0x7f83c805ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:52.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f83c8067040 0x7f83c805ba60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:52.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b68d560 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.901+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b68d560 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.905+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b68d560 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b68d560 2024-09-10T06:22:52.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b691e80 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x7f83c8067040 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b688b50 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56065b68c800 con 0x56065b68d560 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:52.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6907f0 con 0x56065b688b50 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.909+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b690be0 con 0x56065b688b50 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b690be0 con 0x56065b691e80 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 zone default found 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 4 Realm: () 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 zonegroup default 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b694db0 con 0x7f83c8067040 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6968a0 con 0x56065b691e80 2024-09-10T06:22:52.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b696c90 con 0x56065b691e80 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b695c40 con 0x56065b68d560 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585303425120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6958a0 con 0x56065b68d560 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b697ba0 con 0x56065b688b50 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.913+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585303425120] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585303429328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b697ba0 con 0x56065b688b50 2024-09-10T06:22:52.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b698560 con 0x56065b691e80 2024-09-10T06:22:52.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585303433392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b698db0 con 0x56065b691e80 2024-09-10T06:22:52.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585303429328] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.917+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6997b0 con 0x56065b68d560 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585303430896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b699ba0 con 0x56065b68d560 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69a560 con 0x56065b688b50 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585303433392] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585303430896] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585303438016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69a0b0 con 0x56065b688b50 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69a900 con 0x7f83c8067040 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.921+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585303438016] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585303441584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69acf0 con 0x7f83c8067040 2024-09-10T06:22:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69b540 con 0x7f83c8067040 2024-09-10T06:22:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585303441584] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585303442640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69b1a0 con 0x7f83c8067040 2024-09-10T06:22:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.925+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69bc00 con 0x7f83c8067040 2024-09-10T06:22:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585303447264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69c0b0 con 0x7f83c8067040 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=0 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=1 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=2 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=3 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=4 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=5 2024-09-10T06:22:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585303442640] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=6 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585303447264] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 20 add_watcher() i=7 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b69c0b0 con 0x56065b688b50 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.929+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585303448576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69c020 con 0x56065b688b50 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585303448576] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f828d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 5 note: GC not initialized 2024-09-10T06:22:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f8207fff640 20 reqs_thread_entry: start 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 Filter name: none 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f8205ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c2730 con 0x56065b688b50 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c91e0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94585303632976 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94585303438016 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f83d0026410 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f82ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94585303438016 notifier 4366 bl.length()=732 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f82ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f82ba7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(64 notify.4 [notify cookie 94585303632976 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f82ba7fc640 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f829c003eb0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.933+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94585303632976 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f83d00265e0 con 0x56065b688b50 2024-09-10T06:22:52.939 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f828d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585303448576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c4440 con 0x56065b688b50 2024-09-10T06:22:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94585303448576] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585303425120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b68d560 2024-09-10T06:22:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94585303425120] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d9b7d9c0 20 remove_watcher() i=0 2024-09-10T06:22:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d9b7d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.937+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585303429328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b688b50 2024-09-10T06:22:52.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94585303429328] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 20 remove_watcher() i=1 2024-09-10T06:22:52.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585303433392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b691e80 2024-09-10T06:22:52.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d6e82640 1 -- 172.21.15.117:0/1299615735 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94585303433392] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c40a8070 con 0x56065b691e80 2024-09-10T06:22:52.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 20 remove_watcher() i=2 2024-09-10T06:22:52.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585303430896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b68d560 2024-09-10T06:22:52.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d7683640 1 -- 172.21.15.117:0/1299615735 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94585303430896] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83c803b020 con 0x56065b68d560 2024-09-10T06:22:52.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 20 remove_watcher() i=3 2024-09-10T06:22:52.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.941+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585303438016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x56065b688b50 2024-09-10T06:22:52.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94585303438016] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x56065b688b50 2024-09-10T06:22:52.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d9b7d9c0 20 remove_watcher() i=4 2024-09-10T06:22:52.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585303441584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x7f83c8067040 2024-09-10T06:22:52.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94585303441584] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d9b7d9c0 20 remove_watcher() i=5 2024-09-10T06:22:52.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.945+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585303442640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b6c48f0 con 0x7f83c8067040 2024-09-10T06:22:52.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.949+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94585303442640] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.949+0000 7f83d9b7d9c0 20 remove_watcher() i=6 2024-09-10T06:22:52.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.949+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585303447264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56065b69bc00 con 0x7f83c8067040 2024-09-10T06:22:52.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.949+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94585303447264] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83d000a4d0 con 0x7f83c8067040 2024-09-10T06:22:52.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.949+0000 7f83d9b7d9c0 20 remove_watcher() i=7 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f83c8067040 msgr2=0x7f83c805ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f83c8067040 0x7f83c805ba60 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b688b50 msgr2=0x56065b68afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b688b50 0x56065b68afe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b68d560 msgr2=0x56065b68f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b68d560 0x56065b68f950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b691e80 msgr2=0x56065b6942b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b691e80 0x56065b6942b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82a00399d0 msgr2=0x7f82a003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82a00399d0 0x7f82a003be90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83c400a480 tx=0x7f83c40a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 msgr2=0x56065b67da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d7e84640 1 -- 172.21.15.117:0/1299615735 reap_dead start 2024-09-10T06:22:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83c8048170 tx=0x7f83c8012f50 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 shutdown_connections 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/1299615735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b676680 0x56065b67da10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 >> 172.21.15.117:0/1299615735 conn(0x56065b672ab0 msgr2=0x56065b670cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 shutdown_connections 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/1299615735 wait complete. 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 msgr2=0x7f82b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 0x7f82b003bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56065b653be0 tx=0x7f83c4005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 msgr2=0x56065b66a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83c802c890 tx=0x7f83c800d7b0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 shutdown_connections 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82b0039a70 0x7f82b003bf30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2973204792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b669f40 0x56065b66a360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 >> 172.21.15.117:0/2973204792 conn(0x56065b65f8f0 msgr2=0x56065b65fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 shutdown_connections 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2973204792 wait complete. 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b55d850 msgr2=0x56065b653260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56065b55d850 0x56065b653260 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b655a10 msgr2=0x56065b657e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56065b655a10 0x56065b657e00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b659950 msgr2=0x56065b65bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56065b659950 0x56065b65bd40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82bc039a70 msgr2=0x7f82bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f82bc039a70 0x7f82bc03bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ae000 tx=0x7f83c40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 msgr2=0x56065b64c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 --2- 172.21.15.117:0/2932391069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56065b559700 0x56065b64c0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56065b645a40 tx=0x7f83c8000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d7e84640 1 -- 172.21.15.117:0/2932391069 reap_dead start 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 shutdown_connections 2024-09-10T06:22:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 >> 172.21.15.117:0/2932391069 conn(0x56065b4cd010 msgr2=0x56065b63f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 shutdown_connections 2024-09-10T06:22:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:52.953+0000 7f83d9b7d9c0 1 -- 172.21.15.117:0/2932391069 wait complete. 2024-09-10T06:22:52.964 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:52.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:52.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:52.965 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:53.039 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.039 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab642d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558624e96370 0x558624e96750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab642d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558624d4b9c0 con 0x558624e99550 2024-09-10T06:22:53.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab642d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x558624d9b6d0 con 0x558624e96370 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3f33640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558624e96370 0x558624e96750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3f33640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558624e96370 0x558624e96750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42430/0 (socket says 172.21.15.117:42430) 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3732640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x558624e99550 0x558624e9b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44266/0 (socket says 172.21.15.117:44266) 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3f33640 1 -- 172.21.15.117:0/3826646837 learned_addr learned my addr 172.21.15.117:0/3826646837 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3f33640 1 -- 172.21.15.117:0/3826646837 >> v1:172.21.15.84:6789/0 conn(0x558624e99550 legacy=0x558624e9b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.037+0000 7f8ab3f33640 1 -- 172.21.15.117:0/3826646837 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624d3fca0 con 0x558624e96370 2024-09-10T06:22:53.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/3826646837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624e96750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400a5c0 tx=0x7f8aa401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f177f9f031aa919 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab2f31640 1 -- 172.21.15.117:0/3826646837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40a6070 con 0x558624e96370 2024-09-10T06:22:53.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab2f31640 1 -- 172.21.15.117:0/3826646837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40af070 con 0x558624e96370 2024-09-10T06:22:53.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab2f31640 1 -- 172.21.15.117:0/3826646837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40aa5c0 con 0x558624e96370 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3826646837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 msgr2=0x558624e96750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/3826646837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624e96750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400a5c0 tx=0x7f8aa401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3826646837 shutdown_connections 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/3826646837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624e96750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3826646837 >> 172.21.15.117:0/3826646837 conn(0x558624e91e90 msgr2=0x558624e942b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3826646837 shutdown_connections 2024-09-10T06:22:53.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.041+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3826646837 wait complete. 2024-09-10T06:22:53.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.053+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.053+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.053+0000 7f8ab642d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.053+0000 7f8ab642d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558624d9f680 con 0x558624e96370 2024-09-10T06:22:53.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42440/0 (socket says 172.21.15.117:42440) 2024-09-10T06:22:53.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 -- 172.21.15.117:0/2380066098 learned_addr learned my addr 172.21.15.117:0/2380066098 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 -- 172.21.15.117:0/2380066098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624d1ada0 con 0x558624e96370 2024-09-10T06:22:53.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/2380066098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4018f70 tx=0x7f8aa4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e603bf2267fe36a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f89a1e0b640 1 -- 172.21.15.117:0/2380066098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40aa8b0 con 0x558624e96370 2024-09-10T06:22:53.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f89a1e0b640 1 -- 172.21.15.117:0/2380066098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40aaa50 con 0x558624e96370 2024-09-10T06:22:53.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f89a1e0b640 1 -- 172.21.15.117:0/2380066098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40aad30 con 0x558624e96370 2024-09-10T06:22:53.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2380066098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 msgr2=0x558624f84960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2380066098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4018f70 tx=0x7f8aa4003030 comp rx=0 tx=0).stop 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2380066098 shutdown_connections 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2380066098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f84960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2380066098 >> 172.21.15.117:0/2380066098 conn(0x558624e91e90 msgr2=0x558624f7c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2380066098 shutdown_connections 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2380066098 wait complete. 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f8bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab642d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558624d41a50 con 0x558624e96370 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f8bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f8bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42450/0 (socket says 172.21.15.117:42450) 2024-09-10T06:22:53.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 -- 172.21.15.117:0/2772688284 learned_addr learned my addr 172.21.15.117:0/2772688284 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.057+0000 7f8ab3f33640 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624f8c400 con 0x558624e96370 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f8bea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4018f70 tx=0x7f8aa40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 -- 172.21.15.117:0/2772688284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40c6690 con 0x558624e96370 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558624f8c690 con 0x558624e96370 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 -- 172.21.15.117:0/2772688284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40c6830 con 0x558624e96370 2024-09-10T06:22:53.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558624f8d040 con 0x558624e96370 2024-09-10T06:22:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 -- 172.21.15.117:0/2772688284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40c6b30 con 0x558624e96370 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 -- 172.21.15.117:0/2772688284 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8aa40ce030 con 0x558624e96370 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f899c039a70 0x7f899c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f899bfff640 1 -- 172.21.15.117:0/2772688284 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8aa40cc020 con 0x558624e96370 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab3732640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f899c039a70 0x7f899c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624e99550 0x558624f93010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624f93550 con 0x558624e99550 2024-09-10T06:22:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab4734640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624e99550 0x558624f93010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab3732640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f899c039a70 0x7f899c03bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8001e90 tx=0x7f8aa80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab4734640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624e99550 0x558624f93010 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab4734640 1 -- 172.21.15.117:0/2772688284 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624e99550 2024-09-10T06:22:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624f8d490 con 0x558624e99550 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab4734640 1 -- 172.21.15.117:0/2772688284 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624e99550 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624f95810 0x558624f97c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624f982f0 con 0x558624f95810 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624f95810 0x558624f97c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.061+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624f95810 0x558624f97c00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 -- 172.21.15.117:0/2772688284 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8aa40bc580 con 0x558624f95810 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624f946b0 con 0x558624e99550 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab4734640 1 -- 172.21.15.117:0/2772688284 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624e99550 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624f99750 0x558624f9bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624f9c280 con 0x558624f99750 2024-09-10T06:22:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3732640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624f99750 0x558624f9bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3732640 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624f99750 0x558624f9bb40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3732640 1 -- 172.21.15.117:0/2772688284 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8aa800f6e0 con 0x558624f99750 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558624dac450 con 0x558624fa9d80 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42466/0 (socket says 172.21.15.117:42466) 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 -- 172.21.15.117:0/133247638 learned_addr learned my addr 172.21.15.117:0/133247638 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 -- 172.21.15.117:0/133247638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624faa7e0 con 0x558624fa9d80 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40bc910 tx=0x7f8aa40bce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f89997fa640 1 -- 172.21.15.117:0/133247638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40cf6b0 con 0x558624fa9d80 2024-09-10T06:22:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f89997fa640 1 -- 172.21.15.117:0/133247638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40cf850 con 0x558624fa9d80 2024-09-10T06:22:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558624fab040 con 0x558624fa9d80 2024-09-10T06:22:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f89997fa640 1 -- 172.21.15.117:0/133247638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40ebbb0 con 0x558624fa9d80 2024-09-10T06:22:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.065+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558624fab5b0 con 0x558624fa9d80 2024-09-10T06:22:53.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f89997fa640 1 -- 172.21.15.117:0/133247638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8aa40d8040 con 0x558624fa9d80 2024-09-10T06:22:53.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f89997fa640 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 0x7f898c03bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f89997fa640 1 -- 172.21.15.117:0/133247638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8aa40073f0 con 0x558624fa9d80 2024-09-10T06:22:53.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3732640 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 0x7f898c03bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3732640 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 0x7f898c03bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x558624f93990 tx=0x7f8aa800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558624f850f0 con 0x558624fb7510 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42480/0 (socket says 172.21.15.117:42480) 2024-09-10T06:22:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3f33640 1 -- 172.21.15.117:0/3849049525 learned_addr learned my addr 172.21.15.117:0/3849049525 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3f33640 1 -- 172.21.15.117:0/3849049525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624fb7ee0 con 0x558624fb7510 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/3849049525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40057f0 tx=0x7f8aa40e5c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2535f805df852b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8992ffd640 1 -- 172.21.15.117:0/3849049525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40e5440 con 0x558624fb7510 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8992ffd640 1 -- 172.21.15.117:0/3849049525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40fd070 con 0x558624fb7510 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8992ffd640 1 -- 172.21.15.117:0/3849049525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40e8120 con 0x558624fb7510 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3849049525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 msgr2=0x558624fb78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/3849049525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40057f0 tx=0x7f8aa40e5c20 comp rx=0 tx=0).stop 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3849049525 shutdown_connections 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/3849049525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fb78f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3849049525 >> 172.21.15.117:0/3849049525 conn(0x558624fb28d0 msgr2=0x558624fb0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3849049525 shutdown_connections 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/3849049525 wait complete. 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.069+0000 7f8ab642d9c0 1 Processor -- start 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 -- start start 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fbd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558624fb6280 con 0x558624fb7510 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fbd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3f33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fbd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42484/0 (socket says 172.21.15.117:42484) 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 learned_addr learned my addr 172.21.15.117:0/67297197 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558624fbdda0 con 0x558624fb7510 2024-09-10T06:22:53.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fbd840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40e5c60 tx=0x7f8aa40b8f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 -- 172.21.15.117:0/67297197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa4111070 con 0x558624fb7510 2024-09-10T06:22:53.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558624fbdda0 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558624fbe210 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 -- 172.21.15.117:0/67297197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40fd040 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 -- 172.21.15.117:0/67297197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40e59c0 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 -- 172.21.15.117:0/67297197 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8aa4114070 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f897c039a20 0x7f897c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f89917fa640 1 -- 172.21.15.117:0/67297197 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8aa40fa850 con 0x558624fb7510 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3732640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f897c039a20 0x7f897c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624fc88a0 0x558624fcad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fcb480 con 0x558624fc88a0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab4734640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624fc88a0 0x558624fcad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab3732640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f897c039a20 0x7f897c03bee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x558624f9c680 tx=0x7f8aa8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.073+0000 7f8ab4734640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624fc88a0 0x558624fcad30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 realm 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fcb890 con 0x558624fc88a0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc160 con 0x558624fc88a0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624fcd030 0x558624fcf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fcfb60 con 0x558624fcd030 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624fcd030 0x558624fcf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624fcd030 0x558624fcf420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 20 searching for the correct realm 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624fd1b00 0x558624fd3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fd4670 con 0x558624fd1b00 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3732640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624fd1b00 0x558624fd3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3732640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624fd1b00 0x558624fd3fa0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fd4670 con 0x558624fcd030 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8aa4116060 0x7f8aa40fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fd4670 con 0x7f8aa4116060 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8aa4116060 0x7f8aa40fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.077+0000 7f8ab4734640 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8aa4116060 0x7f8aa40fa040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fcd030 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fcd030 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.081+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fcd030 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.085+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fcd030 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fd1b00 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x7f8aa4116060 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fc88a0 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558624fcc500 con 0x558624fcd030 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:53.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd0420 con 0x558624fc88a0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd0810 con 0x558624fc88a0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd0810 con 0x558624fd1b00 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 zone default found 2024-09-10T06:22:53.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 4 Realm: () 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 zonegroup default 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd4af0 con 0x7f8aa4116060 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd64e0 con 0x558624fd1b00 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fd6880 con 0x558624fd1b00 2024-09-10T06:22:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:53.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.089+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd5980 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94034634562928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd55e0 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd7780 con 0x558624fc88a0 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94034634562928] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94034634568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd76f0 con 0x558624fc88a0 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.093+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd8530 con 0x558624fd1b00 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94034634568400] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94034634570608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd8920 con 0x558624fd1b00 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd92e0 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94034634577536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd9f50 con 0x558624fcd030 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fda910 con 0x558624fc88a0 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94034634570608] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.097+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94034634577536] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94034634578592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd9ec0 con 0x558624fc88a0 2024-09-10T06:22:53.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdadc0 con 0x7f8aa4116060 2024-09-10T06:22:53.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94034634578592] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94034634581088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdad30 con 0x7f8aa4116060 2024-09-10T06:22:53.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.101+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdb600 con 0x7f8aa4116060 2024-09-10T06:22:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94034634581088] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94034634582144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdb7e0 con 0x7f8aa4116060 2024-09-10T06:22:53.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdc030 con 0x7f8aa4116060 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94034634582144] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94034634586080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdc0b0 con 0x7f8aa4116060 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=0 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=1 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=2 2024-09-10T06:22:53.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=3 2024-09-10T06:22:53.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=4 2024-09-10T06:22:53.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=5 2024-09-10T06:22:53.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.105+0000 7f8ab642d9c0 20 add_watcher() i=6 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94034634586080] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 add_watcher() i=7 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558624fdf370 con 0x558624fc88a0 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94034634587504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdc640 con 0x558624fc88a0 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94034634587504] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 5 note: GC not initialized 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8968fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 Filter name: none 2024-09-10T06:22:53.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f88e27fc640 20 reqs_thread_entry: start 2024-09-10T06:22:53.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.109+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558625002570 con 0x558624fc88a0 2024-09-10T06:22:53.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T06:22:53.115 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:53.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94034634587504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558625001020 con 0x558624fc88a0 2024-09-10T06:22:53.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94034634587504] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94034634562928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdbd70 con 0x558624fcd030 2024-09-10T06:22:53.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94034634562928] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 20 remove_watcher() i=0 2024-09-10T06:22:53.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:53.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.113+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94034634568400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdbd70 con 0x558624fc88a0 2024-09-10T06:22:53.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94034634568400] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab642d9c0 20 remove_watcher() i=1 2024-09-10T06:22:53.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94034634570608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd72d0 con 0x558624fd1b00 2024-09-10T06:22:53.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab3732640 1 -- 172.21.15.117:0/67297197 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94034634570608] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8037040 con 0x558624fd1b00 2024-09-10T06:22:53.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab642d9c0 20 remove_watcher() i=2 2024-09-10T06:22:53.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.117+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94034634577536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdbd70 con 0x558624fcd030 2024-09-10T06:22:53.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab3f33640 1 -- 172.21.15.117:0/67297197 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94034634577536] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa4113030 con 0x558624fcd030 2024-09-10T06:22:53.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 20 remove_watcher() i=3 2024-09-10T06:22:53.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94034634578592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd7b70 con 0x558624fc88a0 2024-09-10T06:22:53.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94034634578592] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x558624fc88a0 2024-09-10T06:22:53.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 20 remove_watcher() i=4 2024-09-10T06:22:53.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94034634581088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdbd70 con 0x7f8aa4116060 2024-09-10T06:22:53.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94034634581088] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 20 remove_watcher() i=5 2024-09-10T06:22:53.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.121+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94034634582144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fd7b70 con 0x7f8aa4116060 2024-09-10T06:22:53.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94034634582144] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 20 remove_watcher() i=6 2024-09-10T06:22:53.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94034634586080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558624fdbd70 con 0x7f8aa4116060 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94034634586080] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac00a4d0 con 0x7f8aa4116060 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 20 remove_watcher() i=7 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8aa4116060 msgr2=0x7f8aa40fa040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8aa4116060 0x7f8aa40fa040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624fc88a0 msgr2=0x558624fcad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624fc88a0 0x558624fcad30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624fcd030 msgr2=0x558624fcf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624fcd030 0x558624fcf420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624fd1b00 msgr2=0x558624fd3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624fd1b00 0x558624fd3fa0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.125+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f897c039a20 msgr2=0x7f897c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f897c039a20 0x7f897c03bee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x558624f9c680 tx=0x7f8aa8010000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 msgr2=0x558624fbd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/67297197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fb7510 0x558624fbd840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40e5c60 tx=0x7f8aa40b8f60 comp rx=0 tx=0).stop 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 reap_dead start 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab4734640 1 -- 172.21.15.117:0/67297197 reap_dead start 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 shutdown_connections 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 >> 172.21.15.117:0/67297197 conn(0x558624fb28d0 msgr2=0x558624fb0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 shutdown_connections 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/67297197 wait complete. 2024-09-10T06:22:53.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 msgr2=0x7f898c03bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 0x7f898c03bea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x558624f93990 tx=0x7f8aa800f000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 msgr2=0x558624faa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40bc910 tx=0x7f8aa40bce80 comp rx=0 tx=0).stop 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 shutdown_connections 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f898c0399e0 0x7f898c03bea0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/133247638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624fa9d80 0x558624faa1a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 >> 172.21.15.117:0/133247638 conn(0x558624f9f730 msgr2=0x558624f9fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 shutdown_connections 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/133247638 wait complete. 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624e99550 msgr2=0x558624f93010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558624e99550 0x558624f93010 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624f95810 msgr2=0x558624f97c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558624f95810 0x558624f97c00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624f99750 msgr2=0x558624f9bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558624f99750 0x558624f9bb40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f899c039a70 msgr2=0x7f899c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f899c039a70 0x7f899c03bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8001e90 tx=0x7f8aa80013f0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 msgr2=0x558624f8bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 --2- 172.21.15.117:0/2772688284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558624e96370 0x558624f8bea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4018f70 tx=0x7f8aa40180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab4734640 1 -- 172.21.15.117:0/2772688284 reap_dead start 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 shutdown_connections 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 >> 172.21.15.117:0/2772688284 conn(0x558624e91e90 msgr2=0x558624f7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 shutdown_connections 2024-09-10T06:22:53.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.129+0000 7f8ab642d9c0 1 -- 172.21.15.117:0/2772688284 wait complete. 2024-09-10T06:22:53.140 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:53.140 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:53.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:53.140 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:53.211 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.211 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c94d99c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55af19c7f560 0x55af19c81950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c94d99c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55af19b309c0 con 0x55af19c7b370 2024-09-10T06:22:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c94d99c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55af19b806d0 con 0x55af19c7f560 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c67de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55af19c7f560 0x55af19c81950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c67de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55af19c7f560 0x55af19c81950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42492/0 (socket says 172.21.15.117:42492) 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c67de640 1 -- 172.21.15.117:0/3945120863 learned_addr learned my addr 172.21.15.117:0/3945120863 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c6fdf640 1 --1- 172.21.15.117:0/3945120863 >> v1:172.21.15.84:6789/0 conn(0x55af19c7b370 0x55af19c7b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44276/0 (socket says 172.21.15.117:44276) 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c67de640 1 -- 172.21.15.117:0/3945120863 >> v1:172.21.15.84:6789/0 conn(0x55af19c7b370 legacy=0x55af19c7b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.209+0000 7f79c67de640 1 -- 172.21.15.117:0/3945120863 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19b24ca0 con 0x55af19c7f560 2024-09-10T06:22:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c67de640 1 --2- 172.21.15.117:0/3945120863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7f560 0x55af19c81950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00a5c0 tx=0x7f79bc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84613a6284fd9b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c5fdd640 1 -- 172.21.15.117:0/3945120863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc0a9590 con 0x55af19c7f560 2024-09-10T06:22:53.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c5fdd640 1 -- 172.21.15.117:0/3945120863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79bc0ae070 con 0x55af19c7f560 2024-09-10T06:22:53.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c5fdd640 1 -- 172.21.15.117:0/3945120863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc0a9880 con 0x55af19c7f560 2024-09-10T06:22:53.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3945120863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7f560 msgr2=0x55af19c81950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/3945120863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7f560 0x55af19c81950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00a5c0 tx=0x7f79bc01b3d0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3945120863 shutdown_connections 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/3945120863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7f560 0x55af19c81950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3945120863 >> 172.21.15.117:0/3945120863 conn(0x55af19c76e90 msgr2=0x55af19c792b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3945120863 shutdown_connections 2024-09-10T06:22:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.213+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3945120863 wait complete. 2024-09-10T06:22:53.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55af19b84680 con 0x55af19c7b370 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42504/0 (socket says 172.21.15.117:42504) 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 -- 172.21.15.117:0/3786102259 learned_addr learned my addr 172.21.15.117:0/3786102259 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 -- 172.21.15.117:0/3786102259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19affda0 con 0x55af19c7b370 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/3786102259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79b8001680 tx=0x7f79b8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59e92e905077005 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f78b4e09640 1 -- 172.21.15.117:0/3786102259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8013420 con 0x55af19c7b370 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f78b4e09640 1 -- 172.21.15.117:0/3786102259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b80135c0 con 0x55af19c7b370 2024-09-10T06:22:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f78b4e09640 1 -- 172.21.15.117:0/3786102259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b80138e0 con 0x55af19c7b370 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3786102259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 msgr2=0x55af19d69a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/3786102259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79b8001680 tx=0x7f79b8001b40 comp rx=0 tx=0).stop 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3786102259 shutdown_connections 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/3786102259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d69a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3786102259 >> 172.21.15.117:0/3786102259 conn(0x55af19c76e90 msgr2=0x55af19d61290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3786102259 shutdown_connections 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- 172.21.15.117:0/3786102259 wait complete. 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c94d99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55af19b26a50 con 0x55af19c7b370 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42506/0 (socket says 172.21.15.117:42506) 2024-09-10T06:22:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 -- 172.21.15.117:0/2689974214 learned_addr learned my addr 172.21.15.117:0/2689974214 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.229+0000 7f79c6fdf640 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19d71600 con 0x55af19c7b370 2024-09-10T06:22:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d710a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55af19d6a9f0 tx=0x7f79b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 -- 172.21.15.117:0/2689974214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b80037a0 con 0x55af19c7b370 2024-09-10T06:22:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af19d71890 con 0x55af19c7b370 2024-09-10T06:22:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af19d72240 con 0x55af19c7b370 2024-09-10T06:22:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 -- 172.21.15.117:0/2689974214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8023070 con 0x55af19c7b370 2024-09-10T06:22:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 -- 172.21.15.117:0/2689974214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8003a70 con 0x55af19c7b370 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 -- 172.21.15.117:0/2689974214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f79b8010070 con 0x55af19c7b370 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78ac039a70 0x7f78ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f78b3606640 1 -- 172.21.15.117:0/2689974214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79b8050000 con 0x55af19c7b370 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c67de640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78ac039a70 0x7f78ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19c7f560 0x55af19d78210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19d78750 con 0x55af19c7f560 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c77e0640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19c7f560 0x55af19d78210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c67de640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78ac039a70 0x7f78ac03bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0ad000 tx=0x7f79bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c77e0640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19c7f560 0x55af19d78210 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c77e0640 1 -- 172.21.15.117:0/2689974214 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19c7f560 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19d72580 con 0x55af19c7f560 2024-09-10T06:22:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c77e0640 1 -- 172.21.15.117:0/2689974214 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19c7f560 2024-09-10T06:22:53.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19d7a9c0 0x55af19d7cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19d7d4a0 con 0x55af19d7a9c0 2024-09-10T06:22:53.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19d7a9c0 0x55af19d7cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19d7a9c0 0x55af19d7cdb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.233+0000 7f79c6fdf640 1 -- 172.21.15.117:0/2689974214 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79b800f030 con 0x55af19d7a9c0 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19d79860 con 0x55af19c7f560 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c77e0640 1 -- 172.21.15.117:0/2689974214 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19c7f560 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19d7e900 0x55af19d80cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19d81430 con 0x55af19d7e900 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c67de640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19d7e900 0x55af19d80cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c67de640 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19d7e900 0x55af19d80cf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c67de640 1 -- 172.21.15.117:0/2689974214 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19d7e900 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55af19b91450 con 0x55af19d8eef0 2024-09-10T06:22:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42508/0 (socket says 172.21.15.117:42508) 2024-09-10T06:22:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c6fdf640 1 -- 172.21.15.117:0/2952959508 learned_addr learned my addr 172.21.15.117:0/2952959508 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c6fdf640 1 -- 172.21.15.117:0/2952959508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19d8f950 con 0x55af19d8eef0 2024-09-10T06:22:53.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c010 tx=0x7f79b8028c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f78b0e01640 1 -- 172.21.15.117:0/2952959508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8036070 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af19d901b0 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f78b0e01640 1 -- 172.21.15.117:0/2952959508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8019040 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af19d90720 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.237+0000 7f78b0e01640 1 -- 172.21.15.117:0/2952959508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8047bd0 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78b0e01640 1 -- 172.21.15.117:0/2952959508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f79b8041250 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78b0e01640 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 0x7f78a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78b0e01640 1 -- 172.21.15.117:0/2952959508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79b8029020 con 0x55af19d8eef0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c67de640 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 0x7f78a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c67de640 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 0x7f78a003bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55af19d78b90 tx=0x7f79bc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55af19d6a230 con 0x55af19d9c660 2024-09-10T06:22:53.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42510/0 (socket says 172.21.15.117:42510) 2024-09-10T06:22:53.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 -- 172.21.15.117:0/819354449 learned_addr learned my addr 172.21.15.117:0/819354449 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 -- 172.21.15.117:0/819354449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19d9d010 con 0x55af19d9c660 2024-09-10T06:22:53.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/819354449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f79b80287c0 tx=0x7f79b803b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e150c9137a8c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78aa7fc640 1 -- 172.21.15.117:0/819354449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b801d8d0 con 0x55af19d9c660 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78aa7fc640 1 -- 172.21.15.117:0/819354449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b803b9d0 con 0x55af19d9c660 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f78aa7fc640 1 -- 172.21.15.117:0/819354449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b8032d10 con 0x55af19d9c660 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- 172.21.15.117:0/819354449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 msgr2=0x55af19d9ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/819354449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f79b80287c0 tx=0x7f79b803b630 comp rx=0 tx=0).stop 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- 172.21.15.117:0/819354449 shutdown_connections 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/819354449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19d9ca40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- 172.21.15.117:0/819354449 >> 172.21.15.117:0/819354449 conn(0x55af19d97a20 msgr2=0x55af19d95c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- 172.21.15.117:0/819354449 shutdown_connections 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- 172.21.15.117:0/819354449 wait complete. 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 Processor -- start 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- start start 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c94d99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55af19d9b3d0 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42526/0 (socket says 172.21.15.117:42526) 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.241+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 learned_addr learned my addr 172.21.15.117:0/1348901109 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af19da2e90 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79b8011f40 tx=0x7f79b8019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 -- 172.21.15.117:0/1348901109 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b803b9d0 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af19da2e90 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af19da2e90 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 -- 172.21.15.117:0/1348901109 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8064040 con 0x55af19d9c660 2024-09-10T06:22:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 -- 172.21.15.117:0/1348901109 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79b801dad0 con 0x55af19d9c660 2024-09-10T06:22:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 -- 172.21.15.117:0/1348901109 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f79b8070020 con 0x55af19d9c660 2024-09-10T06:22:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7890039a70 0x7f789003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f78a8ff9640 1 -- 172.21.15.117:0/1348901109 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f79b806e020 con 0x55af19d9c660 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c67de640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7890039a70 0x7f789003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19dadab0 0x55af19daff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db0690 con 0x55af19dadab0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19dadab0 0x55af19daff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c67de640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7890039a70 0x7f789003bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55af19d81830 tx=0x7f79bc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19dadab0 0x55af19daff40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19dadab0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 realm 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db0aa0 con 0x55af19dadab0 2024-09-10T06:22:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19dadab0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1370 con 0x55af19dadab0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19dadab0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19dadab0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.245+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19db2240 0x55af19db4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db4d70 con 0x55af19db2240 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19db2240 0x55af19db4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19db2240 0x55af19db4630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c94d99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c94d99c0 20 searching for the correct realm 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19db6d10 0x55af19db9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db9850 con 0x55af19db6d10 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c67de640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19db6d10 0x55af19db9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c67de640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19db6d10 0x55af19db9180 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db9850 con 0x55af19db2240 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f79b805e030 0x7f79b8051800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db9850 con 0x7f79b805e030 2024-09-10T06:22:53.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f79b805e030 0x7f79b8051800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f79b805e030 0x7f79b8051800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c00083f0 con 0x7f79b805e030 2024-09-10T06:22:53.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c00083f0 con 0x55af19dadab0 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.249+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db2240 2024-09-10T06:22:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db2240 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.253+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db2240 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.257+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db2240 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db6d10 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x7f79b805e030 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19dadab0 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55af19db1710 con 0x55af19db2240 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db5630 con 0x55af19dadab0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db5a20 con 0x55af19dadab0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db5a20 con 0x55af19db6d10 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 zone default found 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 4 Realm: () 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 zonegroup default 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19db9cd0 con 0x7f79b805e030 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbb6c0 con 0x55af19db6d10 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbba60 con 0x55af19db6d10 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 started sync module instance, tier type = 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.261+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbab60 con 0x55af19db2240 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94210541465472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbc300 con 0x55af19db2240 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbcb50 con 0x55af19dadab0 2024-09-10T06:22:53.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94210541465472] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94210541469264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbcb50 con 0x55af19dadab0 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.265+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbd630 con 0x55af19db6d10 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94210541469264] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94210541471392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbcac0 con 0x55af19db6d10 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbe3b0 con 0x55af19db2240 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94210541477936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbec50 con 0x55af19db2240 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbf610 con 0x55af19dadab0 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.269+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94210541471392] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94210541477936] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94210541479840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbf610 con 0x55af19dadab0 2024-09-10T06:22:53.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbebc0 con 0x7f79b805e030 2024-09-10T06:22:53.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94210541479840] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94210541482336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbfa30 con 0x7f79b805e030 2024-09-10T06:22:53.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.273+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc03f0 con 0x7f79b805e030 2024-09-10T06:22:53.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.277+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94210541482336] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.277+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.277+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94210541483872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc03f0 con 0x7f79b805e030 2024-09-10T06:22:53.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.277+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc0db0 con 0x7f79b805e030 2024-09-10T06:22:53.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94210541483872] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94210541485888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc0f90 con 0x7f79b805e030 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=0 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=1 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=2 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=3 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=4 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=5 2024-09-10T06:22:53.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.281+0000 7f79c94d99c0 20 add_watcher() i=6 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94210541485888] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 20 add_watcher() i=7 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc4120 con 0x55af19dadab0 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94210541501136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc0ee0 con 0x55af19dadab0 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94210541501136] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f787d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.285+0000 7f79c94d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 5 note: GC not initialized 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f77f7fff640 20 reqs_thread_entry: start 2024-09-10T06:22:53.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 20 Filter name: none 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f77f5ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55af19de73f0 con 0x55af19dadab0 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T06:22:53.291 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:53.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f787d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94210541501136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19de5ea0 con 0x55af19dadab0 2024-09-10T06:22:53.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94210541501136] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.289+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94210541465472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dc3ad0 con 0x55af19db2240 2024-09-10T06:22:53.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94210541465472] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c94d99c0 20 remove_watcher() i=0 2024-09-10T06:22:53.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c94d99c0 2 removed watcher, disabling cache 2024-09-10T06:22:53.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94210541469264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbaf80 con 0x55af19dadab0 2024-09-10T06:22:53.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94210541469264] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c94d99c0 20 remove_watcher() i=1 2024-09-10T06:22:53.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.293+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94210541471392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbbe50 con 0x55af19db6d10 2024-09-10T06:22:53.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c67de640 1 -- 172.21.15.117:0/1348901109 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94210541471392] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79bc0a9a70 con 0x55af19db6d10 2024-09-10T06:22:53.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 20 remove_watcher() i=2 2024-09-10T06:22:53.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94210541477936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbbe50 con 0x55af19db2240 2024-09-10T06:22:53.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c6fdf640 1 -- 172.21.15.117:0/1348901109 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94210541477936] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79b805b030 con 0x55af19db2240 2024-09-10T06:22:53.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 20 remove_watcher() i=3 2024-09-10T06:22:53.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94210541479840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbbe50 con 0x55af19dadab0 2024-09-10T06:22:53.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94210541479840] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x55af19dadab0 2024-09-10T06:22:53.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 20 remove_watcher() i=4 2024-09-10T06:22:53.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.297+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94210541482336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbe7a0 con 0x7f79b805e030 2024-09-10T06:22:53.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.301+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94210541482336] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.301+0000 7f79c94d99c0 20 remove_watcher() i=5 2024-09-10T06:22:53.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.301+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94210541483872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbbe50 con 0x7f79b805e030 2024-09-10T06:22:53.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94210541483872] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 20 remove_watcher() i=6 2024-09-10T06:22:53.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94210541485888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55af19dbf160 con 0x7f79b805e030 2024-09-10T06:22:53.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94210541485888] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c0026040 con 0x7f79b805e030 2024-09-10T06:22:53.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 20 remove_watcher() i=7 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f79b805e030 msgr2=0x7f79b8051800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f79b805e030 0x7f79b8051800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19dadab0 msgr2=0x55af19daff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19dadab0 0x55af19daff40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19db2240 msgr2=0x55af19db4630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19db2240 0x55af19db4630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19db6d10 msgr2=0x55af19db9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.305+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19db6d10 0x55af19db9180 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7890039a70 msgr2=0x7f789003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7890039a70 0x7f789003bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55af19d81830 tx=0x7f79bc0c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 msgr2=0x55af19da2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c77e0640 1 -- 172.21.15.117:0/1348901109 reap_dead start 2024-09-10T06:22:53.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79b8011f40 tx=0x7f79b8019f30 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 shutdown_connections 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/1348901109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d9c660 0x55af19da2930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 >> 172.21.15.117:0/1348901109 conn(0x55af19d97a20 msgr2=0x55af19d95c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 shutdown_connections 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/1348901109 wait complete. 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 msgr2=0x7f78a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 0x7f78a003bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55af19d78b90 tx=0x7f79bc005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 msgr2=0x55af19d8f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c010 tx=0x7f79b8028c20 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 shutdown_connections 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78a0039a70 0x7f78a003bf30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2952959508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19d8eef0 0x55af19d8f310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 >> 172.21.15.117:0/2952959508 conn(0x55af19d848a0 msgr2=0x55af19d84c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 shutdown_connections 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2952959508 wait complete. 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19c7f560 msgr2=0x55af19d78210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55af19c7f560 0x55af19d78210 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19d7a9c0 msgr2=0x55af19d7cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55af19d7a9c0 0x55af19d7cdb0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19d7e900 msgr2=0x55af19d80cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55af19d7e900 0x55af19d80cf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78ac039a70 msgr2=0x7f78ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f78ac039a70 0x7f78ac03bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0ad000 tx=0x7f79bc0a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 msgr2=0x55af19d710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 --2- 172.21.15.117:0/2689974214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55af19c7b370 0x55af19d710a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55af19d6a9f0 tx=0x7f79b8000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:53.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c77e0640 1 -- 172.21.15.117:0/2689974214 reap_dead start 2024-09-10T06:22:53.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 shutdown_connections 2024-09-10T06:22:53.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 >> 172.21.15.117:0/2689974214 conn(0x55af19c76e90 msgr2=0x55af19d5fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 shutdown_connections 2024-09-10T06:22:53.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.309+0000 7f79c94d99c0 1 -- 172.21.15.117:0/2689974214 wait complete. 2024-09-10T06:22:53.319 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:53.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T06:22:53.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T06:22:53.320 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-10T06:22:53.394 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8da329c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562e727f7850 0x562e727f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8da329c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e726a79c0 con 0x562e72767700 2024-09-10T06:22:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8da329c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x562e726f76d0 con 0x562e727f7850 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8ad37640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562e727f7850 0x562e727f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8ad37640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562e727f7850 0x562e727f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42542/0 (socket says 172.21.15.117:42542) 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8b538640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x562e72767700 0x562e727f6130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44280/0 (socket says 172.21.15.117:44280) 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8ad37640 1 -- 172.21.15.117:0/1569223411 learned_addr learned my addr 172.21.15.117:0/1569223411 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8ad37640 1 -- 172.21.15.117:0/1569223411 >> v1:172.21.15.84:6789/0 conn(0x562e72767700 legacy=0x562e727f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.393+0000 7eff8ad37640 1 -- 172.21.15.117:0/1569223411 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7269bca0 con 0x562e727f7850 2024-09-10T06:22:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8ad37640 1 --2- 172.21.15.117:0/1569223411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e727f7850 0x562e727f9c40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff8000a5c0 tx=0x7eff8001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545cf558746c9237 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8a536640 1 -- 172.21.15.117:0/1569223411 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff800b1070 con 0x562e727f7850 2024-09-10T06:22:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8a536640 1 -- 172.21.15.117:0/1569223411 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff800a8070 con 0x562e727f7850 2024-09-10T06:22:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8a536640 1 -- 172.21.15.117:0/1569223411 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff800ac5b0 con 0x562e727f7850 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 -- 172.21.15.117:0/1569223411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e727f7850 msgr2=0x562e727f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1569223411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e727f7850 0x562e727f9c40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff8000a5c0 tx=0x7eff8001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 -- 172.21.15.117:0/1569223411 shutdown_connections 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1569223411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e727f7850 0x562e727f9c40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 -- 172.21.15.117:0/1569223411 >> 172.21.15.117:0/1569223411 conn(0x562e727ede20 msgr2=0x562e727f0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 -- 172.21.15.117:0/1569223411 shutdown_connections 2024-09-10T06:22:53.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.397+0000 7eff8da329c0 1 -- 172.21.15.117:0/1569223411 wait complete. 2024-09-10T06:22:53.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e726fb680 con 0x562e72767700 2024-09-10T06:22:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42554/0 (socket says 172.21.15.117:42554) 2024-09-10T06:22:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 -- 172.21.15.117:0/2214469243 learned_addr learned my addr 172.21.15.117:0/2214469243 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 -- 172.21.15.117:0/2214469243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e72676da0 con 0x562e72767700 2024-09-10T06:22:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 --2- 172.21.15.117:0/2214469243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b270 tx=0x7eff7c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f27892f5ca1a9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7efe7960a640 1 -- 172.21.15.117:0/2214469243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c00e5d0 con 0x562e72767700 2024-09-10T06:22:53.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7efe7960a640 1 -- 172.21.15.117:0/2214469243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c00e770 con 0x562e72767700 2024-09-10T06:22:53.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7efe7960a640 1 -- 172.21.15.117:0/2214469243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c00ea70 con 0x562e72767700 2024-09-10T06:22:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- 172.21.15.117:0/2214469243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 msgr2=0x562e728de9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2214469243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00b270 tx=0x7eff7c00b670 comp rx=0 tx=0).stop 2024-09-10T06:22:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- 172.21.15.117:0/2214469243 shutdown_connections 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2214469243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728de9b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- 172.21.15.117:0/2214469243 >> 172.21.15.117:0/2214469243 conn(0x562e727ede20 msgr2=0x562e728da650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- 172.21.15.117:0/2214469243 shutdown_connections 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- 172.21.15.117:0/2214469243 wait complete. 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8da329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e7269da50 con 0x562e72767700 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728e6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42566/0 (socket says 172.21.15.117:42566) 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.413+0000 7eff8b538640 1 -- 172.21.15.117:0/2291124625 learned_addr learned my addr 172.21.15.117:0/2291124625 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8b538640 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e728e65b0 con 0x562e72767700 2024-09-10T06:22:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8b538640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728e6050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562e728df9a0 tx=0x7eff7c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 -- 172.21.15.117:0/2291124625 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c00be70 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e728e6840 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 -- 172.21.15.117:0/2291124625 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c00f9f0 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 -- 172.21.15.117:0/2291124625 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c02c060 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e728e71f0 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 -- 172.21.15.117:0/2291124625 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7eff7c017070 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe70039a70 0x7efe7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7efe77e07640 1 -- 172.21.15.117:0/2291124625 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7eff7c015020 con 0x562e72767700 2024-09-10T06:22:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe70039a70 0x7efe7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e727f7850 0x562e728ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e728ed700 con 0x562e727f7850 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8bd39640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e727f7850 0x562e728ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe70039a70 0x7efe7003bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae000 tx=0x7eff800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8bd39640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e727f7850 0x562e728ed1c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8bd39640 1 -- 172.21.15.117:0/2291124625 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e727f7850 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e728e7530 con 0x562e727f7850 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8bd39640 1 -- 172.21.15.117:0/2291124625 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e727f7850 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e728ef970 0x562e728f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e728f2450 con 0x562e728ef970 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8b538640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e728ef970 0x562e728f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.417+0000 7eff8b538640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e728ef970 0x562e728f1d60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 -- 172.21.15.117:0/2291124625 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff7c02e070 con 0x562e728ef970 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e728ee810 con 0x562e727f7850 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8bd39640 1 -- 172.21.15.117:0/2291124625 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e727f7850 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e728f38b0 0x562e728f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e728f63e0 con 0x562e728f38b0 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e728f38b0 0x562e728f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e728f38b0 0x562e728f5ca0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8ad37640 1 -- 172.21.15.117:0/2291124625 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff800b4040 con 0x562e728f38b0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e72708450 con 0x562e72903ea0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42572/0 (socket says 172.21.15.117:42572) 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 -- 172.21.15.117:0/2566852234 learned_addr learned my addr 172.21.15.117:0/2566852234 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 -- 172.21.15.117:0/2566852234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e72904900 con 0x562e72903ea0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8b538640 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01bd70 tx=0x7eff7c027e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7efe75602640 1 -- 172.21.15.117:0/2566852234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c035020 con 0x562e72903ea0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e72905160 con 0x562e72903ea0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7efe75602640 1 -- 172.21.15.117:0/2566852234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c019510 con 0x562e72903ea0 2024-09-10T06:22:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7efe75602640 1 -- 172.21.15.117:0/2566852234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c027560 con 0x562e72903ea0 2024-09-10T06:22:53.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.421+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e72905160 con 0x562e72903ea0 2024-09-10T06:22:53.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe75602640 1 -- 172.21.15.117:0/2566852234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7eff7c01a480 con 0x562e72903ea0 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe75602640 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 0x7efe6403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe75602640 1 -- 172.21.15.117:0/2566852234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7eff7c048020 con 0x562e72903ea0 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 0x7efe6403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8ad37640 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 0x7efe6403bf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x562e728edb40 tx=0x7eff80005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e728df200 con 0x562e72911400 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42584/0 (socket says 172.21.15.117:42584) 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8b538640 1 -- 172.21.15.117:0/3917148228 learned_addr learned my addr 172.21.15.117:0/3917148228 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8b538640 1 -- 172.21.15.117:0/3917148228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e72911df0 con 0x562e72911400 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8b538640 1 --2- 172.21.15.117:0/3917148228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01b4a0 tx=0x7eff7c019870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9441258e313a3f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe6effd640 1 -- 172.21.15.117:0/3917148228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c043e00 con 0x562e72911400 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe6effd640 1 -- 172.21.15.117:0/3917148228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c03a400 con 0x562e72911400 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7efe6effd640 1 -- 172.21.15.117:0/3917148228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c031440 con 0x562e72911400 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- 172.21.15.117:0/3917148228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 msgr2=0x562e72911800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 --2- 172.21.15.117:0/3917148228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01b4a0 tx=0x7eff7c019870 comp rx=0 tx=0).stop 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- 172.21.15.117:0/3917148228 shutdown_connections 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 --2- 172.21.15.117:0/3917148228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72911800 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- 172.21.15.117:0/3917148228 >> 172.21.15.117:0/3917148228 conn(0x562e7290c820 msgr2=0x562e7290aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- 172.21.15.117:0/3917148228 shutdown_connections 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- 172.21.15.117:0/3917148228 wait complete. 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 Processor -- start 2024-09-10T06:22:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.425+0000 7eff8da329c0 1 -- start start 2024-09-10T06:22:53.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562e729101d0 con 0x562e72911400 2024-09-10T06:22:53.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8b538640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42592/0 (socket says 172.21.15.117:42592) 2024-09-10T06:22:53.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 learned_addr learned my addr 172.21.15.117:0/1931671342 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e72917cb0 con 0x562e72911400 2024-09-10T06:22:53.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8b538640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff7c04e1c0 tx=0x7eff7c044ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 -- 172.21.15.117:0/1931671342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c048390 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e72917cb0 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 -- 172.21.15.117:0/1931671342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c030a60 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e72917cb0 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 -- 172.21.15.117:0/1931671342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7c030d60 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 -- 172.21.15.117:0/1931671342 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7eff7c062040 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe5403de80 0x7efe54040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7efe6d7fa640 1 -- 172.21.15.117:0/1931671342 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7eff7c060020 con 0x562e72911400 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8ad37640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe5403de80 0x7efe54040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e729206f0 0x562e72922b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e729232d0 con 0x562e729206f0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8bd39640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e729206f0 0x562e72922b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8ad37640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe5403de80 0x7efe54040340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff8001b380 tx=0x7eff800a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8bd39640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e729206f0 0x562e72922b80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 20 realm 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.429+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72923730 con 0x562e729206f0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:53.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72924000 con 0x562e729206f0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e72925100 0x562e729274f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72927b40 con 0x562e72925100 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e72925100 0x562e729274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e72925100 0x562e729274f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 20 searching for the correct realm 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e72929a20 0x562e7292be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e7292c4d0 con 0x562e72929a20 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8ad37640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e72929a20 0x562e7292be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8ad37640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e72929a20 0x562e7292be50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e7292c4d0 con 0x562e72925100 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7eff7c065040 0x7eff7c065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e7292c4d0 con 0x7eff7c065040 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8bd39640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7eff7c065040 0x7eff7c065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.433+0000 7eff8bd39640 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7eff7c065040 0x7eff7c065a70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72925100 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72925100 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.437+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72925100 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.441+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72925100 2024-09-10T06:22:53.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72929a20 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x7eff7c065040 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e729206f0 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562e729243a0 con 0x562e72925100 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:53.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72928390 con 0x562e729206f0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72928780 con 0x562e729206f0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72928780 con 0x562e72929a20 2024-09-10T06:22:53.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 zone default found 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 4 Realm: () 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 zonegroup default 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7292c950 con 0x7eff7c065040 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.445+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7292e440 con 0x562e72929a20 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7292e880 con 0x562e72929a20 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 20 started sync module instance, tier type = 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292d7e0 con 0x562e72925100 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94757490711504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292d440 con 0x562e72925100 2024-09-10T06:22:53.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292f7b0 con 0x562e729206f0 2024-09-10T06:22:53.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94757490711504] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94757490717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292fbd0 con 0x562e729206f0 2024-09-10T06:22:53.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.449+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e729304a0 con 0x562e72929a20 2024-09-10T06:22:53.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.453+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94757490717440] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.453+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.453+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94757490718768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72930890 con 0x562e72929a20 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.453+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72931250 con 0x562e72925100 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.453+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94757490724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72931af0 con 0x562e72925100 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e729324b0 con 0x562e729206f0 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94757490718768] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94757490724560] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94757490728960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72931af0 con 0x562e729206f0 2024-09-10T06:22:53.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.457+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72932420 con 0x7eff7c065040 2024-09-10T06:22:53.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94757490728960] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94757490726464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72931a60 con 0x7eff7c065040 2024-09-10T06:22:53.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72933170 con 0x7eff7c065040 2024-09-10T06:22:53.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94757490726464] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94757490730944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72933090 con 0x7eff7c065040 2024-09-10T06:22:53.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.461+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72933b80 con 0x7eff7c065040 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94757490734672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72933ff0 con 0x7eff7c065040 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=0 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=1 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=2 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=3 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=4 2024-09-10T06:22:53.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.465+0000 7eff8da329c0 20 add_watcher() i=5 2024-09-10T06:22:53.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94757490730944] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8da329c0 20 add_watcher() i=6 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94757490734672] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8da329c0 20 add_watcher() i=7 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8da329c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e72932be0 con 0x562e729206f0 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.469+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94757490732000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72934500 con 0x562e729206f0 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94757490732000] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7efe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 5 note: GC not initialized 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7efe40fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 Filter name: none 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7efdba7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:53.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7295a620 con 0x562e729206f0 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7295b360 con 0x562e72925100 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-10T06:22:53.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T06:22:53.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-10T06:22:53.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e729614d0 con 0x562e729206f0 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94757490921296 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7295cc40 con 0x562e729206f0 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.473+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94757490728960 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7eff840347f0 con 0x562e729206f0 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94757490728960 notifier 4387 bl.length()=849 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify cookie 94757490921296 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efe50003eb0 con 0x562e729206f0 2024-09-10T06:22:53.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94757490921296 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff84018c80 con 0x562e729206f0 2024-09-10T06:22:53.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72960f50 con 0x562e72925100 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8da329c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8da329c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8da329c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94757490921296 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562e7295cc40 con 0x562e72925100 2024-09-10T06:22:53.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== watch-notify(notify (1) cookie 94757490711504 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x562e72904900 con 0x562e72925100 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94757490711504 notifier 4387 bl.length()=166 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(68 notify.0 [notify cookie 94757490921296 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7efe6effd640 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efe50003eb0 con 0x562e72925100 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== watch-notify(notify_complete (2) cookie 94757490921296 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e728e71f0 con 0x562e72925100 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.477+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.482 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T06:22:53.477579Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:53.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7efe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94757490732000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72958360 con 0x562e729206f0 2024-09-10T06:22:53.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94757490732000] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94757490711504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72958360 con 0x562e72925100 2024-09-10T06:22:53.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94757490711504] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037020 con 0x562e72925100 2024-09-10T06:22:53.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8da329c0 20 remove_watcher() i=0 2024-09-10T06:22:53.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8da329c0 2 removed watcher, disabling cache 2024-09-10T06:22:53.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.481+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94757490717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72958360 con 0x562e729206f0 2024-09-10T06:22:53.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94757490717440] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8da329c0 20 remove_watcher() i=1 2024-09-10T06:22:53.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94757490718768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72958360 con 0x562e72929a20 2024-09-10T06:22:53.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8ad37640 1 -- 172.21.15.117:0/1931671342 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94757490718768] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800d9070 con 0x562e72929a20 2024-09-10T06:22:53.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8da329c0 20 remove_watcher() i=2 2024-09-10T06:22:53.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.485+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94757490724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292f830 con 0x562e72925100 2024-09-10T06:22:53.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8b538640 1 -- 172.21.15.117:0/1931671342 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94757490724560] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c070d70 con 0x562e72925100 2024-09-10T06:22:53.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8da329c0 20 remove_watcher() i=3 2024-09-10T06:22:53.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94757490728960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292f830 con 0x562e729206f0 2024-09-10T06:22:53.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94757490728960] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x562e729206f0 2024-09-10T06:22:53.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8da329c0 20 remove_watcher() i=4 2024-09-10T06:22:53.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.489+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94757490726464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72932000 con 0x7eff7c065040 2024-09-10T06:22:53.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.493+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94757490726464] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.493+0000 7eff8da329c0 20 remove_watcher() i=5 2024-09-10T06:22:53.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.493+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94757490730944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e7292f830 con 0x7eff7c065040 2024-09-10T06:22:53.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94757490730944] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 20 remove_watcher() i=6 2024-09-10T06:22:53.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94757490734672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562e72931640 con 0x7eff7c065040 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94757490734672] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8400a4d0 con 0x7eff7c065040 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 20 remove_watcher() i=7 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7eff7c065040 msgr2=0x7eff7c065a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7eff7c065040 0x7eff7c065a70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e729206f0 msgr2=0x562e72922b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e729206f0 0x562e72922b80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e72925100 msgr2=0x562e729274f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e72925100 0x562e729274f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e72929a20 msgr2=0x562e7292be50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e72929a20 0x562e7292be50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe5403de80 msgr2=0x7efe54040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe5403de80 0x7efe54040340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff8001b380 tx=0x7eff800a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 msgr2=0x562e72917750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff7c04e1c0 tx=0x7eff7c044ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8bd39640 1 -- 172.21.15.117:0/1931671342 reap_dead start 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 shutdown_connections 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/1931671342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72911400 0x562e72917750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 >> 172.21.15.117:0/1931671342 conn(0x562e7290c820 msgr2=0x562e7290aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 shutdown_connections 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/1931671342 wait complete. 2024-09-10T06:22:53.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 msgr2=0x7efe6403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 0x7efe6403bf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x562e728edb40 tx=0x7eff80005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 msgr2=0x562e729042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.497+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff7c01bd70 tx=0x7eff7c027e70 comp rx=0 tx=0).stop 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 shutdown_connections 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe64039ac0 0x7efe6403bf80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2566852234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72903ea0 0x562e729042c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 >> 172.21.15.117:0/2566852234 conn(0x562e728f9850 msgr2=0x562e728f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 shutdown_connections 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2566852234 wait complete. 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e727f7850 msgr2=0x562e728ed1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562e727f7850 0x562e728ed1c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e728ef970 msgr2=0x562e728f1d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562e728ef970 0x562e728f1d60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e728f38b0 msgr2=0x562e728f5ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562e728f38b0 0x562e728f5ca0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe70039a70 msgr2=0x7efe7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7efe70039a70 0x7efe7003bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff800ae000 tx=0x7eff800a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 msgr2=0x562e728e6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 --2- 172.21.15.117:0/2291124625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562e72767700 0x562e728e6050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562e728df9a0 tx=0x7eff7c000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8bd39640 1 -- 172.21.15.117:0/2291124625 reap_dead start 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 shutdown_connections 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 >> 172.21.15.117:0/2291124625 conn(0x562e727ede20 msgr2=0x562e728d90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 shutdown_connections 2024-09-10T06:22:53.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.501+0000 7eff8da329c0 1 -- 172.21.15.117:0/2291124625 wait complete. 2024-09-10T06:22:53.511 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T06:22:53.477579Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:53.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:22:53.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:22:53.512 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:22:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff302c7c9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564b8f6258c0 0x564b8f627cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff302c7c9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b8f4d39c0 con 0x564b8f621770 2024-09-10T06:22:53.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff302c7c9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x564b8f5236d0 con 0x564b8f6258c0 2024-09-10T06:22:53.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff2fff81640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564b8f6258c0 0x564b8f627cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff2fff81640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564b8f6258c0 0x564b8f627cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42600/0 (socket says 172.21.15.117:42600) 2024-09-10T06:22:53.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff2fff81640 1 -- 172.21.15.117:0/3605145649 learned_addr learned my addr 172.21.15.117:0/3605145649 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff300782640 1 --1- 172.21.15.117:0/3605145649 >> v1:172.21.15.84:6789/0 conn(0x564b8f621770 0x564b8f621b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44292/0 (socket says 172.21.15.117:44292) 2024-09-10T06:22:53.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff2fff81640 1 -- 172.21.15.117:0/3605145649 >> v1:172.21.15.84:6789/0 conn(0x564b8f621770 legacy=0x564b8f621b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.581+0000 7ff2fff81640 1 -- 172.21.15.117:0/3605145649 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f4c7ca0 con 0x564b8f6258c0 2024-09-10T06:22:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff2fff81640 1 --2- 172.21.15.117:0/3605145649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f627cb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400a5c0 tx=0x7ff2f401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b468d100c942b389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff2ff780640 1 -- 172.21.15.117:0/3605145649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f40a9590 con 0x564b8f6258c0 2024-09-10T06:22:53.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff2ff780640 1 -- 172.21.15.117:0/3605145649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f40ae070 con 0x564b8f6258c0 2024-09-10T06:22:53.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff2ff780640 1 -- 172.21.15.117:0/3605145649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f40a9880 con 0x564b8f6258c0 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/3605145649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 msgr2=0x564b8f627cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/3605145649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f627cb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400a5c0 tx=0x7ff2f401b3d0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/3605145649 shutdown_connections 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/3605145649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f627cb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/3605145649 >> 172.21.15.117:0/3605145649 conn(0x564b8f595080 msgr2=0x564b8f595490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/3605145649 shutdown_connections 2024-09-10T06:22:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.585+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/3605145649 wait complete. 2024-09-10T06:22:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff302c7c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff302c7c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b8f527680 con 0x564b8f621770 2024-09-10T06:22:53.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42602/0 (socket says 172.21.15.117:42602) 2024-09-10T06:22:53.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff300782640 1 -- 172.21.15.117:0/2922743767 learned_addr learned my addr 172.21.15.117:0/2922743767 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff300782640 1 -- 172.21.15.117:0/2922743767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f4a2da0 con 0x564b8f621770 2024-09-10T06:22:53.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff300782640 1 --2- 172.21.15.117:0/2922743767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00016f0 tx=0x7ff2f0001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d6365c8fbe67ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.597+0000 7ff1ee60c640 1 -- 172.21.15.117:0/2922743767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0003460 con 0x564b8f621770 2024-09-10T06:22:53.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ee60c640 1 -- 172.21.15.117:0/2922743767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f0003620 con 0x564b8f621770 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ee60c640 1 -- 172.21.15.117:0/2922743767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0003940 con 0x564b8f621770 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/2922743767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 msgr2=0x564b8f70c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/2922743767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00016f0 tx=0x7ff2f0001bb0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/2922743767 shutdown_connections 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/2922743767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f621770 0x564b8f70c9b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/2922743767 >> 172.21.15.117:0/2922743767 conn(0x564b8f595080 msgr2=0x564b8f708650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/2922743767 shutdown_connections 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/2922743767 wait complete. 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f714310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b8f4c9a50 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f714310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f714310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42614/0 (socket says 172.21.15.117:42614) 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff300782640 1 -- 172.21.15.117:0/1053865060 learned_addr learned my addr 172.21.15.117:0/1053865060 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff300782640 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f714870 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff300782640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f714310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x564b8f70d9a0 tx=0x7ff2f0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ece09640 1 -- 172.21.15.117:0/1053865060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0021020 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ece09640 1 -- 172.21.15.117:0/1053865060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f00067c0 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f714b00 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ece09640 1 -- 172.21.15.117:0/1053865060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f001d7d0 con 0x564b8f6258c0 2024-09-10T06:22:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f715440 con 0x564b8f6258c0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.601+0000 7ff1ece09640 1 -- 172.21.15.117:0/1053865060 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2f0024020 con 0x564b8f6258c0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff1ece09640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1e8039a70 0x7ff1e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff1ece09640 1 -- 172.21.15.117:0/1053865060 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2f0018040 con 0x564b8f6258c0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff2fff81640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1e8039a70 0x7ff1e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f719380 0x564b8f71b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f71bcb0 con 0x564b8f719380 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300f83640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f719380 0x564b8f71b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff2fff81640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1e8039a70 0x7ff1e803bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40ad000 tx=0x7ff2f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300f83640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f719380 0x564b8f71b770 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300f83640 1 -- 172.21.15.117:0/1053865060 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f719380 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f715750 con 0x564b8f719380 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300f83640 1 -- 172.21.15.117:0/1053865060 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f719380 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f71df50 0x564b8f720340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f720a30 con 0x564b8f71df50 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300782640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f71df50 0x564b8f720340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300782640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f71df50 0x564b8f720340 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300782640 1 -- 172.21.15.117:0/1053865060 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f71df50 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f71cdf0 con 0x564b8f719380 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff300f83640 1 -- 172.21.15.117:0/1053865060 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f719380 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f721e90 0x564b8f724280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7249c0 con 0x564b8f721e90 2024-09-10T06:22:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff2fff81640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f721e90 0x564b8f724280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff2fff81640 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f721e90 0x564b8f724280 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff2fff81640 1 -- 172.21.15.117:0/1053865060 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f721e90 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.605+0000 7ff302c7c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b8f534450 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42618/0 (socket says 172.21.15.117:42618) 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 -- 172.21.15.117:0/882487210 learned_addr learned my addr 172.21.15.117:0/882487210 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 -- 172.21.15.117:0/882487210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f732f20 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00064a0 tx=0x7ff2f0012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 -- 172.21.15.117:0/882487210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f00474f0 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f733780 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 -- 172.21.15.117:0/882487210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f0047690 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 -- 172.21.15.117:0/882487210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0025520 con 0x564b8f7324c0 2024-09-10T06:22:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f733cf0 con 0x564b8f7324c0 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 -- 172.21.15.117:0/882487210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2f001b040 con 0x564b8f7324c0 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 0x7ff1d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff1e5ffb640 1 -- 172.21.15.117:0/882487210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2f0039060 con 0x564b8f7324c0 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff2fff81640 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 0x7ff1d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff2fff81640 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 0x7ff1d803bf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x564b8f71c0f0 tx=0x7ff2f4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff302c7c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b8f70d1a0 con 0x564b8f73fcf0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42628/0 (socket says 172.21.15.117:42628) 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.609+0000 7ff300782640 1 -- 172.21.15.117:0/997573836 learned_addr learned my addr 172.21.15.117:0/997573836 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 -- 172.21.15.117:0/997573836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f7406a0 con 0x564b8f73fcf0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 --2- 172.21.15.117:0/997573836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0017fd0 tx=0x7ff2f00274d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ab0df8b798cace server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1df7fe640 1 -- 172.21.15.117:0/997573836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f002f430 con 0x564b8f73fcf0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1df7fe640 1 -- 172.21.15.117:0/997573836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f00383f0 con 0x564b8f73fcf0 2024-09-10T06:22:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1df7fe640 1 -- 172.21.15.117:0/997573836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0004030 con 0x564b8f73fcf0 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/997573836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 msgr2=0x564b8f7400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/997573836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0017fd0 tx=0x7ff2f00274d0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/997573836 shutdown_connections 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/997573836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f7400d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/997573836 >> 172.21.15.117:0/997573836 conn(0x564b8f73b0b0 msgr2=0x564b8f7392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/997573836 shutdown_connections 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/997573836 wait complete. 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 Processor -- start 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- start start 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f745fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b8f73ea60 con 0x564b8f73fcf0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f745fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f745fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42634/0 (socket says 172.21.15.117:42634) 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 learned_addr learned my addr 172.21.15.117:0/971643355 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f746500 con 0x564b8f73fcf0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff300782640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f745fa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff2f001df70 tx=0x7ff2f002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1ddffb640 1 -- 172.21.15.117:0/971643355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f0068020 con 0x564b8f73fcf0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f746500 con 0x564b8f73fcf0 2024-09-10T06:22:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f746500 con 0x564b8f73fcf0 2024-09-10T06:22:53.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1ddffb640 1 -- 172.21.15.117:0/971643355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f002f690 con 0x564b8f73fcf0 2024-09-10T06:22:53.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.613+0000 7ff1ddffb640 1 -- 172.21.15.117:0/971643355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f004e600 con 0x564b8f73fcf0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff1ddffb640 1 -- 172.21.15.117:0/971643355 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2f006b020 con 0x564b8f73fcf0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff1ddffb640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d0039ac0 0x7ff1d003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff1ddffb640 1 -- 172.21.15.117:0/971643355 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff2f005f050 con 0x564b8f73fcf0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d0039ac0 0x7ff1d003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f751150 0x564b8f7535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f753d30 con 0x564b8f751150 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f751150 0x564b8f7535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d0039ac0 0x7ff1d003bf80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4000c10 tx=0x7ff2f40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f751150 0x564b8f7535e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f751150 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 realm 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754140 con 0x564b8f751150 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f751150 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754a10 con 0x564b8f751150 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f751150 2024-09-10T06:22:53.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f751150 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f7558a0 0x564b8f757c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7583d0 con 0x564b8f7558a0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300782640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f7558a0 0x564b8f757c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300782640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f7558a0 0x564b8f757c90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 20 searching for the correct realm 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f75a370 0x564b8f75c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75cee0 con 0x564b8f75a370 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f75a370 0x564b8f75c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f75a370 0x564b8f75c810 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.617+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75cee0 con 0x564b8f7558a0 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300782640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2f0076040 0x7ff2f0027a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75cee0 con 0x7ff2f0076040 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2f0076040 0x7ff2f0027a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2f0076040 0x7ff2f0027a30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f80083f0 con 0x7ff2f0076040 2024-09-10T06:22:53.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f80083f0 con 0x564b8f751150 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f7558a0 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.621+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f7558a0 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.625+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f7558a0 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f7558a0 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f75a370 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x7ff2f0076040 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.629+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f751150 2024-09-10T06:22:53.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b8f754db0 con 0x564b8f7558a0 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f758c90 con 0x564b8f751150 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f759080 con 0x564b8f751150 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f759080 con 0x564b8f75a370 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 zone default found 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 4 Realm: () 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 zonegroup default 2024-09-10T06:22:53.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75d360 con 0x7ff2f0076040 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75ed50 con 0x564b8f75a370 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75f0f0 con 0x564b8f75a370 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 started sync module instance, tier type = 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:53.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75e1f0 con 0x564b8f7558a0 2024-09-10T06:22:53.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882529404384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75f990 con 0x564b8f7558a0 2024-09-10T06:22:53.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.633+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7601e0 con 0x564b8f751150 2024-09-10T06:22:53.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.637+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882529404384] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.637+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.637+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882529408224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7601e0 con 0x564b8f751150 2024-09-10T06:22:53.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.637+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f760cb0 con 0x564b8f75a370 2024-09-10T06:22:53.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.641+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882529408224] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.641+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.641+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882529410352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f760150 con 0x564b8f75a370 2024-09-10T06:22:53.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.641+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f761a60 con 0x564b8f7558a0 2024-09-10T06:22:53.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.645+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.645+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882529416528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f762300 con 0x564b8f7558a0 2024-09-10T06:22:53.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.645+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f762d00 con 0x564b8f751150 2024-09-10T06:22:53.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.645+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882529416528] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.645+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882529410352] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882529415328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f761e50 con 0x564b8f751150 2024-09-10T06:22:53.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7635a0 con 0x7ff2f0076040 2024-09-10T06:22:53.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882529415328] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882529421328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f761e50 con 0x7ff2f0076040 2024-09-10T06:22:53.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.649+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f763ab0 con 0x7ff2f0076040 2024-09-10T06:22:53.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.653+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882529421328] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.653+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.653+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882529423168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f763ab0 con 0x7ff2f0076040 2024-09-10T06:22:53.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.653+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7644b0 con 0x7ff2f0076040 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882529427392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7648d0 con 0x7ff2f0076040 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=0 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=1 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=2 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=3 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=4 2024-09-10T06:22:53.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=5 2024-09-10T06:22:53.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882529423168] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.657+0000 7ff302c7c9c0 20 add_watcher() i=6 2024-09-10T06:22:53.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882529427392] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 add_watcher() i=7 2024-09-10T06:22:53.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:53.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f763590 con 0x564b8f751150 2024-09-10T06:22:53.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882529424784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f764e20 con 0x564b8f751150 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882529424784] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff1b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 5 note: GC not initialized 2024-09-10T06:22:53.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff1b57e2640 20 reqs_thread_entry: start 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 Filter name: none 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff126ffd640 20 reqs_thread_entry: start 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.661+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b8f78aad0 con 0x564b8f751150 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T06:22:53.667 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T06:22:53.477579Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:53.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff1b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882529424784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f78b010 con 0x564b8f751150 2024-09-10T06:22:53.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94882529424784] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882529404384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f763590 con 0x564b8f7558a0 2024-09-10T06:22:53.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94882529404384] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 20 remove_watcher() i=0 2024-09-10T06:22:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 2 removed watcher, disabling cache 2024-09-10T06:22:53.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.665+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882529408224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75e5e0 con 0x564b8f751150 2024-09-10T06:22:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94882529408224] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff302c7c9c0 20 remove_watcher() i=1 2024-09-10T06:22:53.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882529410352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75e5e0 con 0x564b8f75a370 2024-09-10T06:22:53.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff2fff81640 1 -- 172.21.15.117:0/971643355 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94882529410352] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f40a9a60 con 0x564b8f75a370 2024-09-10T06:22:53.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff302c7c9c0 20 remove_watcher() i=2 2024-09-10T06:22:53.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.669+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882529416528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75fd30 con 0x564b8f7558a0 2024-09-10T06:22:53.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff300782640 1 -- 172.21.15.117:0/971643355 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94882529416528] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f000f070 con 0x564b8f7558a0 2024-09-10T06:22:53.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff302c7c9c0 20 remove_watcher() i=3 2024-09-10T06:22:53.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882529415328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75e5e0 con 0x564b8f751150 2024-09-10T06:22:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94882529415328] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x564b8f751150 2024-09-10T06:22:53.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff302c7c9c0 20 remove_watcher() i=4 2024-09-10T06:22:53.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.673+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882529421328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f761550 con 0x7ff2f0076040 2024-09-10T06:22:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.677+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94882529421328] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.677+0000 7ff302c7c9c0 20 remove_watcher() i=5 2024-09-10T06:22:53.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.677+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882529423168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f75fd30 con 0x7ff2f0076040 2024-09-10T06:22:53.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.681+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94882529423168] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.681+0000 7ff302c7c9c0 20 remove_watcher() i=6 2024-09-10T06:22:53.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.681+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882529427392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b8f7610a0 con 0x7ff2f0076040 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94882529427392] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2f8026040 con 0x7ff2f0076040 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 20 remove_watcher() i=7 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2f0076040 msgr2=0x7ff2f0027a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2f0076040 0x7ff2f0027a30 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f751150 msgr2=0x564b8f7535e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f751150 0x564b8f7535e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f7558a0 msgr2=0x564b8f757c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f7558a0 0x564b8f757c90 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f75a370 msgr2=0x564b8f75c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f75a370 0x564b8f75c810 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d0039ac0 msgr2=0x7ff1d003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d0039ac0 0x7ff1d003bf80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4000c10 tx=0x7ff2f40c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 msgr2=0x564b8f745fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/971643355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f73fcf0 0x564b8f745fa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff2f001df70 tx=0x7ff2f002f5d0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 reap_dead start 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff300f83640 1 -- 172.21.15.117:0/971643355 reap_dead start 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 shutdown_connections 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 >> 172.21.15.117:0/971643355 conn(0x564b8f73b0b0 msgr2=0x564b8f7392c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 shutdown_connections 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/971643355 wait complete. 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 msgr2=0x7ff1d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 0x7ff1d803bf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x564b8f71c0f0 tx=0x7ff2f4005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 msgr2=0x564b8f7328e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00064a0 tx=0x7ff2f0012630 comp rx=0 tx=0).stop 2024-09-10T06:22:53.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 shutdown_connections 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1d8039a70 0x7ff1d803bf30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/882487210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f7324c0 0x564b8f7328e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 >> 172.21.15.117:0/882487210 conn(0x564b8f727e70 msgr2=0x564b8f728250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 shutdown_connections 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/882487210 wait complete. 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f719380 msgr2=0x564b8f71b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564b8f719380 0x564b8f71b770 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f71df50 msgr2=0x564b8f720340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564b8f71df50 0x564b8f720340 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f721e90 msgr2=0x564b8f724280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564b8f721e90 0x564b8f724280 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1e8039a70 msgr2=0x7ff1e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1e8039a70 0x7ff1e803bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40ad000 tx=0x7ff2f40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 msgr2=0x564b8f714310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 --2- 172.21.15.117:0/1053865060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b8f6258c0 0x564b8f714310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x564b8f70d9a0 tx=0x7ff2f0001260 comp rx=0 tx=0).stop 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff300f83640 1 -- 172.21.15.117:0/1053865060 reap_dead start 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 shutdown_connections 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 >> 172.21.15.117:0/1053865060 conn(0x564b8f595080 msgr2=0x564b8f7070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 shutdown_connections 2024-09-10T06:22:53.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.685+0000 7ff302c7c9c0 1 -- 172.21.15.117:0/1053865060 wait complete. 2024-09-10T06:22:53.697 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T06:22:53.477579Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:53.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T06:22:53.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T06:22:53.697 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-10T06:22:53.777 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.777 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7666e4b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b701682770 0x55b701682b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7666e4b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7015349c0 con 0x55b7016858b0 2024-09-10T06:22:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7666e4b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55b7015846d0 con 0x55b701682770 2024-09-10T06:22:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7664951640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b701682770 0x55b701682b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7664951640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b701682770 0x55b701682b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42644/0 (socket says 172.21.15.117:42644) 2024-09-10T06:22:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7664951640 1 -- 172.21.15.117:0/2031649122 learned_addr learned my addr 172.21.15.117:0/2031649122 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7664951640 1 -- 172.21.15.117:0/2031649122 >> v1:172.21.15.84:6789/0 conn(0x55b7016858b0 legacy=0x55b701687ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.777+0000 7f7664951640 1 -- 172.21.15.117:0/2031649122 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b701528ca0 con 0x55b701682770 2024-09-10T06:22:53.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7664951640 1 --2- 172.21.15.117:0/2031649122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701682b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f765400a5c0 tx=0x7f765401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc19f2724950e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f766394f640 1 -- 172.21.15.117:0/2031649122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540a6070 con 0x55b701682770 2024-09-10T06:22:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f766394f640 1 -- 172.21.15.117:0/2031649122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540af070 con 0x55b701682770 2024-09-10T06:22:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f766394f640 1 -- 172.21.15.117:0/2031649122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540aa5c0 con 0x55b701682770 2024-09-10T06:22:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2031649122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 msgr2=0x55b701682b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2031649122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701682b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f765400a5c0 tx=0x7f765401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2031649122 shutdown_connections 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2031649122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701682b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2031649122 >> 172.21.15.117:0/2031649122 conn(0x55b7015f6080 msgr2=0x55b7015f6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2031649122 shutdown_connections 2024-09-10T06:22:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.781+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2031649122 wait complete. 2024-09-10T06:22:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7666e4b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7666e4b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b701588680 con 0x55b701682770 2024-09-10T06:22:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42654/0 (socket says 172.21.15.117:42654) 2024-09-10T06:22:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7664951640 1 -- 172.21.15.117:0/3994347827 learned_addr learned my addr 172.21.15.117:0/3994347827 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7664951640 1 -- 172.21.15.117:0/3994347827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b701503da0 con 0x55b701682770 2024-09-10T06:22:53.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7664951640 1 --2- 172.21.15.117:0/3994347827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f76540ac040 tx=0x7f7654003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc14d39a4650ac66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7552e0d640 1 -- 172.21.15.117:0/3994347827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540aa970 con 0x55b701682770 2024-09-10T06:22:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7552e0d640 1 -- 172.21.15.117:0/3994347827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540aab10 con 0x55b701682770 2024-09-10T06:22:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.793+0000 7f7552e0d640 1 -- 172.21.15.117:0/3994347827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540aae30 con 0x55b701682770 2024-09-10T06:22:53.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3994347827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 msgr2=0x55b70176d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3994347827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f76540ac040 tx=0x7f7654003030 comp rx=0 tx=0).stop 2024-09-10T06:22:53.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3994347827 shutdown_connections 2024-09-10T06:22:53.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3994347827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b70176d9e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3994347827 >> 172.21.15.117:0/3994347827 conn(0x55b7015f6080 msgr2=0x55b701769680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3994347827 shutdown_connections 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3994347827 wait complete. 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701774ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b70152aa50 con 0x55b701682770 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701774ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701774ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42668/0 (socket says 172.21.15.117:42668) 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7664951640 1 -- 172.21.15.117:0/2213821237 learned_addr learned my addr 172.21.15.117:0/2213821237 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7664951640 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b701775450 con 0x55b701682770 2024-09-10T06:22:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7664951640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701774ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f765401b170 tx=0x7f76540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f755160a640 1 -- 172.21.15.117:0/2213821237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540cb020 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7017756e0 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f755160a640 1 -- 172.21.15.117:0/2213821237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540c6650 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f755160a640 1 -- 172.21.15.117:0/2213821237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540c6950 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b701776090 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.797+0000 7f755160a640 1 -- 172.21.15.117:0/2213821237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76540ce020 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f755160a640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f754c039a70 0x7f754c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f755160a640 1 -- 172.21.15.117:0/2213821237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f76540ebb40 con 0x55b701682770 2024-09-10T06:22:53.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664150640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f754c039a70 0x7f754c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7016858b0 0x55b70177c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b70177c5a0 con 0x55b7016858b0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7665152640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7016858b0 0x55b70177c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664150640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f754c039a70 0x7f754c03bf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7658001e60 tx=0x7f76580013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7665152640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7016858b0 0x55b70177c060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7665152640 1 -- 172.21.15.117:0/2213821237 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7016858b0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b701776410 con 0x55b7016858b0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7665152640 1 -- 172.21.15.117:0/2213821237 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7016858b0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b70177e8b0 0x55b701780ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b701781390 con 0x55b70177e8b0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664951640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b70177e8b0 0x55b701780ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664951640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b70177e8b0 0x55b701780ca0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664951640 1 -- 172.21.15.117:0/2213821237 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f76540bd910 con 0x55b70177e8b0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b70177d780 con 0x55b7016858b0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7665152640 1 -- 172.21.15.117:0/2213821237 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7016858b0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017827f0 0x55b701784be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017852d0 con 0x55b7017827f0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664150640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017827f0 0x55b701784be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664150640 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017827f0 0x55b701784be0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7664150640 1 -- 172.21.15.117:0/2213821237 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f765800d040 con 0x55b7017827f0 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.801+0000 7f7666e4b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b701595450 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42682/0 (socket says 172.21.15.117:42682) 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 -- 172.21.15.117:0/2533764927 learned_addr learned my addr 172.21.15.117:0/2533764927 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 -- 172.21.15.117:0/2533764927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b701793810 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76540cfff0 tx=0x7f76540cf730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 -- 172.21.15.117:0/2533764927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540eb630 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 -- 172.21.15.117:0/2533764927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76540eb7d0 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b701794070 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 -- 172.21.15.117:0/2533764927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540bc7b0 con 0x55b701792db0 2024-09-10T06:22:53.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7017945e0 con 0x55b701792db0 2024-09-10T06:22:53.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 -- 172.21.15.117:0/2533764927 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76540bc950 con 0x55b701792db0 2024-09-10T06:22:53.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 0x7f753c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f754a7fc640 1 -- 172.21.15.117:0/2533764927 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f76540f6af0 con 0x55b701792db0 2024-09-10T06:22:53.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664150640 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 0x7f753c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664150640 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 0x7f753c03bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55b70177ca30 tx=0x7f7658006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7666e4b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b70176e150 con 0x55b7017a0490 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42688/0 (socket says 172.21.15.117:42688) 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.805+0000 7f7664951640 1 -- 172.21.15.117:0/1070902662 learned_addr learned my addr 172.21.15.117:0/1070902662 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 -- 172.21.15.117:0/1070902662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7017a0e80 con 0x55b7017a0490 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 --2- 172.21.15.117:0/1070902662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76540d04b0 tx=0x7f76540e69c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0b34e3c15072f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753bfff640 1 -- 172.21.15.117:0/1070902662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540e6410 con 0x55b7017a0490 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753bfff640 1 -- 172.21.15.117:0/1070902662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7654106070 con 0x55b7017a0490 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753bfff640 1 -- 172.21.15.117:0/1070902662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540f6e10 con 0x55b7017a0490 2024-09-10T06:22:53.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/1070902662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 msgr2=0x55b7017a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/1070902662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76540d04b0 tx=0x7f76540e69c0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/1070902662 shutdown_connections 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/1070902662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a0890 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/1070902662 >> 172.21.15.117:0/1070902662 conn(0x55b70179b8b0 msgr2=0x55b701799af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/1070902662 shutdown_connections 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/1070902662 wait complete. 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 Processor -- start 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- start start 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b7017a0e80 con 0x55b7017a0490 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42696/0 (socket says 172.21.15.117:42696) 2024-09-10T06:22:53.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 learned_addr learned my addr 172.21.15.117:0/3111313231 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7017a6bf0 con 0x55b7017a0490 2024-09-10T06:22:53.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7664951640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f76540d83f0 tx=0x7f76540e3f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753a7fc640 1 -- 172.21.15.117:0/3111313231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540f43e0 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753a7fc640 1 -- 172.21.15.117:0/3111313231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7654111070 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7017a6bf0 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f753a7fc640 1 -- 172.21.15.117:0/3111313231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76540d88b0 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.809+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7017a6bf0 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f753a7fc640 1 -- 172.21.15.117:0/3111313231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76540bcc90 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f753a7fc640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7530039ac0 0x7f753003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f753a7fc640 1 -- 172.21.15.117:0/3111313231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f76540b9200 con 0x55b7017a0490 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664150640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7530039ac0 0x7f753003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7017b1690 0x55b7017b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b4250 con 0x55b7017b1690 2024-09-10T06:22:53.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7017b1690 0x55b7017b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664150640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7530039ac0 0x7f753003bf80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55b7017856b0 tx=0x7f7658011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7017b1690 0x55b7017b3b00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 realm 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b4660 con 0x55b7017b1690 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b4f30 con 0x55b7017b1690 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b52d0 con 0x55b7017b1690 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b7017b6030 0x55b7017b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b8a70 con 0x55b7017b6030 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664951640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b7017b6030 0x55b7017b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664951640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b7017b6030 0x55b7017b8420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 20 searching for the correct realm 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017ba950 0x55b7017bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.813+0000 7f7664150640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017ba950 0x55b7017bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664150640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017ba950 0x55b7017bcd80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664951640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f765410d040 0x7f76540b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f765410d040 0x7f76540b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f765410d040 0x7f76540b38d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.817+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.821+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017ba950 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x7f765410d040 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b1690 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.825+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bd400 con 0x55b7017b6030 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:53.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b9420 con 0x55b7017b1690 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b9cc0 con 0x55b7017b1690 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017b9060 con 0x55b7017ba950 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 zone default found 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 4 Realm: () 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:53.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 zonegroup default 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bdd30 con 0x7f765410d040 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bf820 con 0x55b7017ba950 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bfcc0 con 0x55b7017ba950 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:53.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 started sync module instance, tier type = 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017bebb0 con 0x55b7017b6030 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94244492275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017be810 con 0x55b7017b6030 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.829+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c0bf0 con 0x55b7017b1690 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.833+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94244492275616] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.833+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.833+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94244492280096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c0bf0 con 0x55b7017b1690 2024-09-10T06:22:53.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.833+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c15b0 con 0x55b7017ba950 2024-09-10T06:22:53.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94244492280096] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94244492281664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c0b60 con 0x55b7017ba950 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c2340 con 0x55b7017b6030 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94244492287568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c2270 con 0x55b7017b6030 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c3240 con 0x55b7017b1690 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94244492281664] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.837+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94244492287568] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94244492289840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c2d50 con 0x55b7017b1690 2024-09-10T06:22:53.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c3ae0 con 0x7f765410d040 2024-09-10T06:22:53.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94244492289840] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94244492286368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c37f0 con 0x7f765410d040 2024-09-10T06:22:53.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.841+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c4040 con 0x7f765410d040 2024-09-10T06:22:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.845+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94244492286368] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.845+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.845+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94244492293200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c3e80 con 0x7f765410d040 2024-09-10T06:22:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.845+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c4970 con 0x7f765410d040 2024-09-10T06:22:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.845+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94244492293200] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94244492297280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c4930 con 0x7f765410d040 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=0 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=1 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=2 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=3 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=4 2024-09-10T06:22:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=5 2024-09-10T06:22:53.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=6 2024-09-10T06:22:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94244492297280] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 20 add_watcher() i=7 2024-09-10T06:22:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c7d90 con 0x55b7017b1690 2024-09-10T06:22:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.849+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94244492294352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c52b0 con 0x55b7017b1690 2024-09-10T06:22:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94244492294352] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f751afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 5 note: GC not initialized 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7519fe3640 20 reqs_thread_entry: start 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 Filter name: none 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f748b7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017eb420 con 0x55b7017b1690 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T06:22:53.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:53.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:53.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017f23f0 con 0x55b7017b1690 2024-09-10T06:22:53.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94244492484192 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017edb40 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94244492289840 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f765c018c80 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f753bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94244492289840 notifier 4401 bl.length()=758 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f753bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f753bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f753bfff640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7528003eb0 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(64 notify.4 [notify cookie 94244492484192 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94244492484192 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f765c034410 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.853+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017f1e60 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7666e4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T06:22:53.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94244492484192 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7017ed690 con 0x55b7017b6030 2024-09-10T06:22:53.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== watch-notify(notify (1) cookie 94244492275616 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55b701794070 con 0x55b7017b6030 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f753b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94244492275616 notifier 4401 bl.length()=159 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f753b7fe640 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f74980032d0 con 0x55b7017b6030 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.0 [notify cookie 94244492484192 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== watch-notify(notify_complete (2) cookie 94244492484192 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b701793810 con 0x55b7017b6030 2024-09-10T06:22:53.860 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T06:22:53.477579Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:53.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f751afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:53.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94244492294352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017b1690 2024-09-10T06:22:53.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94244492294352] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.857+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94244492275616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017b6030 2024-09-10T06:22:53.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94244492275616] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7666e4b9c0 20 remove_watcher() i=0 2024-09-10T06:22:53.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7666e4b9c0 2 removed watcher, disabling cache 2024-09-10T06:22:53.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94244492280096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017b1690 2024-09-10T06:22:53.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94244492280096] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7666e4b9c0 20 remove_watcher() i=1 2024-09-10T06:22:53.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.861+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94244492281664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017ba950 2024-09-10T06:22:53.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7664150640 1 -- 172.21.15.117:0/3111313231 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94244492281664] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7658036040 con 0x55b7017ba950 2024-09-10T06:22:53.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 20 remove_watcher() i=2 2024-09-10T06:22:53.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94244492287568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017b6030 2024-09-10T06:22:53.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7664951640 1 -- 172.21.15.117:0/3111313231 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94244492287568] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76540fe040 con 0x55b7017b6030 2024-09-10T06:22:53.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 20 remove_watcher() i=3 2024-09-10T06:22:53.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94244492289840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x55b7017b1690 2024-09-10T06:22:53.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94244492289840] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x55b7017b1690 2024-09-10T06:22:53.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 20 remove_watcher() i=4 2024-09-10T06:22:53.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.865+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94244492286368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c2730 con 0x7f765410d040 2024-09-10T06:22:53.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94244492286368] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7666e4b9c0 20 remove_watcher() i=5 2024-09-10T06:22:53.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94244492293200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017e9150 con 0x7f765410d040 2024-09-10T06:22:53.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94244492293200] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7666e4b9c0 20 remove_watcher() i=6 2024-09-10T06:22:53.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.869+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94244492297280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7017c3450 con 0x7f765410d040 2024-09-10T06:22:53.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94244492297280] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f765c00a4d0 con 0x7f765410d040 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 20 remove_watcher() i=7 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f765410d040 msgr2=0x7f76540b38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f765410d040 0x7f76540b38d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7017b1690 msgr2=0x55b7017b3b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7017b1690 0x55b7017b3b00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b7017b6030 msgr2=0x55b7017b8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b7017b6030 0x55b7017b8420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017ba950 msgr2=0x55b7017bcd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017ba950 0x55b7017bcd80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7530039ac0 msgr2=0x7f753003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7530039ac0 0x7f753003bf80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55b7017856b0 tx=0x7f7658011000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 msgr2=0x55b7017a6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7665152640 1 -- 172.21.15.117:0/3111313231 reap_dead start 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f76540d83f0 tx=0x7f76540e3f50 comp rx=0 tx=0).stop 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 shutdown_connections 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/3111313231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7017a0490 0x55b7017a6690 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 >> 172.21.15.117:0/3111313231 conn(0x55b70179b8b0 msgr2=0x55b701799ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 shutdown_connections 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/3111313231 wait complete. 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 msgr2=0x7f753c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 0x7f753c03bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55b70177ca30 tx=0x7f7658006000 comp rx=0 tx=0).stop 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 msgr2=0x55b7017931d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76540cfff0 tx=0x7f76540cf730 comp rx=0 tx=0).stop 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 shutdown_connections 2024-09-10T06:22:53.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f753c039a70 0x7f753c03bf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2533764927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701792db0 0x55b7017931d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 >> 172.21.15.117:0/2533764927 conn(0x55b701788760 msgr2=0x55b701788b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 shutdown_connections 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2533764927 wait complete. 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7016858b0 msgr2=0x55b70177c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b7016858b0 0x55b70177c060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b70177e8b0 msgr2=0x55b701780ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b70177e8b0 0x55b701780ca0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017827f0 msgr2=0x55b701784be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b7017827f0 0x55b701784be0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f754c039a70 msgr2=0x7f754c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f754c039a70 0x7f754c03bf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7658001e60 tx=0x7f76580013e0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 msgr2=0x55b701774ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 --2- 172.21.15.117:0/2213821237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b701682770 0x55b701774ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f765401b170 tx=0x7f76540180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7665152640 1 -- 172.21.15.117:0/2213821237 reap_dead start 2024-09-10T06:22:53.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 shutdown_connections 2024-09-10T06:22:53.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 >> 172.21.15.117:0/2213821237 conn(0x55b7015f6080 msgr2=0x55b701768110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 shutdown_connections 2024-09-10T06:22:53.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.873+0000 7f7666e4b9c0 1 -- 172.21.15.117:0/2213821237 wait complete. 2024-09-10T06:22:53.885 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T06:22:53.477579Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:53.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T06:22:53.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T06:22:53.886 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-10T06:22:53.963 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:53.963 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e7c0d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556b81bec8c0 0x556b81beecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e7c0d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b81a9c9c0 con 0x556b81b5c770 2024-09-10T06:22:53.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e7c0d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x556b81aec6d0 con 0x556b81bec8c0 2024-09-10T06:22:53.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e4f12640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556b81bec8c0 0x556b81beecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e5713640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x556b81b5c770 0x556b81beb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44318/0 (socket says 172.21.15.117:44318) 2024-09-10T06:22:53.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.961+0000 7fd9e5713640 1 -- 172.21.15.117:0/4042110449 learned_addr learned my addr 172.21.15.117:0/4042110449 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:53.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e4f12640 1 -- 172.21.15.117:0/4042110449 >> v1:172.21.15.84:6789/0 conn(0x556b81b5c770 legacy=0x556b81beb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e4f12640 1 -- 172.21.15.117:0/4042110449 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81a90ca0 con 0x556b81bec8c0 2024-09-10T06:22:53.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/4042110449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81bec8c0 0x556b81beecb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000a480 tx=0x7fd9d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bf5afccae0cf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9dffff640 1 -- 172.21.15.117:0/4042110449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00af070 con 0x556b81bec8c0 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9dffff640 1 -- 172.21.15.117:0/4042110449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00aa530 con 0x556b81bec8c0 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9dffff640 1 -- 172.21.15.117:0/4042110449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d00aa830 con 0x556b81bec8c0 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/4042110449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81bec8c0 msgr2=0x556b81beecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/4042110449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81bec8c0 0x556b81beecb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000a480 tx=0x7fd9d001b280 comp rx=0 tx=0).stop 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/4042110449 shutdown_connections 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/4042110449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81bec8c0 0x556b81beecb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/4042110449 >> 172.21.15.117:0/4042110449 conn(0x556b81be2e90 msgr2=0x556b81be52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/4042110449 shutdown_connections 2024-09-10T06:22:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.965+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/4042110449 wait complete. 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556b81af0680 con 0x556b81b5c770 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42714/0 (socket says 172.21.15.117:42714) 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 -- 172.21.15.117:0/305230736 learned_addr learned my addr 172.21.15.117:0/305230736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 -- 172.21.15.117:0/305230736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81a6bda0 con 0x556b81b5c770 2024-09-10T06:22:53.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 --2- 172.21.15.117:0/305230736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001e00 tx=0x7fd9d800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac222f3940360e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd8d3606640 1 -- 172.21.15.117:0/305230736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d8012020 con 0x556b81b5c770 2024-09-10T06:22:53.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd8d3606640 1 -- 172.21.15.117:0/305230736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d800e690 con 0x556b81b5c770 2024-09-10T06:22:53.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd8d3606640 1 -- 172.21.15.117:0/305230736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d800ea10 con 0x556b81b5c770 2024-09-10T06:22:53.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/305230736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 msgr2=0x556b81cd3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/305230736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001e00 tx=0x7fd9d800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/305230736 shutdown_connections 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/305230736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81cd3910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/305230736 >> 172.21.15.117:0/305230736 conn(0x556b81be2e90 msgr2=0x556b81ccf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/305230736 shutdown_connections 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/305230736 wait complete. 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81be8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e7c0d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556b81a92a50 con 0x556b81b5c770 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81be8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81be8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42718/0 (socket says 172.21.15.117:42718) 2024-09-10T06:22:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.981+0000 7fd9e5713640 1 -- 172.21.15.117:0/2331040239 learned_addr learned my addr 172.21.15.117:0/2331040239 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e5713640 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81be8de0 con 0x556b81b5c770 2024-09-10T06:22:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e5713640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81be8880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556b81cd4900 tx=0x7fd9d8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 -- 172.21.15.117:0/2331040239 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d8012030 con 0x556b81b5c770 2024-09-10T06:22:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 -- 172.21.15.117:0/2331040239 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d801a750 con 0x556b81b5c770 2024-09-10T06:22:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 -- 172.21.15.117:0/2331040239 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d801aa50 con 0x556b81b5c770 2024-09-10T06:22:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b81be71c0 con 0x556b81b5c770 2024-09-10T06:22:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b81be7750 con 0x556b81b5c770 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 -- 172.21.15.117:0/2331040239 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd9d8015020 con 0x556b81b5c770 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8cc039ac0 0x7fd8cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd8d1e03640 1 -- 172.21.15.117:0/2331040239 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd9d8020030 con 0x556b81b5c770 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8cc039ac0 0x7fd8cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81bec8c0 0x556b81ce4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81ce48d0 con 0x556b81bec8c0 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81bec8c0 0x556b81ce4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8cc039ac0 0x7fd8cc03bf80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00ac000 tx=0x7fd9d00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.985+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81bec8c0 0x556b81ce4390 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5f14640 1 -- 172.21.15.117:0/2331040239 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81bec8c0 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81ce4c70 con 0x556b81bec8c0 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5f14640 1 -- 172.21.15.117:0/2331040239 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81bec8c0 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81ce6a60 0x556b81ce8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81ce9520 con 0x556b81ce6a60 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81ce6a60 0x556b81ce8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81ce6a60 0x556b81ce8e50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 -- 172.21.15.117:0/2331040239 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81ce6a60 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81ce5900 con 0x556b81bec8c0 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5f14640 1 -- 172.21.15.117:0/2331040239 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81bec8c0 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81cea960 0x556b81cecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81ced440 con 0x556b81cea960 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81cea960 0x556b81cecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81cea960 0x556b81cecd50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e4f12640 1 -- 172.21.15.117:0/2331040239 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81cea960 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:53.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e7c0d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556b81afd450 con 0x556b81cfaf40 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42732/0 (socket says 172.21.15.117:42732) 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 -- 172.21.15.117:0/2755498637 learned_addr learned my addr 172.21.15.117:0/2755498637 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 -- 172.21.15.117:0/2755498637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81cfb9a0 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.989+0000 7fd9e5713640 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001030 tx=0x7fd9d8018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 -- 172.21.15.117:0/2755498637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d800d5f0 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b81cfc200 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 -- 172.21.15.117:0/2755498637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d802cb80 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 -- 172.21.15.117:0/2755498637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d802cd30 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b81cfc770 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 -- 172.21.15.117:0/2755498637 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd9d8009070 con 0x556b81cfaf40 2024-09-10T06:22:53.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 0x7fd8c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8caffd640 1 -- 172.21.15.117:0/2755498637 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd9d8047050 con 0x556b81cfaf40 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 0x7fd8c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e7c0d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556b81cd4160 con 0x556b81d08730 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 0x7fd8c003bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x556b81be7a30 tx=0x7fd9d0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42738/0 (socket says 172.21.15.117:42738) 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e5713640 1 -- 172.21.15.117:0/3951123805 learned_addr learned my addr 172.21.15.117:0/3951123805 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:53.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e5713640 1 -- 172.21.15.117:0/3951123805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81d09120 con 0x556b81d08730 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd9e5713640 1 --2- 172.21.15.117:0/3951123805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8036830 tx=0x7fd9d80479b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d71047877f6acd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8c8ff9640 1 -- 172.21.15.117:0/3951123805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d80407b0 con 0x556b81d08730 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8c8ff9640 1 -- 172.21.15.117:0/3951123805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d8050050 con 0x556b81d08730 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.993+0000 7fd8c8ff9640 1 -- 172.21.15.117:0/3951123805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d804b720 con 0x556b81d08730 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/3951123805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 msgr2=0x556b81d08b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/3951123805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8036830 tx=0x7fd9d80479b0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/3951123805 shutdown_connections 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/3951123805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d08b30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/3951123805 >> 172.21.15.117:0/3951123805 conn(0x556b81d03b50 msgr2=0x556b81d01d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/3951123805 shutdown_connections 2024-09-10T06:22:54.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/3951123805 wait complete. 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 Processor -- start 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- start start 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556b81d07500 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5713640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42754/0 (socket says 172.21.15.117:42754) 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 learned_addr learned my addr 172.21.15.117:0/902487278 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b81d0ef70 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5713640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd9d804da40 tx=0x7fd9d8049ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 -- 172.21.15.117:0/902487278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d8067020 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b81d0ef70 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b81d0ef70 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 -- 172.21.15.117:0/902487278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d804b8e0 con 0x556b81d08730 2024-09-10T06:22:54.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 -- 172.21.15.117:0/902487278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9d805f040 con 0x556b81d08730 2024-09-10T06:22:54.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 -- 172.21.15.117:0/902487278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd9d806a020 con 0x556b81d08730 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8b0039a70 0x7fd8b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd8b6ffd640 1 -- 172.21.15.117:0/902487278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fd9d8005050 con 0x556b81d08730 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8b0039a70 0x7fd8b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81d19bb0 0x556b81d1c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1c790 con 0x556b81d19bb0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:53.997+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81d19bb0 0x556b81d1c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8b0039a70 0x7fd8b003bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d001b2c0 tx=0x7fd9d00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81d19bb0 0x556b81d1c040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 realm 2024-09-10T06:22:54.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1cba0 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d470 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81d1e570 0x556b81d20960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d20f70 con 0x556b81d1e570 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81d1e570 0x556b81d20960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81d1e570 0x556b81d20960 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 20 searching for the correct realm 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81d22e50 0x556b81d25280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d25900 con 0x556b81d22e50 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81d22e50 0x556b81d25280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e4f12640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81d22e50 0x556b81d25280 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d25900 con 0x556b81d1e570 2024-09-10T06:22:54.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd9d8075040 0x7fd9d8036a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d25900 con 0x7fd9d8075040 2024-09-10T06:22:54.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.001+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd9d8075040 0x7fd9d8036a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd9d8075040 0x7fd9d8036a60 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d1e570 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.005+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d1e570 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d1e570 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.009+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d1e570 2024-09-10T06:22:54.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d22e50 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x7fd9d8075040 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d19bb0 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b81d1d810 con 0x556b81d1e570 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d217c0 con 0x556b81d19bb0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d21bb0 con 0x556b81d19bb0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d21bb0 con 0x556b81d22e50 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 zone default found 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 4 Realm: () 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 zonegroup default 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.013+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d25d80 con 0x7fd9d8075040 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d27870 con 0x556b81d22e50 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d27ce0 con 0x556b81d22e50 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d26c10 con 0x556b81d1e570 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920227913728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d26870 con 0x556b81d1e570 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d28bf0 con 0x556b81d19bb0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.017+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920227913728] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920227919680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d29010 con 0x556b81d19bb0 2024-09-10T06:22:54.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d298a0 con 0x556b81d22e50 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920227919680] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920227921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d29cc0 con 0x556b81d22e50 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.021+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2a680 con 0x556b81d1e570 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.025+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.025+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920227926752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2ad70 con 0x556b81d1e570 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.025+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2b890 con 0x556b81d19bb0 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.025+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920227926752] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.025+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920227921008] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.029+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.029+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920227930976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2b850 con 0x556b81d19bb0 2024-09-10T06:22:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.029+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2c130 con 0x7fd9d8075040 2024-09-10T06:22:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.029+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920227930976] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.033+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.033+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920227928000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2bd00 con 0x7fd9d8075040 2024-09-10T06:22:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.033+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2c6c0 con 0x7fd9d8075040 2024-09-10T06:22:54.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.037+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920227928000] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.037+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.037+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920227932512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2c6c0 con 0x7fd9d8075040 2024-09-10T06:22:54.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.037+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2d080 con 0x7fd9d8075040 2024-09-10T06:22:54.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.041+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920227932512] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920227935008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2d080 con 0x7fd9d8075040 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=0 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=1 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=2 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=3 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=4 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=5 2024-09-10T06:22:54.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=6 2024-09-10T06:22:54.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920227935008] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 20 add_watcher() i=7 2024-09-10T06:22:54.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d303a0 con 0x556b81d19bb0 2024-09-10T06:22:54.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.045+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920227937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2d610 con 0x556b81d19bb0 2024-09-10T06:22:54.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920227937600] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd89bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 5 note: GC not initialized 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd89afe5640 20 reqs_thread_entry: start 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 Filter name: none 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd898fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d53ac0 con 0x556b81d19bb0 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d5a4f0 con 0x556b81d19bb0 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:54.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93920228122464 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b81d592f0 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 93920227930976 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fd9e0026410 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd8c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93920227930976 notifier 4408 bl.length()=732 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd8c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd8c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(64 notify.4 [notify cookie 93920228122464 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd8c8ff9640 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd8a8003eb0 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.049+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 93920228122464 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd9e00265e0 con 0x556b81d19bb0 2024-09-10T06:22:54.054 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T06:22:53.477579Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:54.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd89bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920227937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d517f0 con 0x556b81d19bb0 2024-09-10T06:22:54.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93920227937600] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920227913728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d517f0 con 0x556b81d1e570 2024-09-10T06:22:54.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93920227913728] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e7c0d9c0 20 remove_watcher() i=0 2024-09-10T06:22:54.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e7c0d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.053+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920227919680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d517f0 con 0x556b81d19bb0 2024-09-10T06:22:54.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93920227919680] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 20 remove_watcher() i=1 2024-09-10T06:22:54.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920227921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d28740 con 0x556b81d22e50 2024-09-10T06:22:54.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e4f12640 1 -- 172.21.15.117:0/902487278 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93920227921008] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d00a8070 con 0x556b81d22e50 2024-09-10T06:22:54.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 20 remove_watcher() i=2 2024-09-10T06:22:54.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920227926752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d517f0 con 0x556b81d1e570 2024-09-10T06:22:54.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e5713640 1 -- 172.21.15.117:0/902487278 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93920227926752] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9d804a040 con 0x556b81d1e570 2024-09-10T06:22:54.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 20 remove_watcher() i=3 2024-09-10T06:22:54.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.057+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920227930976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2a2e0 con 0x556b81d19bb0 2024-09-10T06:22:54.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.061+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93920227930976] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x556b81d19bb0 2024-09-10T06:22:54.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.061+0000 7fd9e7c0d9c0 20 remove_watcher() i=4 2024-09-10T06:22:54.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.061+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920227928000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d517f0 con 0x7fd9d8075040 2024-09-10T06:22:54.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93920227928000] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e7c0d9c0 20 remove_watcher() i=5 2024-09-10T06:22:54.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920227932512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2b360 con 0x7fd9d8075040 2024-09-10T06:22:54.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93920227932512] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e7c0d9c0 20 remove_watcher() i=6 2024-09-10T06:22:54.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920227935008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b81d2a2e0 con 0x7fd9d8075040 2024-09-10T06:22:54.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93920227935008] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e000a4d0 con 0x7fd9d8075040 2024-09-10T06:22:54.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.065+0000 7fd9e7c0d9c0 20 remove_watcher() i=7 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd9d8075040 msgr2=0x7fd9d8036a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd9d8075040 0x7fd9d8036a60 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81d19bb0 msgr2=0x556b81d1c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81d19bb0 0x556b81d1c040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81d1e570 msgr2=0x556b81d20960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81d1e570 0x556b81d20960 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81d22e50 msgr2=0x556b81d25280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81d22e50 0x556b81d25280 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8b0039a70 msgr2=0x7fd8b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8b0039a70 0x7fd8b003bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d001b2c0 tx=0x7fd9d00a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e5f14640 1 -- 172.21.15.117:0/902487278 reap_dead start 2024-09-10T06:22:54.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 msgr2=0x556b81d0ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd9d804da40 tx=0x7fd9d8049ec0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 shutdown_connections 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/902487278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81d08730 0x556b81d0ea10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 >> 172.21.15.117:0/902487278 conn(0x556b81d03b50 msgr2=0x556b81d01d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 shutdown_connections 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/902487278 wait complete. 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 msgr2=0x7fd8c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 0x7fd8c003bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x556b81be7a30 tx=0x7fd9d0005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 msgr2=0x556b81cfb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001030 tx=0x7fd9d8018720 comp rx=0 tx=0).stop 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 shutdown_connections 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8c0039a70 0x7fd8c003bf30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2755498637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81cfaf40 0x556b81cfb360 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 >> 172.21.15.117:0/2755498637 conn(0x556b81cf08f0 msgr2=0x556b81cf0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 shutdown_connections 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2755498637 wait complete. 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81bec8c0 msgr2=0x556b81ce4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556b81bec8c0 0x556b81ce4390 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81ce6a60 msgr2=0x556b81ce8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556b81ce6a60 0x556b81ce8e50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81cea960 msgr2=0x556b81cecd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556b81cea960 0x556b81cecd50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8cc039ac0 msgr2=0x7fd8cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd8cc039ac0 0x7fd8cc03bf80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00ac000 tx=0x7fd9d00a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 msgr2=0x556b81be8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 --2- 172.21.15.117:0/2331040239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556b81b5c770 0x556b81be8880 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556b81cd4900 tx=0x7fd9d8000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e5f14640 1 -- 172.21.15.117:0/2331040239 reap_dead start 2024-09-10T06:22:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 shutdown_connections 2024-09-10T06:22:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 >> 172.21.15.117:0/2331040239 conn(0x556b81be2e90 msgr2=0x556b81cce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 shutdown_connections 2024-09-10T06:22:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.069+0000 7fd9e7c0d9c0 1 -- 172.21.15.117:0/2331040239 wait complete. 2024-09-10T06:22:54.080 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T06:22:53.477579Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:54.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T06:22:54.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T06:22:54.080 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-10T06:22:54.151 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:54.151 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c169029c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c524ea4300 0x55c524ea46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c169029c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c524d599c0 con 0x55c524ea74e0 2024-09-10T06:22:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c169029c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c524da96d0 con 0x55c524ea4300 2024-09-10T06:22:54.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c14408640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c524ea4300 0x55c524ea46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c14408640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c524ea4300 0x55c524ea46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42764/0 (socket says 172.21.15.117:42764) 2024-09-10T06:22:54.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c14408640 1 -- 172.21.15.117:0/3187676538 learned_addr learned my addr 172.21.15.117:0/3187676538 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c14408640 1 -- 172.21.15.117:0/3187676538 >> v1:172.21.15.84:6789/0 conn(0x55c524ea74e0 legacy=0x55c524ea98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.149+0000 7f0c14408640 1 -- 172.21.15.117:0/3187676538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524d4dca0 con 0x55c524ea4300 2024-09-10T06:22:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c14408640 1 --2- 172.21.15.117:0/3187676538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524ea46e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400a7a0 tx=0x7f0c0401d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3429448e34660b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c13406640 1 -- 172.21.15.117:0/3187676538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040b3070 con 0x55c524ea4300 2024-09-10T06:22:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c13406640 1 -- 172.21.15.117:0/3187676538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040a6720 con 0x55c524ea4300 2024-09-10T06:22:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c13406640 1 -- 172.21.15.117:0/3187676538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040a6a20 con 0x55c524ea4300 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 -- 172.21.15.117:0/3187676538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 msgr2=0x55c524ea46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 --2- 172.21.15.117:0/3187676538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524ea46e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400a7a0 tx=0x7f0c0401d800 comp rx=0 tx=0).stop 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 -- 172.21.15.117:0/3187676538 shutdown_connections 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 --2- 172.21.15.117:0/3187676538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524ea46e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 -- 172.21.15.117:0/3187676538 >> 172.21.15.117:0/3187676538 conn(0x55c524e9fe20 msgr2=0x55c524ea2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 -- 172.21.15.117:0/3187676538 shutdown_connections 2024-09-10T06:22:54.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.153+0000 7f0c169029c0 1 -- 172.21.15.117:0/3187676538 wait complete. 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.165+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c524dad680 con 0x55c524ea4300 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42770/0 (socket says 172.21.15.117:42770) 2024-09-10T06:22:54.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 -- 172.21.15.117:0/114692914 learned_addr learned my addr 172.21.15.117:0/114692914 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 -- 172.21.15.117:0/114692914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524d28da0 con 0x55c524ea4300 2024-09-10T06:22:54.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 --2- 172.21.15.117:0/114692914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c0401a410 tx=0x7f0c040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f940960e1cdd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0b0260c640 1 -- 172.21.15.117:0/114692914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040b3070 con 0x55c524ea4300 2024-09-10T06:22:54.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0b0260c640 1 -- 172.21.15.117:0/114692914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040b4040 con 0x55c524ea4300 2024-09-10T06:22:54.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0b0260c640 1 -- 172.21.15.117:0/114692914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040a6c30 con 0x55c524ea4300 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- 172.21.15.117:0/114692914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 msgr2=0x55c524f8e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 --2- 172.21.15.117:0/114692914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c0401a410 tx=0x7f0c040033b0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- 172.21.15.117:0/114692914 shutdown_connections 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 --2- 172.21.15.117:0/114692914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f8e760 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- 172.21.15.117:0/114692914 >> 172.21.15.117:0/114692914 conn(0x55c524e9fe20 msgr2=0x55c524f8a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- 172.21.15.117:0/114692914 shutdown_connections 2024-09-10T06:22:54.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- 172.21.15.117:0/114692914 wait complete. 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f9a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c169029c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c524d4fa50 con 0x55c524ea4300 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f9a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f9a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42774/0 (socket says 172.21.15.117:42774) 2024-09-10T06:22:54.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.169+0000 7f0c14408640 1 -- 172.21.15.117:0/2082288786 learned_addr learned my addr 172.21.15.117:0/2082288786 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c14408640 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524f9a5c0 con 0x55c524ea4300 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c14408640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f9a060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ba040 tx=0x7f0c0401a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 -- 172.21.15.117:0/2082288786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040aee00 con 0x55c524ea4300 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 -- 172.21.15.117:0/2082288786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040c5070 con 0x55c524ea4300 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c524f9a850 con 0x55c524ea4300 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 -- 172.21.15.117:0/2082288786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040c0570 con 0x55c524ea4300 2024-09-10T06:22:54.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c524f9b200 con 0x55c524ea4300 2024-09-10T06:22:54.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 -- 172.21.15.117:0/2082288786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0c040c0710 con 0x55c524ea4300 2024-09-10T06:22:54.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0afc039ac0 0x7f0afc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0b00e09640 1 -- 172.21.15.117:0/2082288786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c040bd070 con 0x55c524ea4300 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0afc039ac0 0x7f0afc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524ea74e0 0x55c524fa11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fa1710 con 0x55c524ea74e0 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524ea74e0 0x55c524fa11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0afc039ac0 0x7f0afc03bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001ec0 tx=0x7f0c08001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524ea74e0 0x55c524fa11d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c14c09640 1 -- 172.21.15.117:0/2082288786 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524ea74e0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.173+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fa1b10 con 0x55c524ea74e0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14c09640 1 -- 172.21.15.117:0/2082288786 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524ea74e0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fa3920 0x55c524fa5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fa63e0 con 0x55c524fa3920 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fa3920 0x55c524fa5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fa3920 0x55c524fa5d10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 -- 172.21.15.117:0/2082288786 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fa3920 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fa27c0 con 0x55c524ea74e0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14c09640 1 -- 172.21.15.117:0/2082288786 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524ea74e0 2024-09-10T06:22:54.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fa7820 0x55c524fa9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524faa3a0 con 0x55c524fa7820 2024-09-10T06:22:54.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fa7820 0x55c524fa9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fa7820 0x55c524fa9c10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c13c07640 1 -- 172.21.15.117:0/2082288786 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c0800d040 con 0x55c524fa7820 2024-09-10T06:22:54.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c524dba450 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42780/0 (socket says 172.21.15.117:42780) 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 -- 172.21.15.117:0/1009661100 learned_addr learned my addr 172.21.15.117:0/1009661100 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 -- 172.21.15.117:0/1009661100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524fb88c0 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c14408640 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad560 tx=0x7f0c040bf380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0af9ffb640 1 -- 172.21.15.117:0/1009661100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ca640 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0af9ffb640 1 -- 172.21.15.117:0/1009661100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040c88f0 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c524fb9120 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.177+0000 7f0af9ffb640 1 -- 172.21.15.117:0/1009661100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ea530 con 0x55c524fb7e60 2024-09-10T06:22:54.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c524fb9690 con 0x55c524fb7e60 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af9ffb640 1 -- 172.21.15.117:0/1009661100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0c040cad10 con 0x55c524fb7e60 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af9ffb640 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 0x7f0aec03c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af9ffb640 1 -- 172.21.15.117:0/1009661100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c040da070 con 0x55c524fb7e60 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c13c07640 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 0x7f0aec03c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c13c07640 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 0x7f0aec03c170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55c524faa7a0 tx=0x7f0c08006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c524f8eef0 con 0x55c524fc55d0 2024-09-10T06:22:54.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42788/0 (socket says 172.21.15.117:42788) 2024-09-10T06:22:54.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c14408640 1 -- 172.21.15.117:0/1043139619 learned_addr learned my addr 172.21.15.117:0/1043139619 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c14408640 1 -- 172.21.15.117:0/1043139619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524fc5fa0 con 0x55c524fc55d0 2024-09-10T06:22:54.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c14408640 1 --2- 172.21.15.117:0/1043139619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c8b10 tx=0x7f0c040d2ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3ccc979046522d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af37fe640 1 -- 172.21.15.117:0/1043139619 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ea8b0 con 0x55c524fc55d0 2024-09-10T06:22:54.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af37fe640 1 -- 172.21.15.117:0/1043139619 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040c93c0 con 0x55c524fc55d0 2024-09-10T06:22:54.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0af37fe640 1 -- 172.21.15.117:0/1043139619 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040d2dd0 con 0x55c524fc55d0 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1043139619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 msgr2=0x55c524fc59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1043139619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c8b10 tx=0x7f0c040d2ca0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1043139619 shutdown_connections 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1043139619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fc59b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1043139619 >> 172.21.15.117:0/1043139619 conn(0x55c524fc0990 msgr2=0x55c524fbebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1043139619 shutdown_connections 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.181+0000 7f0c169029c0 1 -- 172.21.15.117:0/1043139619 wait complete. 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 Processor -- start 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 -- start start 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fcb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c524fc4340 con 0x55c524fc55d0 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fcb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14408640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fcb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42798/0 (socket says 172.21.15.117:42798) 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 learned_addr learned my addr 172.21.15.117:0/2428530417 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c524fcbde0 con 0x55c524fc55d0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14408640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fcb880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c0fd0 tx=0x7f0c040d9e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 -- 172.21.15.117:0/2428530417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040ea8b0 con 0x55c524fc55d0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c524fcbde0 con 0x55c524fc55d0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c524fcbde0 con 0x55c524fc55d0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 -- 172.21.15.117:0/2428530417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c04007110 con 0x55c524fc55d0 2024-09-10T06:22:54.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 -- 172.21.15.117:0/2428530417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c040c9800 con 0x55c524fc55d0 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 -- 172.21.15.117:0/2428530417 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0c04110020 con 0x55c524fc55d0 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0ae4039a20 0x7f0ae403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0af1ffb640 1 -- 172.21.15.117:0/2428530417 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f0c0410e020 con 0x55c524fc55d0 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0ae4039a20 0x7f0ae403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524fd6990 0x55c524fd8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fd9570 con 0x55c524fd6990 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.185+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524fd6990 0x55c524fd8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0ae4039a20 0x7f0ae403bee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c08010fd0 tx=0x7f0c08011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524fd6990 0x55c524fd8e20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524fd6990 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 realm 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fd9980 con 0x55c524fd6990 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524fd6990 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda250 con 0x55c524fd6990 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524fd6990 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524fd6990 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fdb350 0x55c524fdd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fddd90 con 0x55c524fdb350 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fdb350 0x55c524fdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fdb350 0x55c524fdd740 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 20 searching for the correct realm 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fdfc70 0x55c524fe20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe2720 con 0x55c524fdfc70 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fdfc70 0x55c524fe20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c13c07640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fdfc70 0x55c524fe20a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe2720 con 0x55c524fdb350 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0c040dc370 0x7f0c040f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe2720 con 0x7f0c040dc370 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0c040dc370 0x7f0c040f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.189+0000 7f0c14c09640 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0c040dc370 0x7f0c040f6450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c0083f0 con 0x7f0c040dc370 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c0083f0 con 0x55c524fd6990 2024-09-10T06:22:54.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdb350 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdb350 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.193+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdb350 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.197+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdb350 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdfc70 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x7f0c040dc370 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fd6990 2024-09-10T06:22:54.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c524fda5f0 con 0x55c524fdb350 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fde5e0 con 0x55c524fd6990 2024-09-10T06:22:54.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fde9d0 con 0x55c524fd6990 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fde9d0 con 0x55c524fdfc70 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 zone default found 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 4 Realm: () 2024-09-10T06:22:54.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 zonegroup default 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.201+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe2ba0 con 0x7f0c040dc370 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe4690 con 0x55c524fdfc70 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe4b40 con 0x55c524fdfc70 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe3a30 con 0x55c524fdb350 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94305217560096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe3690 con 0x55c524fdb350 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe5a70 con 0x55c524fd6990 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94305217560096] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.205+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94305217566144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe59e0 con 0x55c524fd6990 2024-09-10T06:22:54.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe67c0 con 0x55c524fdfc70 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94305217566144] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94305217569552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe7060 con 0x55c524fdfc70 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe5e60 con 0x55c524fdb350 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94305217574256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe5e60 con 0x55c524fdb350 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.209+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe8460 con 0x55c524fd6990 2024-09-10T06:22:54.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94305217569552] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94305217574256] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94305217575312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe7fb0 con 0x55c524fd6990 2024-09-10T06:22:54.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe8d00 con 0x7f0c040dc370 2024-09-10T06:22:54.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94305217575312] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94305217571760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe89f0 con 0x7f0c040dc370 2024-09-10T06:22:54.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.213+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe9240 con 0x7f0c040dc370 2024-09-10T06:22:54.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94305217579984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe95c0 con 0x7f0c040dc370 2024-09-10T06:22:54.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fea0e0 con 0x7f0c040dc370 2024-09-10T06:22:54.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94305217571760] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94305217579984] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94305217584048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fea0a0 con 0x7f0c040dc370 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=0 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=1 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=2 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=3 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=4 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=5 2024-09-10T06:22:54.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.217+0000 7f0c169029c0 20 add_watcher() i=6 2024-09-10T06:22:54.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94305217584048] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 add_watcher() i=7 2024-09-10T06:22:54.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c524fed0d0 con 0x55c524fd6990 2024-09-10T06:22:54.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94305217578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fea550 con 0x55c524fd6990 2024-09-10T06:22:54.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94305217578304] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0acafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 5 note: GC not initialized 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0ac9fe3640 20 reqs_thread_entry: start 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 Filter name: none 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0ac2ffd640 20 reqs_thread_entry: start 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.221+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5250105f0 con 0x55c524fd6990 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T06:22:54.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:54.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:54.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c525017140 con 0x55c524fd6990 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94305217768368 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c5250128b0 con 0x55c524fd6990 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94305217575312 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0c0c010040 con 0x55c524fd6990 2024-09-10T06:22:54.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0af37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94305217575312 notifier 4415 bl.length()=567 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0af37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0af37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0af37fe640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0ad8003eb0 con 0x55c524fd6990 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(64 notify.4 [notify cookie 94305217768368 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94305217768368 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c0c00ada0 con 0x55c524fd6990 2024-09-10T06:22:54.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.225+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c525016bb0 con 0x55c524fdb350 2024-09-10T06:22:54.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c169029c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94305217768368 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c525011310 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== watch-notify(notify (1) cookie 94305217560096 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55c524fb9120 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0af2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94305217560096 notifier 4415 bl.length()=159 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0af2ffd640 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0a3c0032d0 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(67 notify.0 [notify cookie 94305217768368 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== watch-notify(notify_complete (2) cookie 94305217768368 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c524fb88c0 con 0x55c524fdb350 2024-09-10T06:22:54.231 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:54.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0acafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94305217578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x55c524fd6990 2024-09-10T06:22:54.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94305217578304] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.229+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94305217560096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x55c524fdb350 2024-09-10T06:22:54.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94305217560096] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c169029c0 20 remove_watcher() i=0 2024-09-10T06:22:54.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c169029c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94305217566144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x55c524fd6990 2024-09-10T06:22:54.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94305217566144] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c169029c0 20 remove_watcher() i=1 2024-09-10T06:22:54.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.233+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94305217569552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x55c524fdfc70 2024-09-10T06:22:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c13c07640 1 -- 172.21.15.117:0/2428530417 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94305217569552] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c08036040 con 0x55c524fdfc70 2024-09-10T06:22:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 20 remove_watcher() i=2 2024-09-10T06:22:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94305217574256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x55c524fdb350 2024-09-10T06:22:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c14408640 1 -- 172.21.15.117:0/2428530417 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94305217574256] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c040b6070 con 0x55c524fdb350 2024-09-10T06:22:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 20 remove_watcher() i=3 2024-09-10T06:22:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94305217575312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe7570 con 0x55c524fd6990 2024-09-10T06:22:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94305217575312] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x55c524fd6990 2024-09-10T06:22:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 20 remove_watcher() i=4 2024-09-10T06:22:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.237+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94305217571760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x7f0c040dc370 2024-09-10T06:22:54.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94305217571760] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c169029c0 20 remove_watcher() i=5 2024-09-10T06:22:54.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94305217579984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c524fe6bb0 con 0x7f0c040dc370 2024-09-10T06:22:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94305217579984] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c169029c0 20 remove_watcher() i=6 2024-09-10T06:22:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.241+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94305217584048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c52500e320 con 0x7f0c040dc370 2024-09-10T06:22:54.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94305217584048] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c026040 con 0x7f0c040dc370 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 20 remove_watcher() i=7 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0c040dc370 msgr2=0x7f0c040f6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0c040dc370 0x7f0c040f6450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524fd6990 msgr2=0x55c524fd8e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524fd6990 0x55c524fd8e20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fdb350 msgr2=0x55c524fdd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fdb350 0x55c524fdd740 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fdfc70 msgr2=0x55c524fe20a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fdfc70 0x55c524fe20a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0ae4039a20 msgr2=0x7f0ae403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0ae4039a20 0x7f0ae403bee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c08010fd0 tx=0x7f0c08011000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 msgr2=0x55c524fcb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2428530417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fc55d0 0x55c524fcb880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c040c0fd0 tx=0x7f0c040d9e80 comp rx=0 tx=0).stop 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c14c09640 1 -- 172.21.15.117:0/2428530417 reap_dead start 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 shutdown_connections 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 >> 172.21.15.117:0/2428530417 conn(0x55c524fc0990 msgr2=0x55c524fbeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 shutdown_connections 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2428530417 wait complete. 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 msgr2=0x7f0aec03c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 0x7f0aec03c170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55c524faa7a0 tx=0x7f0c08006000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 msgr2=0x55c524fb8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad560 tx=0x7f0c040bf380 comp rx=0 tx=0).stop 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 shutdown_connections 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0aec039cb0 0x7f0aec03c170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/1009661100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524fb7e60 0x55c524fb8280 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 >> 172.21.15.117:0/1009661100 conn(0x55c524fad810 msgr2=0x55c524fadbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 shutdown_connections 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/1009661100 wait complete. 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524ea74e0 msgr2=0x55c524fa11d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c524ea74e0 0x55c524fa11d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fa3920 msgr2=0x55c524fa5d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c524fa3920 0x55c524fa5d10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fa7820 msgr2=0x55c524fa9c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c524fa7820 0x55c524fa9c10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0afc039ac0 msgr2=0x7f0afc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0afc039ac0 0x7f0afc03bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001ec0 tx=0x7f0c08001440 comp rx=0 tx=0).stop 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 msgr2=0x55c524f9a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 --2- 172.21.15.117:0/2082288786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c524ea4300 0x55c524f9a060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ba040 tx=0x7f0c0401a5a0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c14c09640 1 -- 172.21.15.117:0/2082288786 reap_dead start 2024-09-10T06:22:54.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 shutdown_connections 2024-09-10T06:22:54.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 >> 172.21.15.117:0/2082288786 conn(0x55c524e9fe20 msgr2=0x55c524f88e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 shutdown_connections 2024-09-10T06:22:54.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.245+0000 7f0c169029c0 1 -- 172.21.15.117:0/2082288786 wait complete. 2024-09-10T06:22:54.257 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:54.257 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T06:22:54.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T06:22:54.257 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T06:22:54.329 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1cefc9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558935c51590 0x558935c50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1cefc9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558935b8e9c0 con 0x558935c51060 2024-09-10T06:22:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1cefc9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x558935bde6d0 con 0x558935c51590 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1a201640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558935c51590 0x558935c50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1a201640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558935c51590 0x558935c50110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42802/0 (socket says 172.21.15.117:42802) 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1a201640 1 -- 172.21.15.117:0/228805461 learned_addr learned my addr 172.21.15.117:0/228805461 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1aa02640 1 --1- 172.21.15.117:0/228805461 >> v1:172.21.15.84:6789/0 conn(0x558935c51060 0x558935c4fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44336/0 (socket says 172.21.15.117:44336) 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1a201640 1 -- 172.21.15.117:0/228805461 >> v1:172.21.15.84:6789/0 conn(0x558935c51060 legacy=0x558935c4fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.329+0000 7f1d1a201640 1 -- 172.21.15.117:0/228805461 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935b82ca0 con 0x558935c51590 2024-09-10T06:22:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1a201640 1 --2- 172.21.15.117:0/228805461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51590 0x558935c50110 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400a4e0 tx=0x7f1d1401b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35bb1bc4478a1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d19a00640 1 -- 172.21.15.117:0/228805461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d140aa540 con 0x558935c51590 2024-09-10T06:22:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d19a00640 1 -- 172.21.15.117:0/228805461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d140aa6e0 con 0x558935c51590 2024-09-10T06:22:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d19a00640 1 -- 172.21.15.117:0/228805461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d140aaa40 con 0x558935c51590 2024-09-10T06:22:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/228805461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51590 msgr2=0x558935c50110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/228805461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51590 0x558935c50110 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400a4e0 tx=0x7f1d1401b030 comp rx=0 tx=0).stop 2024-09-10T06:22:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/228805461 shutdown_connections 2024-09-10T06:22:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/228805461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51590 0x558935c50110 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/228805461 >> 172.21.15.117:0/228805461 conn(0x558935cd6040 msgr2=0x558935cd8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/228805461 shutdown_connections 2024-09-10T06:22:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.333+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/228805461 wait complete. 2024-09-10T06:22:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1cefc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1cefc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558935be2680 con 0x558935c51060 2024-09-10T06:22:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42814/0 (socket says 172.21.15.117:42814) 2024-09-10T06:22:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1aa02640 1 -- 172.21.15.117:0/1939277597 learned_addr learned my addr 172.21.15.117:0/1939277597 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1aa02640 1 -- 172.21.15.117:0/1939277597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935b5dda0 con 0x558935c51060 2024-09-10T06:22:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/1939277597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d04001ec0 tx=0x7f1d0400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8053e8b20cf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.345+0000 7f1c08e09640 1 -- 172.21.15.117:0/1939277597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0400e5d0 con 0x558935c51060 2024-09-10T06:22:54.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1c08e09640 1 -- 172.21.15.117:0/1939277597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0400e770 con 0x558935c51060 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1c08e09640 1 -- 172.21.15.117:0/1939277597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0400ea70 con 0x558935c51060 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/1939277597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 msgr2=0x558935dcc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/1939277597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d04001ec0 tx=0x7f1d0400b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/1939277597 shutdown_connections 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/1939277597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dcc470 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/1939277597 >> 172.21.15.117:0/1939277597 conn(0x558935cd6040 msgr2=0x558935dc8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/1939277597 shutdown_connections 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/1939277597 wait complete. 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558935b84a50 con 0x558935c51060 2024-09-10T06:22:54.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dd3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42830/0 (socket says 172.21.15.117:42830) 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1aa02640 1 -- 172.21.15.117:0/4285484352 learned_addr learned my addr 172.21.15.117:0/4285484352 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1aa02640 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935dd4020 con 0x558935c51060 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dd3ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x558935dcd460 tx=0x7f1d04000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1c07606640 1 -- 172.21.15.117:0/4285484352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0401a7c0 con 0x558935c51060 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558935dd42b0 con 0x558935c51060 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1c07606640 1 -- 172.21.15.117:0/4285484352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0401a980 con 0x558935c51060 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1c07606640 1 -- 172.21.15.117:0/4285484352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0401aca0 con 0x558935c51060 2024-09-10T06:22:54.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.349+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558935dd4c60 con 0x558935c51060 2024-09-10T06:22:54.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1c07606640 1 -- 172.21.15.117:0/4285484352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d04017070 con 0x558935c51060 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1c07606640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c00039a70 0x7f1c0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1c07606640 1 -- 172.21.15.117:0/4285484352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d04015020 con 0x558935c51060 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1a201640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c00039a70 0x7f1c0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935c51590 0x558935ddac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935ddb170 con 0x558935c51590 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1b203640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935c51590 0x558935ddac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1a201640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c00039a70 0x7f1c0003bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d140ab000 tx=0x7f1d140a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1b203640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935c51590 0x558935ddac30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1b203640 1 -- 172.21.15.117:0/4285484352 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935c51590 2024-09-10T06:22:54.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935dd4fd0 con 0x558935c51590 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1b203640 1 -- 172.21.15.117:0/4285484352 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935c51590 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935ddd460 0x558935ddf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935ddff40 con 0x558935ddd460 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935ddd460 0x558935ddf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935ddd460 0x558935ddf850 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1aa02640 1 -- 172.21.15.117:0/4285484352 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d0402e070 con 0x558935ddd460 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935ddc300 con 0x558935c51590 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1b203640 1 -- 172.21.15.117:0/4285484352 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935c51590 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935de13a0 0x558935de3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935de3ed0 con 0x558935de13a0 2024-09-10T06:22:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1a201640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935de13a0 0x558935de3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1a201640 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935de13a0 0x558935de3790 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1a201640 1 -- 172.21.15.117:0/4285484352 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d140bc040 con 0x558935de13a0 2024-09-10T06:22:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.353+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558935bef450 con 0x558935df1990 2024-09-10T06:22:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42846/0 (socket says 172.21.15.117:42846) 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1aa02640 1 -- 172.21.15.117:0/985157071 learned_addr learned my addr 172.21.15.117:0/985157071 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1aa02640 1 -- 172.21.15.117:0/985157071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935df23f0 con 0x558935df1990 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401afd0 tx=0x7f1d04019e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 -- 172.21.15.117:0/985157071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0401b500 con 0x558935df1990 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 -- 172.21.15.117:0/985157071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04035030 con 0x558935df1990 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 -- 172.21.15.117:0/985157071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04048ae0 con 0x558935df1990 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558935df2c50 con 0x558935df1990 2024-09-10T06:22:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558935df2c50 con 0x558935df1990 2024-09-10T06:22:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 -- 172.21.15.117:0/985157071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d040421b0 con 0x558935df1990 2024-09-10T06:22:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 0x7f1bf403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1c04e01640 1 -- 172.21.15.117:0/985157071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d0403f850 con 0x558935df1990 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1a201640 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 0x7f1bf403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.357+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1a201640 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 0x7f1bf403bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x558935ddb600 tx=0x7f1d14005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558935dccca0 con 0x558935dfefb0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42858/0 (socket says 172.21.15.117:42858) 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 -- 172.21.15.117:0/3247077520 learned_addr learned my addr 172.21.15.117:0/3247077520 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 -- 172.21.15.117:0/3247077520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935dff960 con 0x558935dfefb0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/3247077520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401bf90 tx=0x7f1d04040f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecca07fbd495d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1bfe7fc640 1 -- 172.21.15.117:0/3247077520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04044d80 con 0x558935dfefb0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1bfe7fc640 1 -- 172.21.15.117:0/3247077520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04048250 con 0x558935dfefb0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1bfe7fc640 1 -- 172.21.15.117:0/3247077520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04026390 con 0x558935dfefb0 2024-09-10T06:22:54.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/3247077520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 msgr2=0x558935dff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/3247077520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401bf90 tx=0x7f1d04040f50 comp rx=0 tx=0).stop 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/3247077520 shutdown_connections 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/3247077520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935dff390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/3247077520 >> 172.21.15.117:0/3247077520 conn(0x558935dfa370 msgr2=0x558935df85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/3247077520 shutdown_connections 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/3247077520 wait complete. 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 Processor -- start 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- start start 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1cefc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558935dfdd20 con 0x558935dfefb0 2024-09-10T06:22:54.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42860/0 (socket says 172.21.15.117:42860) 2024-09-10T06:22:54.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 learned_addr learned my addr 172.21.15.117:0/2915788056 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558935e057e0 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.361+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401bf90 tx=0x7f1d04021f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 -- 172.21.15.117:0/2915788056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0400f590 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558935e057e0 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558935e057e0 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 -- 172.21.15.117:0/2915788056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04066030 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 -- 172.21.15.117:0/2915788056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04070060 con 0x558935dfefb0 2024-09-10T06:22:54.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 -- 172.21.15.117:0/2915788056 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d0405a030 con 0x558935dfefb0 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1be4039a70 0x7f1be403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1bfcff9640 1 -- 172.21.15.117:0/2915788056 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1d04058070 con 0x558935dfefb0 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1a201640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1be4039a70 0x7f1be403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935e10280 0x558935e12710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e12e60 con 0x558935e10280 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935e10280 0x558935e12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1a201640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1be4039a70 0x7f1be403bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f90 tx=0x7f1d140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935e10280 0x558935e12710 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935e10280 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 realm 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e13270 con 0x558935e10280 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935e10280 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e13b40 con 0x558935e10280 2024-09-10T06:22:54.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935e10280 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935e10280 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935e14a10 0x558935e16e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e17540 con 0x558935e14a10 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935e14a10 0x558935e16e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.365+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935e14a10 0x558935e16e00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1cefc9c0 20 searching for the correct realm 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935e194e0 0x558935e1b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e1c020 con 0x558935e194e0 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1a201640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935e194e0 0x558935e1b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1a201640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935e194e0 0x558935e1b950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e1c020 con 0x558935e14a10 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1aa02640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1d0400a700 0x7f1d0400ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e1c020 con 0x7f1d0400a700 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1d0400a700 0x7f1d0400ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1d0400a700 0x7f1d0400ab40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0083f0 con 0x7f1d0400a700 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c0083f0 con 0x558935e10280 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.369+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e14a10 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e14a10 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.373+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e14a10 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e14a10 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e194e0 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.377+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x7f1d0400a700 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e10280 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558935e13ee0 con 0x558935e14a10 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e17e00 con 0x558935e10280 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e181f0 con 0x558935e10280 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e181f0 con 0x558935e194e0 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 zone default found 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 4 Realm: () 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 zonegroup default 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e1c4a0 con 0x7f1d0400a700 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e1de90 con 0x558935e194e0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e1e230 con 0x558935e194e0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.381+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1d330 con 0x558935e14a10 2024-09-10T06:22:54.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047802873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1ead0 con 0x558935e14a10 2024-09-10T06:22:54.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1f320 con 0x558935e10280 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047802873680] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047802877472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1f320 con 0x558935e10280 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.385+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1fe00 con 0x558935e194e0 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047802877472] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047802879600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1f290 con 0x558935e194e0 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e20bb0 con 0x558935e14a10 2024-09-10T06:22:54.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047802888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e21870 con 0x558935e14a10 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e22230 con 0x558935e10280 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047802879600] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.389+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047802888096] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.393+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.393+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047802891648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e21870 con 0x558935e10280 2024-09-10T06:22:54.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.393+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e221a0 con 0x7f1d0400a700 2024-09-10T06:22:54.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.393+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047802891648] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047802889424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e22650 con 0x7f1d0400a700 2024-09-10T06:22:54.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e23010 con 0x7f1d0400a700 2024-09-10T06:22:54.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047802889424] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047802895200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e22f80 con 0x7f1d0400a700 2024-09-10T06:22:54.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.397+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e23940 con 0x7f1d0400a700 2024-09-10T06:22:54.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047802895200] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047802897552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e23d60 con 0x7f1d0400a700 2024-09-10T06:22:54.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=0 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=1 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=2 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=3 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=4 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=5 2024-09-10T06:22:54.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.401+0000 7f1d1cefc9c0 20 add_watcher() i=6 2024-09-10T06:22:54.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047802897552] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 add_watcher() i=7 2024-09-10T06:22:54.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e23d60 con 0x558935e10280 2024-09-10T06:22:54.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047802898608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e23d40 con 0x558935e10280 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047802898608] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1bd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 5 note: GC not initialized 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1b4bfff640 20 reqs_thread_entry: start 2024-09-10T06:22:54.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 Filter name: none 2024-09-10T06:22:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1b49ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e49fb0 con 0x558935e10280 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e4a9a0 con 0x558935e10280 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558935e4b9b0 con 0x558935e14a10 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.405+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1bd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047802898608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e47d70 con 0x558935e10280 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94047802898608] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047802873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e47d70 con 0x558935e14a10 2024-09-10T06:22:54.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94047802873680] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1cefc9c0 20 remove_watcher() i=0 2024-09-10T06:22:54.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1cefc9c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.409+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047802877472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e47d70 con 0x558935e10280 2024-09-10T06:22:54.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94047802877472] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1cefc9c0 20 remove_watcher() i=1 2024-09-10T06:22:54.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047802879600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e47d70 con 0x558935e194e0 2024-09-10T06:22:54.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1a201640 1 -- 172.21.15.117:0/2915788056 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94047802879600] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d140ca070 con 0x558935e194e0 2024-09-10T06:22:54.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1cefc9c0 20 remove_watcher() i=2 2024-09-10T06:22:54.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.413+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047802888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1ee70 con 0x558935e14a10 2024-09-10T06:22:54.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1aa02640 1 -- 172.21.15.117:0/2915788056 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94047802888096] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0402e070 con 0x558935e14a10 2024-09-10T06:22:54.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1cefc9c0 20 remove_watcher() i=3 2024-09-10T06:22:54.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047802891648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1ee70 con 0x558935e10280 2024-09-10T06:22:54.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94047802891648] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x558935e10280 2024-09-10T06:22:54.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1cefc9c0 20 remove_watcher() i=4 2024-09-10T06:22:54.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.417+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047802889424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1ee70 con 0x7f1d0400a700 2024-09-10T06:22:54.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94047802889424] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1cefc9c0 20 remove_watcher() i=5 2024-09-10T06:22:54.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047802895200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e1ee70 con 0x7f1d0400a700 2024-09-10T06:22:54.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94047802895200] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1cefc9c0 20 remove_watcher() i=6 2024-09-10T06:22:54.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047802897552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558935e22b60 con 0x7f1d0400a700 2024-09-10T06:22:54.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94047802897552] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c026040 con 0x7f1d0400a700 2024-09-10T06:22:54.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.421+0000 7f1d1cefc9c0 20 remove_watcher() i=7 2024-09-10T06:22:54.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1d0400a700 msgr2=0x7f1d0400ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1d0400a700 0x7f1d0400ab40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935e10280 msgr2=0x558935e12710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935e10280 0x558935e12710 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935e14a10 msgr2=0x558935e16e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935e14a10 0x558935e16e00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935e194e0 msgr2=0x558935e1b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935e194e0 0x558935e1b950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1be4039a70 msgr2=0x7f1be403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1be4039a70 0x7f1be403bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d14000f90 tx=0x7f1d140a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 msgr2=0x558935e05280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401bf90 tx=0x7f1d04021f80 comp rx=0 tx=0).stop 2024-09-10T06:22:54.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1b203640 1 -- 172.21.15.117:0/2915788056 reap_dead start 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 shutdown_connections 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/2915788056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935dfefb0 0x558935e05280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 >> 172.21.15.117:0/2915788056 conn(0x558935dfa370 msgr2=0x558935df8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 shutdown_connections 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/2915788056 wait complete. 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 msgr2=0x7f1bf403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 0x7f1bf403bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x558935ddb600 tx=0x7f1d14005e50 comp rx=0 tx=0).stop 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 msgr2=0x558935df1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d0401afd0 tx=0x7f1d04019e10 comp rx=0 tx=0).stop 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 shutdown_connections 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1bf4039a70 0x7f1bf403bf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/985157071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935df1990 0x558935df1db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 >> 172.21.15.117:0/985157071 conn(0x558935de7340 msgr2=0x558935de7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 shutdown_connections 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/985157071 wait complete. 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935c51590 msgr2=0x558935ddac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558935c51590 0x558935ddac30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935ddd460 msgr2=0x558935ddf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558935ddd460 0x558935ddf850 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935de13a0 msgr2=0x558935de3790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558935de13a0 0x558935de3790 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c00039a70 msgr2=0x7f1c0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c00039a70 0x7f1c0003bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d140ab000 tx=0x7f1d140a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 msgr2=0x558935dd3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 --2- 172.21.15.117:0/4285484352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558935c51060 0x558935dd3ac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x558935dcd460 tx=0x7f1d04000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1b203640 1 -- 172.21.15.117:0/4285484352 reap_dead start 2024-09-10T06:22:54.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 shutdown_connections 2024-09-10T06:22:54.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 >> 172.21.15.117:0/4285484352 conn(0x558935cd6040 msgr2=0x558935dc6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 shutdown_connections 2024-09-10T06:22:54.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.425+0000 7f1d1cefc9c0 1 -- 172.21.15.117:0/4285484352 wait complete. 2024-09-10T06:22:54.436 INFO:teuthology.orchestra.run.smithi117.stdout:[] 2024-09-10T06:22:54.436 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T06:22:54.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T06:22:54.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T06:22:54.437 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T06:22:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.501+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.501+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.501+0000 7fa4938a59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577c740c8c0 0x5577c740ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.501+0000 7fa4938a59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577c72bc9c0 con 0x5577c737c770 2024-09-10T06:22:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.501+0000 7fa4938a59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5577c730c6d0 con 0x5577c740c8c0 2024-09-10T06:22:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa490baa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577c740c8c0 0x5577c740ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4913ab640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5577c737c770 0x5577c740b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44340/0 (socket says 172.21.15.117:44340) 2024-09-10T06:22:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa490baa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5577c740c8c0 0x5577c740ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42876/0 (socket says 172.21.15.117:42876) 2024-09-10T06:22:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4913ab640 1 -- 172.21.15.117:0/1513630707 learned_addr learned my addr 172.21.15.117:0/1513630707 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:54.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa490baa640 1 -- 172.21.15.117:0/1513630707 >> v1:172.21.15.84:6789/0 conn(0x5577c737c770 legacy=0x5577c740b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa490baa640 1 -- 172.21.15.117:0/1513630707 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c72b0ca0 con 0x5577c740c8c0 2024-09-10T06:22:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa490baa640 1 --2- 172.21.15.117:0/1513630707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c740c8c0 0x5577c740ecb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a420 tx=0x7fa47c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b68362abfdfb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa48bfff640 1 -- 172.21.15.117:0/1513630707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c0b0070 con 0x5577c740c8c0 2024-09-10T06:22:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa48bfff640 1 -- 172.21.15.117:0/1513630707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c0a3dc0 con 0x5577c740c8c0 2024-09-10T06:22:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa48bfff640 1 -- 172.21.15.117:0/1513630707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c0ab570 con 0x5577c740c8c0 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1513630707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c740c8c0 msgr2=0x5577c740ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1513630707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c740c8c0 0x5577c740ecb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a420 tx=0x7fa47c01afd0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1513630707 shutdown_connections 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1513630707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c740c8c0 0x5577c740ecb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1513630707 >> 172.21.15.117:0/1513630707 conn(0x5577c7402e90 msgr2=0x5577c74052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1513630707 shutdown_connections 2024-09-10T06:22:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.505+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1513630707 wait complete. 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577c7310680 con 0x5577c737c770 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42880/0 (socket says 172.21.15.117:42880) 2024-09-10T06:22:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 -- 172.21.15.117:0/3726683844 learned_addr learned my addr 172.21.15.117:0/3726683844 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 -- 172.21.15.117:0/3726683844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c728bda0 con 0x5577c737c770 2024-09-10T06:22:54.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 --2- 172.21.15.117:0/3726683844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa484001e00 tx=0x7fa48400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8581452bbded137 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa37f606640 1 -- 172.21.15.117:0/3726683844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484012020 con 0x5577c737c770 2024-09-10T06:22:54.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa37f606640 1 -- 172.21.15.117:0/3726683844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48400e690 con 0x5577c737c770 2024-09-10T06:22:54.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa37f606640 1 -- 172.21.15.117:0/3726683844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48400ea10 con 0x5577c737c770 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- 172.21.15.117:0/3726683844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 msgr2=0x5577c74f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/3726683844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa484001e00 tx=0x7fa48400b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- 172.21.15.117:0/3726683844 shutdown_connections 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/3726683844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74f38d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- 172.21.15.117:0/3726683844 >> 172.21.15.117:0/3726683844 conn(0x5577c7402e90 msgr2=0x5577c74ef570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- 172.21.15.117:0/3726683844 shutdown_connections 2024-09-10T06:22:54.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- 172.21.15.117:0/3726683844 wait complete. 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74faf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4938a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577c72b2a50 con 0x5577c737c770 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74faf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42888/0 (socket says 172.21.15.117:42888) 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.521+0000 7fa4913ab640 1 -- 172.21.15.117:0/1282866112 learned_addr learned my addr 172.21.15.117:0/1282866112 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4913ab640 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c74fb4d0 con 0x5577c737c770 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4913ab640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74faf70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5577c74f48c0 tx=0x7fa484000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 -- 172.21.15.117:0/1282866112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484012030 con 0x5577c737c770 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 -- 172.21.15.117:0/1282866112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48401a750 con 0x5577c737c770 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c74fb760 con 0x5577c737c770 2024-09-10T06:22:54.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 -- 172.21.15.117:0/1282866112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48401aa50 con 0x5577c737c770 2024-09-10T06:22:54.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c74fc110 con 0x5577c737c770 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 -- 172.21.15.117:0/1282866112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa484015020 con 0x5577c737c770 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa378039a70 0x7fa37803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa37de03640 1 -- 172.21.15.117:0/1282866112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa484020030 con 0x5577c737c770 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa490baa640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa378039a70 0x7fa37803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c740c8c0 0x5577c75020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7502620 con 0x5577c740c8c0 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa491bac640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c740c8c0 0x5577c75020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa490baa640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa378039a70 0x7fa37803bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0ad000 tx=0x7fa47c0a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa491bac640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c740c8c0 0x5577c75020e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa491bac640 1 -- 172.21.15.117:0/1282866112 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c740c8c0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7502a70 con 0x5577c740c8c0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa491bac640 1 -- 172.21.15.117:0/1282866112 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c740c8c0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c7504880 0x5577c7506c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7507340 con 0x5577c7504880 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.525+0000 7fa4913ab640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c7504880 0x5577c7506c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c7504880 0x5577c7506c70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 -- 172.21.15.117:0/1282866112 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa484008030 con 0x5577c7504880 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7503720 con 0x5577c740c8c0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa491bac640 1 -- 172.21.15.117:0/1282866112 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c740c8c0 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c7508780 0x5577c750ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c750b300 con 0x5577c7508780 2024-09-10T06:22:54.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa490baa640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c7508780 0x5577c750ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa490baa640 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c7508780 0x5577c750ab70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa490baa640 1 -- 172.21.15.117:0/1282866112 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa47c0abac0 con 0x5577c7508780 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577c731d450 con 0x5577c7518dc0 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42904/0 (socket says 172.21.15.117:42904) 2024-09-10T06:22:54.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 -- 172.21.15.117:0/1195653937 learned_addr learned my addr 172.21.15.117:0/1195653937 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 -- 172.21.15.117:0/1195653937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7519820 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4913ab640 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa48404ec80 tx=0x7fa48401aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa376ffd640 1 -- 172.21.15.117:0/1195653937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48402ce60 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c751a080 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa376ffd640 1 -- 172.21.15.117:0/1195653937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484016d10 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa376ffd640 1 -- 172.21.15.117:0/1195653937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484016570 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.529+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c751a080 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa376ffd640 1 -- 172.21.15.117:0/1195653937 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa48404a040 con 0x5577c7518dc0 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa376ffd640 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 0x7fa36c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa376ffd640 1 -- 172.21.15.117:0/1195653937 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa484005050 con 0x5577c7518dc0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa490baa640 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 0x7fa36c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577c74f4120 con 0x5577c75263e0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa490baa640 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 0x7fa36c03bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5577c750b700 tx=0x7fa47c005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42908/0 (socket says 172.21.15.117:42908) 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4913ab640 1 -- 172.21.15.117:0/1647147934 learned_addr learned my addr 172.21.15.117:0/1647147934 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4913ab640 1 -- 172.21.15.117:0/1647147934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7526d90 con 0x5577c75263e0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4913ab640 1 --2- 172.21.15.117:0/1647147934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa484018c60 tx=0x7fa484016840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4859d5dfe26ac390 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa374ff9640 1 -- 172.21.15.117:0/1647147934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840168f0 con 0x5577c75263e0 2024-09-10T06:22:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa374ff9640 1 -- 172.21.15.117:0/1647147934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48400cc20 con 0x5577c75263e0 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa374ff9640 1 -- 172.21.15.117:0/1647147934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484027e50 con 0x5577c75263e0 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1647147934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 msgr2=0x5577c75267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1647147934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa484018c60 tx=0x7fa484016840 comp rx=0 tx=0).stop 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1647147934 shutdown_connections 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1647147934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c75267c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1647147934 >> 172.21.15.117:0/1647147934 conn(0x5577c75217a0 msgr2=0x5577c751f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1647147934 shutdown_connections 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1647147934 wait complete. 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 Processor -- start 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- start start 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.533+0000 7fa4938a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577c7525150 con 0x5577c75263e0 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4913ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42922/0 (socket says 172.21.15.117:42922) 2024-09-10T06:22:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 learned_addr learned my addr 172.21.15.117:0/731878675 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c752cbb0 con 0x5577c75263e0 2024-09-10T06:22:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4913ab640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4840481e0 tx=0x7fa484031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 -- 172.21.15.117:0/731878675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48400cc20 con 0x5577c75263e0 2024-09-10T06:22:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c752cbb0 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c752cbb0 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 -- 172.21.15.117:0/731878675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484063070 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 -- 172.21.15.117:0/731878675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840400e0 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 -- 172.21.15.117:0/731878675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa48406f060 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa35c039a20 0x7fa35c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa362ffd640 1 -- 172.21.15.117:0/731878675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa48405ead0 con 0x5577c75263e0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa490baa640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa35c039a20 0x7fa35c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c7537760 0x5577c7539bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753a340 con 0x5577c7537760 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa491bac640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c7537760 0x5577c7539bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa490baa640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa35c039a20 0x7fa35c03bee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa47c017be0 tx=0x7fa47c0b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa491bac640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c7537760 0x5577c7539bf0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c7537760 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 realm 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753a750 con 0x5577c7537760 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c7537760 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.537+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b020 con 0x5577c7537760 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c7537760 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c7537760 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c753bef0 0x5577c753e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753ea20 con 0x5577c753bef0 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c753bef0 0x5577c753e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c753bef0 0x5577c753e2e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 20 searching for the correct realm 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c75409c0 0x5577c7542e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7543530 con 0x5577c75409c0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa490baa640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c75409c0 0x5577c7542e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa490baa640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c75409c0 0x5577c7542e60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7543530 con 0x5577c753bef0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa484017050 0x7fa4840035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7543530 con 0x7fa484017050 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa484017050 0x7fa4840035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa484017050 0x7fa4840035b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c0083f0 con 0x7fa484017050 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.541+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c0083f0 con 0x5577c7537760 2024-09-10T06:22:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c753bef0 2024-09-10T06:22:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c753bef0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.545+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c753bef0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.549+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c753bef0 2024-09-10T06:22:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c75409c0 2024-09-10T06:22:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x7fa484017050 2024-09-10T06:22:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c7537760 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c753b3c0 con 0x5577c753bef0 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753f2e0 con 0x5577c7537760 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753f6d0 con 0x5577c7537760 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c753f6d0 con 0x5577c75409c0 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 zone default found 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 4 Realm: () 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 zonegroup default 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c75439b0 con 0x7fa484017050 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c75453a0 con 0x5577c75409c0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.553+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7545740 con 0x5577c75409c0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7544840 con 0x5577c753bef0 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93972933659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7545f90 con 0x5577c753bef0 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c75467e0 con 0x5577c7537760 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93972933659696] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93972933663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7546820 con 0x5577c7537760 2024-09-10T06:22:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.557+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7547310 con 0x5577c75409c0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93972933668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7547bb0 con 0x5577c75409c0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c75485b0 con 0x5577c753bef0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93972933663456] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93972933665584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c75489d0 con 0x5577c753bef0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7549390 con 0x5577c7537760 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.561+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93972933668320] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93972933670656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7549390 con 0x5577c7537760 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7549c20 con 0x7fa484017050 2024-09-10T06:22:54.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93972933665584] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93972933670656] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93972933673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7549390 con 0x7fa484017050 2024-09-10T06:22:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.565+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c754a4c0 con 0x7fa484017050 2024-09-10T06:22:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.569+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.569+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93972933681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7549390 con 0x7fa484017050 2024-09-10T06:22:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.569+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c754af00 con 0x7fa484017050 2024-09-10T06:22:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.569+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93972933673152] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93972933676768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c754b0e0 con 0x7fa484017050 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=0 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=1 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=2 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=3 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=4 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=5 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93972933681168] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=6 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93972933676768] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 add_watcher() i=7 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c754e000 con 0x5577c7537760 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93972933684000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c754b3f0 con 0x5577c7537760 2024-09-10T06:22:54.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93972933684000] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa3477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.573+0000 7fa4938a59c0 5 note: GC not initialized 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa3467e4640 20 reqs_thread_entry: start 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 Filter name: none 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa2b7fff640 20 reqs_thread_entry: start 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7570f70 con 0x5577c7537760 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7571960 con 0x5577c7537760 2024-09-10T06:22:54.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7572970 con 0x5577c753bef0 2024-09-10T06:22:54.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa3477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93972933684000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c756ed00 con 0x5577c7537760 2024-09-10T06:22:54.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93972933684000] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.577+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93972933659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c756ed00 con 0x5577c753bef0 2024-09-10T06:22:54.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93972933659696] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4938a59c0 20 remove_watcher() i=0 2024-09-10T06:22:54.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4938a59c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93972933663456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c756ed00 con 0x5577c7537760 2024-09-10T06:22:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93972933663456] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4938a59c0 20 remove_watcher() i=1 2024-09-10T06:22:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.581+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93972933668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7545ae0 con 0x5577c75409c0 2024-09-10T06:22:54.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa490baa640 1 -- 172.21.15.117:0/731878675 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93972933668320] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c0c9070 con 0x5577c75409c0 2024-09-10T06:22:54.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 20 remove_watcher() i=2 2024-09-10T06:22:54.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93972933665584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c756ed00 con 0x5577c753bef0 2024-09-10T06:22:54.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4913ab640 1 -- 172.21.15.117:0/731878675 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93972933665584] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa484008030 con 0x5577c753bef0 2024-09-10T06:22:54.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 20 remove_watcher() i=3 2024-09-10T06:22:54.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93972933670656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7546330 con 0x5577c7537760 2024-09-10T06:22:54.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93972933670656] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x5577c7537760 2024-09-10T06:22:54.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 20 remove_watcher() i=4 2024-09-10T06:22:54.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.585+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93972933673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c756ed00 con 0x7fa484017050 2024-09-10T06:22:54.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93972933673152] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa4938a59c0 20 remove_watcher() i=5 2024-09-10T06:22:54.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93972933681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7546330 con 0x7fa484017050 2024-09-10T06:22:54.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93972933681168] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa4938a59c0 20 remove_watcher() i=6 2024-09-10T06:22:54.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.589+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93972933676768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c75480c0 con 0x7fa484017050 2024-09-10T06:22:54.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93972933676768] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c026040 con 0x7fa484017050 2024-09-10T06:22:54.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 20 remove_watcher() i=7 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa484017050 msgr2=0x7fa4840035b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa484017050 0x7fa4840035b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c7537760 msgr2=0x5577c7539bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c7537760 0x5577c7539bf0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c753bef0 msgr2=0x5577c753e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c753bef0 0x5577c753e2e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c75409c0 msgr2=0x5577c7542e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c75409c0 0x5577c7542e60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa35c039a20 msgr2=0x7fa35c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa35c039a20 0x7fa35c03bee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa47c017be0 tx=0x7fa47c0b8040 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 msgr2=0x5577c752c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4840481e0 tx=0x7fa484031f10 comp rx=0 tx=0).stop 2024-09-10T06:22:54.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa491bac640 1 -- 172.21.15.117:0/731878675 reap_dead start 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 shutdown_connections 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/731878675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c75263e0 0x5577c752c650 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 >> 172.21.15.117:0/731878675 conn(0x5577c75217a0 msgr2=0x5577c751f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 shutdown_connections 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/731878675 wait complete. 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 msgr2=0x7fa36c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 0x7fa36c03bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5577c750b700 tx=0x7fa47c005d90 comp rx=0 tx=0).stop 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 msgr2=0x5577c75191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa48404ec80 tx=0x7fa48401aec0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 shutdown_connections 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa36c039a70 0x7fa36c03bf30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1195653937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c7518dc0 0x5577c75191e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 >> 172.21.15.117:0/1195653937 conn(0x5577c750e770 msgr2=0x5577c750eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 shutdown_connections 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1195653937 wait complete. 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c740c8c0 msgr2=0x5577c75020e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5577c740c8c0 0x5577c75020e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c7504880 msgr2=0x5577c7506c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5577c7504880 0x5577c7506c70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c7508780 msgr2=0x5577c750ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5577c7508780 0x5577c750ab70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa378039a70 msgr2=0x7fa37803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa378039a70 0x7fa37803bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0ad000 tx=0x7fa47c0a5070 comp rx=0 tx=0).stop 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 msgr2=0x5577c74faf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 --2- 172.21.15.117:0/1282866112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577c737c770 0x5577c74faf70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5577c74f48c0 tx=0x7fa484000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa491bac640 1 -- 172.21.15.117:0/1282866112 reap_dead start 2024-09-10T06:22:54.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 shutdown_connections 2024-09-10T06:22:54.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 >> 172.21.15.117:0/1282866112 conn(0x5577c7402e90 msgr2=0x5577c74ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 shutdown_connections 2024-09-10T06:22:54.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.593+0000 7fa4938a59c0 1 -- 172.21.15.117:0/1282866112 wait complete. 2024-09-10T06:22:54.605 INFO:teuthology.orchestra.run.smithi117.stdout:[] 2024-09-10T06:22:54.605 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T06:22:54.627 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:54.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T06:22:54.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T06:22:54.627 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T06:22:54.673 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:54.673 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:54.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8ec4e9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556a0414eb90 0x556a041e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8ec4e9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a0408e9c0 con 0x556a0414e7b0 2024-09-10T06:22:54.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8ec4e9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x556a040de6d0 con 0x556a0414eb90 2024-09-10T06:22:54.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8bf53640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556a0414eb90 0x556a041e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8c754640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x556a0414e7b0 0x556a041df560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44348/0 (socket says 172.21.15.117:44348) 2024-09-10T06:22:54.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8bf53640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556a0414eb90 0x556a041e2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42930/0 (socket says 172.21.15.117:42930) 2024-09-10T06:22:54.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8c754640 1 -- 172.21.15.117:0/3333180203 learned_addr learned my addr 172.21.15.117:0/3333180203 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:54.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8b752640 1 -- 172.21.15.117:0/3333180203 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459407285 0 0) 0x556a0408e9c0 con 0x556a0414e7b0 2024-09-10T06:22:54.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8b752640 1 -- 172.21.15.117:0/3333180203 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b74001e20 con 0x556a0414e7b0 2024-09-10T06:22:54.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8bf53640 1 -- 172.21.15.117:0/3333180203 >> v1:172.21.15.84:6789/0 conn(0x556a0414e7b0 legacy=0x556a041df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.673+0000 7f8b8bf53640 1 -- 172.21.15.117:0/3333180203 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a04082ca0 con 0x556a0414eb90 2024-09-10T06:22:54.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/3333180203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414eb90 0x556a041e2c90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000a480 tx=0x7f8b8001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e43676d1da0e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8b752640 1 -- 172.21.15.117:0/3333180203 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b800b0070 con 0x556a0414eb90 2024-09-10T06:22:54.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8b752640 1 -- 172.21.15.117:0/3333180203 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b800ab540 con 0x556a0414eb90 2024-09-10T06:22:54.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8b752640 1 -- 172.21.15.117:0/3333180203 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b800ab840 con 0x556a0414eb90 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3333180203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414eb90 msgr2=0x556a041e2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3333180203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414eb90 0x556a041e2c90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000a480 tx=0x7f8b8001b280 comp rx=0 tx=0).stop 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3333180203 shutdown_connections 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3333180203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414eb90 0x556a041e2c90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3333180203 >> 172.21.15.117:0/3333180203 conn(0x556a041d4e90 msgr2=0x556a041d72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3333180203 shutdown_connections 2024-09-10T06:22:54.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.677+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3333180203 wait complete. 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8ec4e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8ec4e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a040e2680 con 0x556a0414e7b0 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42936/0 (socket says 172.21.15.117:42936) 2024-09-10T06:22:54.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8c754640 1 -- 172.21.15.117:0/380273580 learned_addr learned my addr 172.21.15.117:0/380273580 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8c754640 1 -- 172.21.15.117:0/380273580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a0405dda0 con 0x556a0414e7b0 2024-09-10T06:22:54.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8b8c754640 1 --2- 172.21.15.117:0/380273580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c001e40 tx=0x7f8b7c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1ef9e084d5f22b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8a7a60c640 1 -- 172.21.15.117:0/380273580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c012020 con 0x556a0414e7b0 2024-09-10T06:22:54.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8a7a60c640 1 -- 172.21.15.117:0/380273580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00e690 con 0x556a0414e7b0 2024-09-10T06:22:54.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.689+0000 7f8a7a60c640 1 -- 172.21.15.117:0/380273580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c00e9b0 con 0x556a0414e7b0 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/380273580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 msgr2=0x556a042c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/380273580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c001e40 tx=0x7f8b7c00b790 comp rx=0 tx=0).stop 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/380273580 shutdown_connections 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/380273580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042c7890 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/380273580 >> 172.21.15.117:0/380273580 conn(0x556a041d4e90 msgr2=0x556a042c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/380273580 shutdown_connections 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/380273580 wait complete. 2024-09-10T06:22:54.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a04084a50 con 0x556a0414e7b0 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42950/0 (socket says 172.21.15.117:42950) 2024-09-10T06:22:54.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8c754640 1 -- 172.21.15.117:0/820565364 learned_addr learned my addr 172.21.15.117:0/820565364 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8c754640 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a042cf460 con 0x556a0414e7b0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8c754640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042cef00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x556a042c8820 tx=0x7f8b7c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8a78e09640 1 -- 172.21.15.117:0/820565364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c012030 con 0x556a0414e7b0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a042cf6f0 con 0x556a0414e7b0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8a78e09640 1 -- 172.21.15.117:0/820565364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c01a720 con 0x556a0414e7b0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8a78e09640 1 -- 172.21.15.117:0/820565364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c01aa60 con 0x556a0414e7b0 2024-09-10T06:22:54.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.693+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a042d00a0 con 0x556a0414e7b0 2024-09-10T06:22:54.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8a78e09640 1 -- 172.21.15.117:0/820565364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b7c015020 con 0x556a0414e7b0 2024-09-10T06:22:54.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8a78e09640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a74039a70 0x7f8a7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8a78e09640 1 -- 172.21.15.117:0/820565364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8b7c020070 con 0x556a0414e7b0 2024-09-10T06:22:54.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a74039a70 0x7f8a7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0414eb90 0x556a042d6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a042d65b0 con 0x556a0414eb90 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0414eb90 0x556a042d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a74039a70 0x7f8a7403bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b800ad000 tx=0x7f8b800a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0414eb90 0x556a042d6070 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8cf55640 1 -- 172.21.15.117:0/820565364 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0414eb90 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a042d69d0 con 0x556a0414eb90 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8cf55640 1 -- 172.21.15.117:0/820565364 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0414eb90 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a042d87e0 0x556a042dabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a042db270 con 0x556a042d87e0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8c754640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a042d87e0 0x556a042dabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8c754640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a042d87e0 0x556a042dabd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8c754640 1 -- 172.21.15.117:0/820565364 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b7c008030 con 0x556a042d87e0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a042d7650 con 0x556a0414eb90 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8cf55640 1 -- 172.21.15.117:0/820565364 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0414eb90 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a042dc6b0 0x556a042deac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a042df250 con 0x556a042dc6b0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a042dc6b0 0x556a042deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a042dc6b0 0x556a042deac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8bf53640 1 -- 172.21.15.117:0/820565364 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b800aca20 con 0x556a042dc6b0 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.697+0000 7f8b8ec4e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a040ef450 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42958/0 (socket says 172.21.15.117:42958) 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 -- 172.21.15.117:0/3155250713 learned_addr learned my addr 172.21.15.117:0/3155250713 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 -- 172.21.15.117:0/3155250713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a042ed770 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000c10 tx=0x7f8b7c016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 -- 172.21.15.117:0/3155250713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c04d670 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a042edfd0 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 -- 172.21.15.117:0/3155250713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c04ffa0 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 -- 172.21.15.117:0/3155250713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c0502c0 con 0x556a042ecd10 2024-09-10T06:22:54.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a042edfd0 con 0x556a042ecd10 2024-09-10T06:22:54.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 -- 172.21.15.117:0/3155250713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b7c04b030 con 0x556a042ecd10 2024-09-10T06:22:54.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 0x7f8a6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8a71ffb640 1 -- 172.21.15.117:0/3155250713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8b7c005050 con 0x556a042ecd10 2024-09-10T06:22:54.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 0x7f8a6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8ec4e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a042c80e0 con 0x556a042f9280 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 0x7f8a6403bf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b8001b2c0 tx=0x7f8b80005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42972/0 (socket says 172.21.15.117:42972) 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.701+0000 7f8b8c754640 1 -- 172.21.15.117:0/720818674 learned_addr learned my addr 172.21.15.117:0/720818674 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 -- 172.21.15.117:0/720818674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a042f9c30 con 0x556a042f9280 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 --2- 172.21.15.117:0/720818674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c02ef90 tx=0x7f8b7c02dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdcd3e7f847b791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a6b7fe640 1 -- 172.21.15.117:0/720818674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c047620 con 0x556a042f9280 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a6b7fe640 1 -- 172.21.15.117:0/720818674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c059070 con 0x556a042f9280 2024-09-10T06:22:54.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a6b7fe640 1 -- 172.21.15.117:0/720818674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c024460 con 0x556a042f9280 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/720818674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 msgr2=0x556a042f9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/720818674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c02ef90 tx=0x7f8b7c02dd40 comp rx=0 tx=0).stop 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/720818674 shutdown_connections 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/720818674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a042f9660 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/720818674 >> 172.21.15.117:0/720818674 conn(0x556a042f56b0 msgr2=0x556a042f38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/720818674 shutdown_connections 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/720818674 wait complete. 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 Processor -- start 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- start start 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a042fa110 con 0x556a042f9280 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42982/0 (socket says 172.21.15.117:42982) 2024-09-10T06:22:54.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 learned_addr learned my addr 172.21.15.117:0/263559313 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a04300b70 con 0x556a042f9280 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8c754640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c026040 tx=0x7f8b7c019e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a69ffb640 1 -- 172.21.15.117:0/263559313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c06d070 con 0x556a042f9280 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a04300b70 con 0x556a042f9280 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a04300b70 con 0x556a042f9280 2024-09-10T06:22:54.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a69ffb640 1 -- 172.21.15.117:0/263559313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c022920 con 0x556a042f9280 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.705+0000 7f8a69ffb640 1 -- 172.21.15.117:0/263559313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c022ad0 con 0x556a042f9280 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8a69ffb640 1 -- 172.21.15.117:0/263559313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b7c070070 con 0x556a042f9280 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8a69ffb640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a5c039ac0 0x7f8a5c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8a69ffb640 1 -- 172.21.15.117:0/263559313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8b7c064030 con 0x556a042f9280 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a5c039ac0 0x7f8a5c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0430b5b0 0x556a0430da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a0430e190 con 0x556a0430b5b0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0430b5b0 0x556a0430da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a5c039ac0 0x7f8a5c03bf80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c10 tx=0x7f8b800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0430b5b0 0x556a0430da40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 realm 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a0430e5a0 con 0x556a0430b5b0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a0430ee70 con 0x556a0430b5b0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a0430fd40 0x556a04312130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04312870 con 0x556a0430fd40 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8c754640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a0430fd40 0x556a04312130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8c754640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a0430fd40 0x556a04312130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 20 searching for the correct realm 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a04314810 0x556a04316c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a04317350 con 0x556a04314810 2024-09-10T06:22:54.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a04314810 0x556a04316c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a04314810 0x556a04316c80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.709+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a04317350 con 0x556a0430fd40 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8c754640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8b7c072060 0x7f8b7c00d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a04317350 con 0x7f8b7c072060 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8b7c072060 0x7f8b7c00d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8b7c072060 0x7f8b7c00d7c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430fd40 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.713+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430fd40 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430fd40 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.717+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430fd40 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a04314810 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x7f8b7c072060 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430b5b0 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a0430f210 con 0x556a0430fd40 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04313130 con 0x556a0430b5b0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04313520 con 0x556a0430b5b0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.721+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04313520 con 0x556a04314810 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 zone default found 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 4 Realm: () 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 zonegroup default 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a043177d0 con 0x7f8b7c072060 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a043191c0 con 0x556a04314810 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04319560 con 0x556a04314810 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04318660 con 0x556a0430fd40 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93913825249872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04319e00 con 0x556a0430fd40 2024-09-10T06:22:54.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431a650 con 0x556a0430b5b0 2024-09-10T06:22:54.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.725+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93913825249872] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.729+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.729+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93913825253712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431a220 con 0x556a0430b5b0 2024-09-10T06:22:54.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.729+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431acf0 con 0x556a04314810 2024-09-10T06:22:54.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.729+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93913825253712] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93913825254768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431a190 con 0x556a04314810 2024-09-10T06:22:54.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431bad0 con 0x556a0430fd40 2024-09-10T06:22:54.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93913825260992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431c370 con 0x556a0430fd40 2024-09-10T06:22:54.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.733+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431cd70 con 0x556a0430b5b0 2024-09-10T06:22:54.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.737+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93913825260992] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.737+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93913825254768] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.737+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.737+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93913825259792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431bec0 con 0x556a0430b5b0 2024-09-10T06:22:54.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.737+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431d610 con 0x7f8b7c072060 2024-09-10T06:22:54.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.741+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93913825259792] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.745+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.745+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93913825265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431bec0 con 0x7f8b7c072060 2024-09-10T06:22:54.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.745+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431dac0 con 0x7f8b7c072060 2024-09-10T06:22:54.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.749+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93913825265792] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.749+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.749+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93913825269168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431da80 con 0x7f8b7c072060 2024-09-10T06:22:54.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.749+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431e4a0 con 0x7f8b7c072060 2024-09-10T06:22:54.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93913825269168] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93913825271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431e460 con 0x7f8b7c072060 2024-09-10T06:22:54.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=0 2024-09-10T06:22:54.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=1 2024-09-10T06:22:54.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=2 2024-09-10T06:22:54.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=3 2024-09-10T06:22:54.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=4 2024-09-10T06:22:54.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=5 2024-09-10T06:22:54.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.753+0000 7f8b8ec4e9c0 20 add_watcher() i=6 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93913825271696] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 20 add_watcher() i=7 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a043218f0 con 0x556a0430b5b0 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93913825267520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431edc0 con 0x556a0430b5b0 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93913825267520] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8b8ec4e9c0 5 note: GC not initialized 2024-09-10T06:22:54.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.757+0000 7f8a417e2640 20 reqs_thread_entry: start 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 Filter name: none 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f89b2ffd640 20 reqs_thread_entry: start 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04344a60 con 0x556a0430b5b0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04345450 con 0x556a0430b5b0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:54.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a04346460 con 0x556a0430fd40 2024-09-10T06:22:54.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93913825267520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04342890 con 0x556a0430b5b0 2024-09-10T06:22:54.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93913825267520] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.761+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93913825249872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04342890 con 0x556a0430fd40 2024-09-10T06:22:54.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93913825249872] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8ec4e9c0 20 remove_watcher() i=0 2024-09-10T06:22:54.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8ec4e9c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93913825253712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04342890 con 0x556a0430b5b0 2024-09-10T06:22:54.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93913825253712] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8ec4e9c0 20 remove_watcher() i=1 2024-09-10T06:22:54.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.765+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93913825254768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04342890 con 0x556a04314810 2024-09-10T06:22:54.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8bf53640 1 -- 172.21.15.117:0/263559313 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93913825254768] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b800cb030 con 0x556a04314810 2024-09-10T06:22:54.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8ec4e9c0 20 remove_watcher() i=2 2024-09-10T06:22:54.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93913825260992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04318a50 con 0x556a0430fd40 2024-09-10T06:22:54.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8c754640 1 -- 172.21.15.117:0/263559313 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93913825260992] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c06f030 con 0x556a0430fd40 2024-09-10T06:22:54.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8ec4e9c0 20 remove_watcher() i=3 2024-09-10T06:22:54.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.769+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93913825259792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04318a50 con 0x556a0430b5b0 2024-09-10T06:22:54.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93913825259792] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x556a0430b5b0 2024-09-10T06:22:54.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8ec4e9c0 20 remove_watcher() i=4 2024-09-10T06:22:54.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93913825265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431b110 con 0x7f8b7c072060 2024-09-10T06:22:54.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93913825265792] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8ec4e9c0 20 remove_watcher() i=5 2024-09-10T06:22:54.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.773+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93913825269168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a04318a50 con 0x7f8b7c072060 2024-09-10T06:22:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93913825269168] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 20 remove_watcher() i=6 2024-09-10T06:22:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93913825271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a0431b110 con 0x7f8b7c072060 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93913825271696] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4d0 con 0x7f8b7c072060 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 20 remove_watcher() i=7 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8b7c072060 msgr2=0x7f8b7c00d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8b7c072060 0x7f8b7c00d7c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0430b5b0 msgr2=0x556a0430da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0430b5b0 0x556a0430da40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a0430fd40 msgr2=0x556a04312130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a0430fd40 0x556a04312130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a04314810 msgr2=0x556a04316c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.777+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a04314810 0x556a04316c80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a5c039ac0 msgr2=0x7f8a5c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a5c039ac0 0x7f8a5c03bf80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c10 tx=0x7f8b800a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 msgr2=0x556a04300610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8cf55640 1 -- 172.21.15.117:0/263559313 reap_dead start 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c026040 tx=0x7f8b7c019e00 comp rx=0 tx=0).stop 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 shutdown_connections 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/263559313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042f9280 0x556a04300610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 >> 172.21.15.117:0/263559313 conn(0x556a042f56b0 msgr2=0x556a042f38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 shutdown_connections 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/263559313 wait complete. 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 msgr2=0x7f8a6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 0x7f8a6403bf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b8001b2c0 tx=0x7f8b80005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 msgr2=0x556a042ed130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c000c10 tx=0x7f8b7c016b00 comp rx=0 tx=0).stop 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 shutdown_connections 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a64039a70 0x7f8a6403bf30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/3155250713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a042ecd10 0x556a042ed130 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 >> 172.21.15.117:0/3155250713 conn(0x556a042e26c0 msgr2=0x556a042e2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 shutdown_connections 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/3155250713 wait complete. 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0414eb90 msgr2=0x556a042d6070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556a0414eb90 0x556a042d6070 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a042d87e0 msgr2=0x556a042dabd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556a042d87e0 0x556a042dabd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a042dc6b0 msgr2=0x556a042deac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x556a042dc6b0 0x556a042deac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a74039a70 msgr2=0x7f8a7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8a74039a70 0x7f8a7403bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b800ad000 tx=0x7f8b800a5040 comp rx=0 tx=0).stop 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 msgr2=0x556a042cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 --2- 172.21.15.117:0/820565364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a0414e7b0 0x556a042cef00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x556a042c8820 tx=0x7f8b7c0040f0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8cf55640 1 -- 172.21.15.117:0/820565364 reap_dead start 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 shutdown_connections 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 >> 172.21.15.117:0/820565364 conn(0x556a041d4e90 msgr2=0x556a042c1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 shutdown_connections 2024-09-10T06:22:54.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.781+0000 7f8b8ec4e9c0 1 -- 172.21.15.117:0/820565364 wait complete. 2024-09-10T06:22:54.791 INFO:teuthology.orchestra.run.smithi117.stdout:["myfoo"] 2024-09-10T06:22:54.792 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T06:22:54.795 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:54.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T06:22:54.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T06:22:54.795 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T06:22:54.859 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:54.860 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:54.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f46004079c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x559aa5cb66a0 0x559aa5cb8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f46004079c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559aa5b669c0 con 0x559aa5cb2500 2024-09-10T06:22:54.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f46004079c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x559aa5bb66d0 con 0x559aa5cb66a0 2024-09-10T06:22:54.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f45fd70c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x559aa5cb66a0 0x559aa5cb8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f45fdf0d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x559aa5cb2500 0x559aa5cb28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:44354/0 (socket says 172.21.15.117:44354) 2024-09-10T06:22:54.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.857+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1796969642 learned_addr learned my addr 172.21.15.117:0/1796969642 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:54.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.861+0000 7f45fd70c640 1 -- 172.21.15.117:0/1796969642 >> v1:172.21.15.84:6789/0 conn(0x559aa5cb2500 legacy=0x559aa5cb28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.861+0000 7f45fd70c640 1 -- 172.21.15.117:0/1796969642 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5b5aca0 con 0x559aa5cb66a0 2024-09-10T06:22:54.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.861+0000 7f45fd70c640 1 --2- 172.21.15.117:0/1796969642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb66a0 0x559aa5cb8a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f45f000a420 tx=0x7f45f001b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af41c39153de3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f45fcf0b640 1 -- 172.21.15.117:0/1796969642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00af070 con 0x559aa5cb66a0 2024-09-10T06:22:54.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f45fcf0b640 1 -- 172.21.15.117:0/1796969642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f00aa530 con 0x559aa5cb66a0 2024-09-10T06:22:54.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f45fcf0b640 1 -- 172.21.15.117:0/1796969642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00aa850 con 0x559aa5cb66a0 2024-09-10T06:22:54.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 -- 172.21.15.117:0/1796969642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb66a0 msgr2=0x559aa5cb8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 --2- 172.21.15.117:0/1796969642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb66a0 0x559aa5cb8a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f45f000a420 tx=0x7f45f001b060 comp rx=0 tx=0).stop 2024-09-10T06:22:54.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 -- 172.21.15.117:0/1796969642 shutdown_connections 2024-09-10T06:22:54.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 --2- 172.21.15.117:0/1796969642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb66a0 0x559aa5cb8a90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 -- 172.21.15.117:0/1796969642 >> 172.21.15.117:0/1796969642 conn(0x559aa5cae020 msgr2=0x559aa5cb0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 -- 172.21.15.117:0/1796969642 shutdown_connections 2024-09-10T06:22:54.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.865+0000 7f46004079c0 1 -- 172.21.15.117:0/1796969642 wait complete. 2024-09-10T06:22:54.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f46004079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f46004079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559aa5bba680 con 0x559aa5cb2500 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42988/0 (socket says 172.21.15.117:42988) 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1636490548 learned_addr learned my addr 172.21.15.117:0/1636490548 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1636490548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5b35da0 con 0x559aa5cb2500 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/1636490548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45e8001e50 tx=0x7f45e8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b74bdd26cea082 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f44ebe07640 1 -- 172.21.15.117:0/1636490548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8012020 con 0x559aa5cb2500 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f44ebe07640 1 -- 172.21.15.117:0/1636490548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e800e7c0 con 0x559aa5cb2500 2024-09-10T06:22:54.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.877+0000 7f44ebe07640 1 -- 172.21.15.117:0/1636490548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e800eaa0 con 0x559aa5cb2500 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/1636490548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 msgr2=0x559aa5c28f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 --2- 172.21.15.117:0/1636490548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45e8001e50 tx=0x7f45e8001e80 comp rx=0 tx=0).stop 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/1636490548 shutdown_connections 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 --2- 172.21.15.117:0/1636490548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5c28f60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/1636490548 >> 172.21.15.117:0/1636490548 conn(0x559aa5cae020 msgr2=0x559aa5d99520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/1636490548 shutdown_connections 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/1636490548 wait complete. 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5da7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559aa5b5ca50 con 0x559aa5cb2500 2024-09-10T06:22:54.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5da7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5da7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:42994/0 (socket says 172.21.15.117:42994) 2024-09-10T06:22:54.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f45fdf0d640 1 -- 172.21.15.117:0/963462741 learned_addr learned my addr 172.21.15.117:0/963462741 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f45fdf0d640 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5da76c0 con 0x559aa5cb2500 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5da7160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x559aa5c28b40 tx=0x7f45e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f44ea604640 1 -- 172.21.15.117:0/963462741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8012030 con 0x559aa5cb2500 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa5da7950 con 0x559aa5cb2500 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f44ea604640 1 -- 172.21.15.117:0/963462741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e801a680 con 0x559aa5cb2500 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f44ea604640 1 -- 172.21.15.117:0/963462741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e801a9a0 con 0x559aa5cb2500 2024-09-10T06:22:54.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa5da8210 con 0x559aa5cb2500 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.881+0000 7f44ea604640 1 -- 172.21.15.117:0/963462741 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f45e8015020 con 0x559aa5cb2500 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f44ea604640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44e4039a70 0x7f44e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f44ea604640 1 -- 172.21.15.117:0/963462741 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f45e8020070 con 0x559aa5cb2500 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fd70c640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44e4039a70 0x7f44e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5cb66a0 0x559aa5dae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5dae720 con 0x559aa5cb66a0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fe70e640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5cb66a0 0x559aa5dae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fd70c640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44e4039a70 0x7f44e403bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ac000 tx=0x7f45f00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fe70e640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5cb66a0 0x559aa5dae1e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fe70e640 1 -- 172.21.15.117:0/963462741 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5cb66a0 2024-09-10T06:22:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5daeb20 con 0x559aa5cb66a0 2024-09-10T06:22:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fe70e640 1 -- 172.21.15.117:0/963462741 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5cb66a0 2024-09-10T06:22:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5db0930 0x559aa5db2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5db33f0 con 0x559aa5db0930 2024-09-10T06:22:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5db0930 0x559aa5db2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5db0930 0x559aa5db2d20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fdf0d640 1 -- 172.21.15.117:0/963462741 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f45e8008030 con 0x559aa5db0930 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5daf7d0 con 0x559aa5cb66a0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fe70e640 1 -- 172.21.15.117:0/963462741 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5cb66a0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5db4830 0x559aa5db6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5db73b0 con 0x559aa5db4830 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fd70c640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5db4830 0x559aa5db6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fd70c640 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5db4830 0x559aa5db6c20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f45fd70c640 1 -- 172.21.15.117:0/963462741 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f45f00b2070 con 0x559aa5db4830 2024-09-10T06:22:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.885+0000 7f46004079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559aa5bc7450 con 0x559aa5dc4e70 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51752/0 (socket says 172.21.15.117:51752) 2024-09-10T06:22:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 -- 172.21.15.117:0/124958305 learned_addr learned my addr 172.21.15.117:0/124958305 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 -- 172.21.15.117:0/124958305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5dc58d0 con 0x559aa5dc4e70 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f45e804ec60 tx=0x7f45e802d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 -- 172.21.15.117:0/124958305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e80235a0 con 0x559aa5dc4e70 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 -- 172.21.15.117:0/124958305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e800d5a0 con 0x559aa5dc4e70 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa5dc6130 con 0x559aa5dc4e70 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 -- 172.21.15.117:0/124958305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e800d880 con 0x559aa5dc4e70 2024-09-10T06:22:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa5dc6130 con 0x559aa5dc4e70 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 -- 172.21.15.117:0/124958305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f45e804c070 con 0x559aa5dc4e70 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 0x7f44d803c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f44e37fe640 1 -- 172.21.15.117:0/124958305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f45e8005050 con 0x559aa5dc4e70 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fd70c640 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 0x7f44d803c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fd70c640 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 0x7f44d803c080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45f0018c90 tx=0x7f45f0005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f46004079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559aa5c29790 con 0x559aa5dd2450 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51764/0 (socket says 172.21.15.117:51764) 2024-09-10T06:22:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.889+0000 7f45fdf0d640 1 -- 172.21.15.117:0/3719432498 learned_addr learned my addr 172.21.15.117:0/3719432498 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 -- 172.21.15.117:0/3719432498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5dd2e40 con 0x559aa5dd2450 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/3719432498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45e8016640 tx=0x7f45e800deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f831c9b8b8a1cb33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44e17fa640 1 -- 172.21.15.117:0/3719432498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e801c0e0 con 0x559aa5dd2450 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44e17fa640 1 -- 172.21.15.117:0/3719432498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e804d400 con 0x559aa5dd2450 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44e17fa640 1 -- 172.21.15.117:0/3719432498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e80400d0 con 0x559aa5dd2450 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/3719432498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 msgr2=0x559aa5dd2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 --2- 172.21.15.117:0/3719432498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f45e8016640 tx=0x7f45e800deb0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/3719432498 shutdown_connections 2024-09-10T06:22:54.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 --2- 172.21.15.117:0/3719432498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd2850 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/3719432498 >> 172.21.15.117:0/3719432498 conn(0x559aa5dcd870 msgr2=0x559aa5dcbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/3719432498 shutdown_connections 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/3719432498 wait complete. 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 Processor -- start 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- start start 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559aa5dd1220 con 0x559aa5dd2450 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51770/0 (socket says 172.21.15.117:51770) 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 learned_addr learned my addr 172.21.15.117:0/1804023731 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa5dd8cd0 con 0x559aa5dd2450 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45e80247c0 tx=0x7f45e8044f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44cf7fe640 1 -- 172.21.15.117:0/1804023731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e806d070 con 0x559aa5dd2450 2024-09-10T06:22:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa5dd8cd0 con 0x559aa5dd2450 2024-09-10T06:22:54.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44cf7fe640 1 -- 172.21.15.117:0/1804023731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e804d400 con 0x559aa5dd2450 2024-09-10T06:22:54.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f44cf7fe640 1 -- 172.21.15.117:0/1804023731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e8017430 con 0x559aa5dd2450 2024-09-10T06:22:54.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.893+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa5dd8cd0 con 0x559aa5dd2450 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f44cf7fe640 1 -- 172.21.15.117:0/1804023731 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f45e8009070 con 0x559aa5dd2450 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f44cf7fe640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44c8039a20 0x7f44c803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f44cf7fe640 1 -- 172.21.15.117:0/1804023731 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f45e8072aa0 con 0x559aa5dd2450 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44c8039a20 0x7f44c803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5de3800 0x559aa5de5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de63e0 con 0x559aa5de3800 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5de3800 0x559aa5de5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44c8039a20 0x7f44c803bee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559aa5db77b0 tx=0x7f45f00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5de3800 0x559aa5de5c90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5de3800 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 realm 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de67f0 con 0x559aa5de3800 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5de3800 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de70c0 con 0x559aa5de3800 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5de3800 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5de3800 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5de7f90 0x559aa5dea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deaac0 con 0x559aa5de7f90 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5de7f90 0x559aa5dea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5de7f90 0x559aa5dea380 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 20 searching for the correct realm 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5deca60 0x559aa5deef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5def5d0 con 0x559aa5deca60 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5deca60 0x559aa5deef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5deca60 0x559aa5deef00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.897+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5def5d0 con 0x559aa5de7f90 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fdf0d640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f45e8017050 0x7f45e8036a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5def5d0 con 0x7f45e8017050 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f45e8017050 0x7f45e8036a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:54.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f45e8017050 0x7f45e8036a90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:54.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083f0 con 0x7f45e8017050 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f80083f0 con 0x559aa5de3800 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.901+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de7f90 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de7f90 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.905+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de7f90 2024-09-10T06:22:54.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de7f90 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5deca60 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x7f45e8017050 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.909+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de3800 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5de7460 con 0x559aa5de7f90 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:54.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb380 con 0x559aa5de3800 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb770 con 0x559aa5de3800 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:54.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb770 con 0x559aa5deca60 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 zone default found 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 4 Realm: () 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 zonegroup default 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5defa50 con 0x7f45e8017050 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df1440 con 0x559aa5deca60 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df17e0 con 0x559aa5deca60 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 started sync module instance, tier type = 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df08e0 con 0x559aa5de7f90 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122696182992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.913+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df26a0 con 0x559aa5de3800 2024-09-10T06:22:54.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122696182992] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122696188400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df2610 con 0x559aa5de3800 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df3450 con 0x559aa5deca60 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122696191808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df3cf0 con 0x559aa5deca60 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.917+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df4710 con 0x559aa5de7f90 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122696188400] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122696196608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df4b00 con 0x559aa5de7f90 2024-09-10T06:22:54.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df54c0 con 0x559aa5de3800 2024-09-10T06:22:54.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122696191808] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.921+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122696196608] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.925+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.925+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122696190608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df5010 con 0x559aa5de3800 2024-09-10T06:22:54.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.925+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df5d60 con 0x7f45e8017050 2024-09-10T06:22:54.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.925+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122696190608] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.929+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.929+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122696194112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df5010 con 0x7f45e8017050 2024-09-10T06:22:54.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.929+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df61d0 con 0x7f45e8017050 2024-09-10T06:22:54.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.933+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.933+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122696203424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df6640 con 0x7f45e8017050 2024-09-10T06:22:54.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.933+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df7130 con 0x7f45e8017050 2024-09-10T06:22:54.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122696194112] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122696203424] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122696207360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df6190 con 0x7f45e8017050 2024-09-10T06:22:54.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=0 2024-09-10T06:22:54.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=1 2024-09-10T06:22:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=2 2024-09-10T06:22:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=3 2024-09-10T06:22:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=4 2024-09-10T06:22:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=5 2024-09-10T06:22:54.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.937+0000 7f46004079c0 20 add_watcher() i=6 2024-09-10T06:22:54.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122696207360] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 20 add_watcher() i=7 2024-09-10T06:22:54.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:54.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559aa5dfa230 con 0x559aa5de3800 2024-09-10T06:22:54.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122696201680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df76b0 con 0x559aa5de3800 2024-09-10T06:22:54.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122696201680] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f44af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.941+0000 7f46004079c0 5 note: GC not initialized 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f44ae7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f46004079c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f46004079c0 20 Filter name: none 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f441ffff640 20 reqs_thread_entry: start 2024-09-10T06:22:54.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1cce0 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1cce0 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1cce0 con 0x559aa5de3800 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb380 con 0x559aa5de3800 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb380 con 0x559aa5de7f90 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.945+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.949+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=127b] v30'2 uv2 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.953+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x7f45e8017050 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de3800 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5deca60 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df0540 con 0x559aa5de7f90 2024-09-10T06:22:54.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f46004079c0 20 RGWRados::pool_iterate: got myfoo 2024-09-10T06:22:54.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f46004079c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:54.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f44af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:54.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122696201680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5deb380 con 0x559aa5de3800 2024-09-10T06:22:54.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94122696201680] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.957+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122696182992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1aed0 con 0x559aa5de7f90 2024-09-10T06:22:54.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94122696182992] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f46004079c0 20 remove_watcher() i=0 2024-09-10T06:22:54.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f46004079c0 2 removed watcher, disabling cache 2024-09-10T06:22:54.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122696188400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1aed0 con 0x559aa5de3800 2024-09-10T06:22:54.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94122696188400] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f46004079c0 20 remove_watcher() i=1 2024-09-10T06:22:54.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.961+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122696191808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df21f0 con 0x559aa5deca60 2024-09-10T06:22:54.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f45fd70c640 1 -- 172.21.15.117:0/1804023731 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94122696191808] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f00c9070 con 0x559aa5deca60 2024-09-10T06:22:54.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 20 remove_watcher() i=2 2024-09-10T06:22:54.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122696196608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1aed0 con 0x559aa5de7f90 2024-09-10T06:22:54.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f45fdf0d640 1 -- 172.21.15.117:0/1804023731 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94122696196608] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45e8066070 con 0x559aa5de7f90 2024-09-10T06:22:54.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 20 remove_watcher() i=3 2024-09-10T06:22:54.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122696190608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df2f40 con 0x559aa5de3800 2024-09-10T06:22:54.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94122696190608] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x559aa5de3800 2024-09-10T06:22:54.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 20 remove_watcher() i=4 2024-09-10T06:22:54.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.965+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122696194112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5e1aed0 con 0x7f45e8017050 2024-09-10T06:22:54.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.969+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94122696194112] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.969+0000 7f46004079c0 20 remove_watcher() i=5 2024-09-10T06:22:54.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.969+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122696203424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df2f40 con 0x7f45e8017050 2024-09-10T06:22:54.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.973+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94122696203424] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.973+0000 7f46004079c0 20 remove_watcher() i=6 2024-09-10T06:22:54.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.973+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122696207360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559aa5df3840 con 0x7f45e8017050 2024-09-10T06:22:54.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94122696207360] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45f8026040 con 0x7f45e8017050 2024-09-10T06:22:54.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 20 remove_watcher() i=7 2024-09-10T06:22:54.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f45e8017050 msgr2=0x7f45e8036a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f45e8017050 0x7f45e8036a90 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5de3800 msgr2=0x559aa5de5c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5de3800 0x559aa5de5c90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5de7f90 msgr2=0x559aa5dea380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5de7f90 0x559aa5dea380 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5deca60 msgr2=0x559aa5deef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5deca60 0x559aa5deef00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44c8039a20 msgr2=0x7f44c803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44c8039a20 0x7f44c803bee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559aa5db77b0 tx=0x7f45f00a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 msgr2=0x559aa5dd8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f45fe70e640 1 -- 172.21.15.117:0/1804023731 reap_dead start 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45e80247c0 tx=0x7f45e8044f20 comp rx=0 tx=0).stop 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 shutdown_connections 2024-09-10T06:22:54.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/1804023731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dd2450 0x559aa5dd8770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 >> 172.21.15.117:0/1804023731 conn(0x559aa5dcd870 msgr2=0x559aa5dcba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 shutdown_connections 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/1804023731 wait complete. 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 msgr2=0x7f44d803c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 0x7f44d803c080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45f0018c90 tx=0x7f45f0005d90 comp rx=0 tx=0).stop 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 msgr2=0x559aa5dc5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f45e804ec60 tx=0x7f45e802d7c0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 shutdown_connections 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44d8039bc0 0x7f44d803c080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/124958305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5dc4e70 0x559aa5dc5290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 >> 172.21.15.117:0/124958305 conn(0x559aa5dba820 msgr2=0x559aa5dbac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 shutdown_connections 2024-09-10T06:22:54.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/124958305 wait complete. 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5cb66a0 msgr2=0x559aa5dae1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x559aa5cb66a0 0x559aa5dae1e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5db0930 msgr2=0x559aa5db2d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559aa5db0930 0x559aa5db2d20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5db4830 msgr2=0x559aa5db6c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559aa5db4830 0x559aa5db6c20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44e4039a70 msgr2=0x7f44e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f44e4039a70 0x7f44e403bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ac000 tx=0x7f45f00a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 msgr2=0x559aa5da7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 --2- 172.21.15.117:0/963462741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559aa5cb2500 0x559aa5da7160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x559aa5c28b40 tx=0x7f45e8000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f45fe70e640 1 -- 172.21.15.117:0/963462741 reap_dead start 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 shutdown_connections 2024-09-10T06:22:54.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 >> 172.21.15.117:0/963462741 conn(0x559aa5cae020 msgr2=0x559aa5c27c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:54.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 shutdown_connections 2024-09-10T06:22:54.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:54.977+0000 7f46004079c0 1 -- 172.21.15.117:0/963462741 wait complete. 2024-09-10T06:22:54.991 INFO:teuthology.orchestra.run.smithi117.stdout:["myfoo"] 2024-09-10T06:22:54.991 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T06:22:55.008 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.025 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.044 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.089 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-10T06:22:55.159 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.232 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.310 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:55.310 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:55.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:55.310 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T06:22:55.348 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:55.348 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.345+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.345+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.345+0000 7fb0df7889c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5606d47f16c0 0x5606d48834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.345+0000 7fb0df7889c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606d472a9c0 con 0x5606d47ed4d0 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.345+0000 7fb0df7889c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5606d477a6d0 con 0x5606d47f16c0 2024-09-10T06:22:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dca8d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5606d47f16c0 0x5606d48834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dd28e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5606d47ed4d0 0x5606d47ed8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52430/0 (socket says 172.21.15.117:52430) 2024-09-10T06:22:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dd28e640 1 -- 172.21.15.117:0/975684367 learned_addr learned my addr 172.21.15.117:0/975684367 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dca8d640 1 -- 172.21.15.117:0/975684367 >> v1:172.21.15.84:6789/0 conn(0x5606d47ed4d0 legacy=0x5606d47ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dca8d640 1 -- 172.21.15.117:0/975684367 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d471eca0 con 0x5606d47f16c0 2024-09-10T06:22:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0cffff640 1 -- 172.21.15.117:0/975684367 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441426978 0 0) 0x5606d472a9c0 con 0x5606d47ed4d0 2024-09-10T06:22:55.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/975684367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47f16c0 0x5606d48834a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400a480 tx=0x7fb0d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a87256a93381636 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0cffff640 1 -- 172.21.15.117:0/975684367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d40af070 con 0x5606d47f16c0 2024-09-10T06:22:55.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0cffff640 1 -- 172.21.15.117:0/975684367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d40aa530 con 0x5606d47f16c0 2024-09-10T06:22:55.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.349+0000 7fb0cffff640 1 -- 172.21.15.117:0/975684367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d40aa830 con 0x5606d47f16c0 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 -- 172.21.15.117:0/975684367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47f16c0 msgr2=0x5606d48834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/975684367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47f16c0 0x5606d48834a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400a480 tx=0x7fb0d401b280 comp rx=0 tx=0).stop 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 -- 172.21.15.117:0/975684367 shutdown_connections 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/975684367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47f16c0 0x5606d48834a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 -- 172.21.15.117:0/975684367 >> 172.21.15.117:0/975684367 conn(0x5606d47ec010 msgr2=0x5606d47ec420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 -- 172.21.15.117:0/975684367 shutdown_connections 2024-09-10T06:22:55.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.353+0000 7fb0df7889c0 1 -- 172.21.15.117:0/975684367 wait complete. 2024-09-10T06:22:55.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.365+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.365+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.365+0000 7fb0df7889c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.365+0000 7fb0df7889c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5606d477e680 con 0x5606d47ed4d0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51800/0 (socket says 172.21.15.117:51800) 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 -- 172.21.15.117:0/378029077 learned_addr learned my addr 172.21.15.117:0/378029077 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 -- 172.21.15.117:0/378029077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d46f9da0 con 0x5606d47ed4d0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/378029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8006fb0 tx=0x7fb0d8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c408ac4e1ab1121e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fafcb606640 1 -- 172.21.15.117:0/378029077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8003460 con 0x5606d47ed4d0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fafcb606640 1 -- 172.21.15.117:0/378029077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8003600 con 0x5606d47ed4d0 2024-09-10T06:22:55.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fafcb606640 1 -- 172.21.15.117:0/378029077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8003920 con 0x5606d47ed4d0 2024-09-10T06:22:55.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- 172.21.15.117:0/378029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 msgr2=0x5606d4967f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/378029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8006fb0 tx=0x7fb0d8001b10 comp rx=0 tx=0).stop 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- 172.21.15.117:0/378029077 shutdown_connections 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/378029077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d4967f00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- 172.21.15.117:0/378029077 >> 172.21.15.117:0/378029077 conn(0x5606d47ec010 msgr2=0x5606d4963ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- 172.21.15.117:0/378029077 shutdown_connections 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- 172.21.15.117:0/378029077 wait complete. 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d496f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0df7889c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5606d4720a50 con 0x5606d47ed4d0 2024-09-10T06:22:55.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d496f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d496f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51810/0 (socket says 172.21.15.117:51810) 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.369+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3656749845 learned_addr learned my addr 172.21.15.117:0/3656749845 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d496fb70 con 0x5606d47ed4d0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d496f610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8002060 tx=0x7fb0d8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 -- 172.21.15.117:0/3656749845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8025070 con 0x5606d47ed4d0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 -- 172.21.15.117:0/3656749845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8019040 con 0x5606d47ed4d0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606d496fe00 con 0x5606d47ed4d0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 -- 172.21.15.117:0/3656749845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d80136c0 con 0x5606d47ed4d0 2024-09-10T06:22:55.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d49707b0 con 0x5606d47ed4d0 2024-09-10T06:22:55.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 -- 172.21.15.117:0/3656749845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0d8010070 con 0x5606d47ed4d0 2024-09-10T06:22:55.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafc4039ac0 0x7fafc403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fafc9e03640 1 -- 172.21.15.117:0/3656749845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0d804f670 con 0x5606d47ed4d0 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafc4039ac0 0x7fafc403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d47f16c0 0x5606d4976780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d4976cc0 con 0x5606d47f16c0 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d47f16c0 0x5606d4976780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafc4039ac0 0x7fafc403bf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400a480 tx=0x7fb0d40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d47f16c0 0x5606d4976780 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3656749845 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d47f16c0 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.373+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d4977110 con 0x5606d47f16c0 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3656749845 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d47f16c0 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d4978f20 0x5606d497b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d497ba00 con 0x5606d4978f20 2024-09-10T06:22:55.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d4978f20 0x5606d497b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d4978f20 0x5606d497b310 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3656749845 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0d800f030 con 0x5606d4978f20 2024-09-10T06:22:55.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d4977dc0 con 0x5606d47f16c0 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3656749845 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d47f16c0 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d497ce60 0x5606d497f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d497f990 con 0x5606d497ce60 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d497ce60 0x5606d497f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d497ce60 0x5606d497f250 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3656749845 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0d40b2040 con 0x5606d497ce60 2024-09-10T06:22:55.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0df7889c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5606d478b450 con 0x5606d498d490 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51816/0 (socket says 172.21.15.117:51816) 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 -- 172.21.15.117:0/1074505536 learned_addr learned my addr 172.21.15.117:0/1074505536 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.377+0000 7fb0dd28e640 1 -- 172.21.15.117:0/1074505536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d498def0 con 0x5606d498d490 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb0d803d010 tx=0x7fb0d8010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 -- 172.21.15.117:0/1074505536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d803f040 con 0x5606d498d490 2024-09-10T06:22:55.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 -- 172.21.15.117:0/1074505536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8010810 con 0x5606d498d490 2024-09-10T06:22:55.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606d498e750 con 0x5606d498d490 2024-09-10T06:22:55.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 -- 172.21.15.117:0/1074505536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8013a40 con 0x5606d498d490 2024-09-10T06:22:55.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d498ecc0 con 0x5606d498d490 2024-09-10T06:22:55.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 -- 172.21.15.117:0/1074505536 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0d804a050 con 0x5606d498d490 2024-09-10T06:22:55.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 0x7fafb403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fafc2ffd640 1 -- 172.21.15.117:0/1074505536 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0d803ba30 con 0x5606d498d490 2024-09-10T06:22:55.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 0x7fafb403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 0x7fafb403bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5606d4970ad0 tx=0x7fb0d4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0df7889c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5606d4968730 con 0x5606d499aba0 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51820/0 (socket says 172.21.15.117:51820) 2024-09-10T06:22:55.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 -- 172.21.15.117:0/849430818 learned_addr learned my addr 172.21.15.117:0/849430818 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 -- 172.21.15.117:0/849430818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d499b570 con 0x5606d499aba0 2024-09-10T06:22:55.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.381+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/849430818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb0d801fe20 tx=0x7fb0d801fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234b6936caa3f4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafc0ff9640 1 -- 172.21.15.117:0/849430818 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d805f070 con 0x5606d499aba0 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafc0ff9640 1 -- 172.21.15.117:0/849430818 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d801fa00 con 0x5606d499aba0 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafc0ff9640 1 -- 172.21.15.117:0/849430818 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d8040250 con 0x5606d499aba0 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/849430818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 msgr2=0x5606d499af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/849430818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb0d801fe20 tx=0x7fb0d801fc60 comp rx=0 tx=0).stop 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/849430818 shutdown_connections 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/849430818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d499af80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/849430818 >> 172.21.15.117:0/849430818 conn(0x5606d4995f60 msgr2=0x5606d49941a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/849430818 shutdown_connections 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/849430818 wait complete. 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 Processor -- start 2024-09-10T06:22:55.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- start start 2024-09-10T06:22:55.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5606d4999910 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0dd28e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51824/0 (socket says 172.21.15.117:51824) 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 learned_addr learned my addr 172.21.15.117:0/3399897836 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606d49a1390 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0d804ca90 tx=0x7fb0d8047ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafb2ffd640 1 -- 172.21.15.117:0/3399897836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d805f030 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606d49a1390 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606d49a1390 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafb2ffd640 1 -- 172.21.15.117:0/3399897836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d801fa00 con 0x5606d499aba0 2024-09-10T06:22:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.385+0000 7fafb2ffd640 1 -- 172.21.15.117:0/3399897836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d80123c0 con 0x5606d499aba0 2024-09-10T06:22:55.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fafb2ffd640 1 -- 172.21.15.117:0/3399897836 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0d806d020 con 0x5606d499aba0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fafb2ffd640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafa8039a70 0x7fafa803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fafb2ffd640 1 -- 172.21.15.117:0/3399897836 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb0d806b020 con 0x5606d499aba0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafa8039a70 0x7fafa803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d49abe70 0x5606d49ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49aea50 con 0x5606d49abe70 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d49abe70 0x5606d49ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafa8039a70 0x7fafa803bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4000c10 tx=0x7fb0d40b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d49abe70 0x5606d49ae300 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d49abe70 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 realm 2024-09-10T06:22:55.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49aee60 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49af730 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d49abe70 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d49b0600 0x5606d49b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b3130 con 0x5606d49b0600 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d49b0600 0x5606d49b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d49b0600 0x5606d49b29f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 20 searching for the correct realm 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d49b50d0 0x5606d49b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b7c10 con 0x5606d49b50d0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.389+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d49b50d0 0x5606d49b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dca8d640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d49b50d0 0x5606d49b7540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b7c10 con 0x5606d49b0600 2024-09-10T06:22:55.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dd28e640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb0d8040410 0x7fb0d8066650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b7c10 con 0x7fb0d8040410 2024-09-10T06:22:55.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb0d8040410 0x7fb0d8066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb0d8040410 0x7fb0d8066650 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d00083f0 con 0x7fb0d8040410 2024-09-10T06:22:55.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d00083f0 con 0x5606d49abe70 2024-09-10T06:22:55.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.393+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b0600 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b0600 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.397+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b0600 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.401+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b0600 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b50d0 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x7fb0d8040410 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49abe70 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5606d49afad0 con 0x5606d49b0600 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:55.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b39f0 con 0x5606d49abe70 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b3de0 con 0x5606d49abe70 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b3de0 con 0x5606d49b50d0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 zone default found 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 4 Realm: () 2024-09-10T06:22:55.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 zonegroup default 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.405+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b8090 con 0x7fb0d8040410 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b9a80 con 0x5606d49b50d0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b9e20 con 0x5606d49b50d0 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 started sync module instance, tier type = 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49b8f20 con 0x5606d49b0600 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587336758080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49ba6c0 con 0x5606d49b0600 2024-09-10T06:22:55.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49baf10 con 0x5606d49abe70 2024-09-10T06:22:55.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.409+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587336758080] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.413+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.413+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587336761872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49baae0 con 0x5606d49abe70 2024-09-10T06:22:55.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.413+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bb5e0 con 0x5606d49b50d0 2024-09-10T06:22:55.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.413+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587336761872] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587336762928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49baa50 con 0x5606d49b50d0 2024-09-10T06:22:55.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bc350 con 0x5606d49b0600 2024-09-10T06:22:55.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587336769152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bcbf0 con 0x5606d49b0600 2024-09-10T06:22:55.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.417+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bd5b0 con 0x5606d49abe70 2024-09-10T06:22:55.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.421+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587336762928] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.421+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587336769152] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.421+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.421+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587336773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bcbf0 con 0x5606d49abe70 2024-09-10T06:22:55.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.421+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bd520 con 0x7fb0d8040410 2024-09-10T06:22:55.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.425+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587336773888] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.425+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.425+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587336771392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bcb60 con 0x7fb0d8040410 2024-09-10T06:22:55.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.425+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49be3e0 con 0x7fb0d8040410 2024-09-10T06:22:55.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.425+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587336771392] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587336775952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49be3e0 con 0x7fb0d8040410 2024-09-10T06:22:55.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49beda0 con 0x7fb0d8040410 2024-09-10T06:22:55.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587336775952] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587336778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49beda0 con 0x7fb0d8040410 2024-09-10T06:22:55.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=0 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=1 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=2 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=3 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=4 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=5 2024-09-10T06:22:55.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.429+0000 7fb0df7889c0 20 add_watcher() i=6 2024-09-10T06:22:55.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587336778000] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 add_watcher() i=7 2024-09-10T06:22:55.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:55.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c21d0 con 0x5606d49abe70 2024-09-10T06:22:55.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587336780480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49bf6f0 con 0x5606d49abe70 2024-09-10T06:22:55.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587336780480] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7faf93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 5 note: GC not initialized 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7faf92fe5640 20 reqs_thread_entry: start 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 Filter name: none 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7faf90fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49e5890 con 0x5606d49b0600 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.433+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49e6120 con 0x5606d49abe70 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(63 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:55.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49e4b40 con 0x5606d49b0600 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49e7730 con 0x5606d49abe70 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 4.23 4:c456ee1c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49e7160 con 0x7fb0d8040410 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 4.4 4:210bc693:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49ec050 con 0x7fb0d8040410 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 4.37 4:ed00a776:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49ee8c0 con 0x7fb0d8040410 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 4.2d 4:b41aa053:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49f1130 con 0x7fb0d8040410 2024-09-10T06:22:55.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 4.2b 4:d64dd120:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49f39a0 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 4.35 4:ac74c6ce:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49f6250 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49f8c60 con 0x7fb0d8040410 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 4.37 4:ed2df8df:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49fb630 con 0x7fb0d8040410 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 4.34 4:2c42ad31:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d49fe0a0 con 0x5606d49b0600 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 4.25 4:a75a5a58:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d4a00a90 con 0x5606d49b50d0 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 4.35 4:ac804643:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5606d4a03770 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(70 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(71 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(74 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(75 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(66 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(68 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(67 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(69 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(73 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.437+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(72 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7faf93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587336780480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49abe70 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94587336780480] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587336758080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49b0600 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94587336758080] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0df7889c0 20 remove_watcher() i=0 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0df7889c0 2 removed watcher, disabling cache 2024-09-10T06:22:55.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.441+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587336761872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49abe70 2024-09-10T06:22:55.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94587336761872] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0df7889c0 20 remove_watcher() i=1 2024-09-10T06:22:55.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587336762928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49b50d0 2024-09-10T06:22:55.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0dca8d640 1 -- 172.21.15.117:0/3399897836 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94587336762928] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d40c7030 con 0x5606d49b50d0 2024-09-10T06:22:55.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0df7889c0 20 remove_watcher() i=2 2024-09-10T06:22:55.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.445+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587336769152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49b0600 2024-09-10T06:22:55.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0dd28e640 1 -- 172.21.15.117:0/3399897836 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94587336769152] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d8058070 con 0x5606d49b0600 2024-09-10T06:22:55.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0df7889c0 20 remove_watcher() i=3 2024-09-10T06:22:55.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587336773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x5606d49abe70 2024-09-10T06:22:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94587336773888] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x5606d49abe70 2024-09-10T06:22:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0df7889c0 20 remove_watcher() i=4 2024-09-10T06:22:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.449+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587336771392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x7fb0d8040410 2024-09-10T06:22:55.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94587336771392] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0df7889c0 20 remove_watcher() i=5 2024-09-10T06:22:55.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587336775952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x7fb0d8040410 2024-09-10T06:22:55.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94587336775952] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0df7889c0 20 remove_watcher() i=6 2024-09-10T06:22:55.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.453+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587336778000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5606d49c1720 con 0x7fb0d8040410 2024-09-10T06:22:55.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94587336778000] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0d0026040 con 0x7fb0d8040410 2024-09-10T06:22:55.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 20 remove_watcher() i=7 2024-09-10T06:22:55.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb0d8040410 msgr2=0x7fb0d8066650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb0d8040410 0x7fb0d8066650 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d49abe70 msgr2=0x5606d49ae300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d49abe70 0x5606d49ae300 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d49b0600 msgr2=0x5606d49b29f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d49b0600 0x5606d49b29f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d49b50d0 msgr2=0x5606d49b7540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d49b50d0 0x5606d49b7540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafa8039a70 msgr2=0x7fafa803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafa8039a70 0x7fafa803bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4000c10 tx=0x7fb0d40b8040 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 msgr2=0x5606d49a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0d804ca90 tx=0x7fb0d8047ea0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3399897836 reap_dead start 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 shutdown_connections 2024-09-10T06:22:55.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3399897836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d499aba0 0x5606d49a0e30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 >> 172.21.15.117:0/3399897836 conn(0x5606d4995f60 msgr2=0x5606d4994170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 shutdown_connections 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3399897836 wait complete. 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 msgr2=0x7fafb403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 0x7fafb403bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5606d4970ad0 tx=0x7fb0d4005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 msgr2=0x5606d498d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb0d803d010 tx=0x7fb0d8010ef0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 shutdown_connections 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafb4039a70 0x7fafb403bf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/1074505536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d498d490 0x5606d498d8b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 >> 172.21.15.117:0/1074505536 conn(0x5606d4982e40 msgr2=0x5606d4983220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 shutdown_connections 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/1074505536 wait complete. 2024-09-10T06:22:55.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d47f16c0 msgr2=0x5606d4976780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5606d47f16c0 0x5606d4976780 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d4978f20 msgr2=0x5606d497b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5606d4978f20 0x5606d497b310 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d497ce60 msgr2=0x5606d497f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5606d497ce60 0x5606d497f250 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafc4039ac0 msgr2=0x7fafc403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fafc4039ac0 0x7fafc403bf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400a480 tx=0x7fb0d40a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 msgr2=0x5606d496f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 --2- 172.21.15.117:0/3656749845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606d47ed4d0 0x5606d496f610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8002060 tx=0x7fb0d8001260 comp rx=0 tx=0).stop 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0dda8f640 1 -- 172.21.15.117:0/3656749845 reap_dead start 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 shutdown_connections 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 >> 172.21.15.117:0/3656749845 conn(0x5606d47ec010 msgr2=0x5606d4962630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 shutdown_connections 2024-09-10T06:22:55.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.457+0000 7fb0df7889c0 1 -- 172.21.15.117:0/3656749845 wait complete. 2024-09-10T06:22:55.470 INFO:teuthology.orchestra.run.smithi117.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1f11ec0c-dab3-4c88-849a-c22a32f07424","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T06:22:54.618518Z","creation_time":"2024-09-10T06:22:54.613572Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T06:22:55.471 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:22:54.618518Z', 'creation_time': '2024-09-10T06:22:54.613572Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T06:22:55.471 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T06:22:55.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T06:22:55.471 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T06:22:55.547 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:55.548 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d9bb19c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d6ff969770 0x55d6ff9fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d9bb19c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6ff8a99c0 con 0x55d6ff969b50 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d9bb19c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55d6ff8f96d0 con 0x55d6ff969770 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d76b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d6ff969770 0x55d6ff9fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d6eb6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55d6ff969b50 0x55d6ff9fcaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52442/0 (socket says 172.21.15.117:52442) 2024-09-10T06:22:55.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.545+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1241619771 learned_addr learned my addr 172.21.15.117:0/1241619771 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:55.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.549+0000 7f33d76b7640 1 -- 172.21.15.117:0/1241619771 >> v1:172.21.15.84:6789/0 conn(0x55d6ff969b50 legacy=0x55d6ff9fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.549+0000 7f33d76b7640 1 -- 172.21.15.117:0/1241619771 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ff89dca0 con 0x55d6ff969770 2024-09-10T06:22:55.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.549+0000 7f33d76b7640 1 --2- 172.21.15.117:0/1241619771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969770 0x55d6ff9fa5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f33c800a480 tx=0x7f33c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c4453788281ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.549+0000 7f33d66b5640 1 -- 172.21.15.117:0/1241619771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80b0070 con 0x55d6ff969770 2024-09-10T06:22:55.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d66b5640 1 -- 172.21.15.117:0/1241619771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80ab540 con 0x55d6ff969770 2024-09-10T06:22:55.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d66b5640 1 -- 172.21.15.117:0/1241619771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80ab840 con 0x55d6ff969770 2024-09-10T06:22:55.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1241619771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969770 msgr2=0x55d6ff9fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1241619771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969770 0x55d6ff9fa5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f33c800a480 tx=0x7f33c801b280 comp rx=0 tx=0).stop 2024-09-10T06:22:55.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1241619771 shutdown_connections 2024-09-10T06:22:55.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1241619771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969770 0x55d6ff9fa5a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1241619771 >> 172.21.15.117:0/1241619771 conn(0x55d6ff9efe90 msgr2=0x55d6ff9f22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1241619771 shutdown_connections 2024-09-10T06:22:55.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.553+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1241619771 wait complete. 2024-09-10T06:22:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6ff8fd680 con 0x55d6ff969b50 2024-09-10T06:22:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51844/0 (socket says 172.21.15.117:51844) 2024-09-10T06:22:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d76b7640 1 -- 172.21.15.117:0/761439834 learned_addr learned my addr 172.21.15.117:0/761439834 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d76b7640 1 -- 172.21.15.117:0/761439834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ff878da0 con 0x55d6ff969b50 2024-09-10T06:22:55.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d76b7640 1 --2- 172.21.15.117:0/761439834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33c801b2c0 tx=0x7f33c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d448bccf95a82cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f32c560a640 1 -- 172.21.15.117:0/761439834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80b0040 con 0x55d6ff969b50 2024-09-10T06:22:55.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f32c560a640 1 -- 172.21.15.117:0/761439834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c800a300 con 0x55d6ff969b50 2024-09-10T06:22:55.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f32c560a640 1 -- 172.21.15.117:0/761439834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80ab860 con 0x55d6ff969b50 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/761439834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 msgr2=0x55d6ffae2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/761439834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33c801b2c0 tx=0x7f33c8003030 comp rx=0 tx=0).stop 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/761439834 shutdown_connections 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/761439834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffae2b80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/761439834 >> 172.21.15.117:0/761439834 conn(0x55d6ff9efe90 msgr2=0x55d6ffade780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/761439834 shutdown_connections 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/761439834 wait complete. 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.569+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffaea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6ff89fa50 con 0x55d6ff969b50 2024-09-10T06:22:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffaea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffaea1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51856/0 (socket says 172.21.15.117:51856) 2024-09-10T06:22:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d76b7640 1 -- 172.21.15.117:0/3367406153 learned_addr learned my addr 172.21.15.117:0/3367406153 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d76b7640 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ffaea720 con 0x55d6ff969b50 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d76b7640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffaea1c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f33c80ab510 tx=0x7f33c8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 -- 172.21.15.117:0/3367406153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80b0040 con 0x55d6ff969b50 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 -- 172.21.15.117:0/3367406153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80c6070 con 0x55d6ff969b50 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6ffaea9b0 con 0x55d6ff969b50 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 -- 172.21.15.117:0/3367406153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80c1700 con 0x55d6ff969b50 2024-09-10T06:22:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ffaeb360 con 0x55d6ff969b50 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 -- 172.21.15.117:0/3367406153 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f33c80c1ab0 con 0x55d6ff969b50 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32bc039a70 0x7f32bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f32c3e07640 1 -- 172.21.15.117:0/3367406153 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f33c80bb070 con 0x55d6ff969b50 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32bc039a70 0x7f32bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffaef320 0x55d6ffaf1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffaf1c50 con 0x55d6ffaef320 2024-09-10T06:22:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.573+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffaef320 0x55d6ffaf1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32bc039a70 0x7f32bc03bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33cc001650 tx=0x7f33cc006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffaef320 0x55d6ffaf1710 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d7eb8640 1 -- 172.21.15.117:0/3367406153 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffaef320 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffaf2030 con 0x55d6ffaef320 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d7eb8640 1 -- 172.21.15.117:0/3367406153 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffaef320 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffaf3e10 0x55d6ffaf6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffaf68d0 con 0x55d6ffaf3e10 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d76b7640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffaf3e10 0x55d6ffaf6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d76b7640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffaf3e10 0x55d6ffaf6200 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d76b7640 1 -- 172.21.15.117:0/3367406153 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffaf3e10 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffaf2cb0 con 0x55d6ffaef320 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d7eb8640 1 -- 172.21.15.117:0/3367406153 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffaef320 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffaf7d30 0x55d6ffafa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffafa890 con 0x55d6ffaf7d30 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffaf7d30 0x55d6ffafa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffaf7d30 0x55d6ffafa120 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d6eb6640 1 -- 172.21.15.117:0/3367406153 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffaf7d30 2024-09-10T06:22:55.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.577+0000 7f33d9bb19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6ff90a450 con 0x55d6ffb08370 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51864/0 (socket says 172.21.15.117:51864) 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 -- 172.21.15.117:0/379419711 learned_addr learned my addr 172.21.15.117:0/379419711 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 -- 172.21.15.117:0/379419711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ffb08dd0 con 0x55d6ffb08370 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f33c8005410 tx=0x7f33c80aaf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 -- 172.21.15.117:0/379419711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80ca850 con 0x55d6ffb08370 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 -- 172.21.15.117:0/379419711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80eb0b0 con 0x55d6ffb08370 2024-09-10T06:22:55.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6ffb09630 con 0x55d6ffb08370 2024-09-10T06:22:55.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 -- 172.21.15.117:0/379419711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80eb3d0 con 0x55d6ffb08370 2024-09-10T06:22:55.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ffb09630 con 0x55d6ffb08370 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 -- 172.21.15.117:0/379419711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f33c80f2060 con 0x55d6ffb08370 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 0x7f32b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f32c1602640 1 -- 172.21.15.117:0/379419711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f33c80a8070 con 0x55d6ffb08370 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 0x7f32b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 0x7f32b003bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0062e0 tx=0x7f33cc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d9bb19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6ffae3310 con 0x55d6ffb15910 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.581+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51876/0 (socket says 172.21.15.117:51876) 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 -- 172.21.15.117:0/904623572 learned_addr learned my addr 172.21.15.117:0/904623572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 -- 172.21.15.117:0/904623572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ffb16300 con 0x55d6ffb15910 2024-09-10T06:22:55.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 --2- 172.21.15.117:0/904623572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33c80075f0 tx=0x7f33c80e2b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4daf17270d7a93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f32baffd640 1 -- 172.21.15.117:0/904623572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80bd870 con 0x55d6ffb15910 2024-09-10T06:22:55.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f32baffd640 1 -- 172.21.15.117:0/904623572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80b01e0 con 0x55d6ffb15910 2024-09-10T06:22:55.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f32baffd640 1 -- 172.21.15.117:0/904623572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80c05d0 con 0x55d6ffb15910 2024-09-10T06:22:55.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/904623572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 msgr2=0x55d6ffb15d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/904623572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33c80075f0 tx=0x7f33c80e2b20 comp rx=0 tx=0).stop 2024-09-10T06:22:55.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/904623572 shutdown_connections 2024-09-10T06:22:55.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/904623572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb15d10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/904623572 >> 172.21.15.117:0/904623572 conn(0x55d6ffb10d30 msgr2=0x55d6ffb0ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/904623572 shutdown_connections 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/904623572 wait complete. 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 Processor -- start 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- start start 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb1bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d9bb19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6ffb146e0 con 0x55d6ffb15910 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb1bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb1bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51890/0 (socket says 172.21.15.117:51890) 2024-09-10T06:22:55.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 learned_addr learned my addr 172.21.15.117:0/1919049871 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6ffb1c100 con 0x55d6ffb15910 2024-09-10T06:22:55.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f33d76b7640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb1bba0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33c80a4640 tx=0x7f33c80eefd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.585+0000 7f32b97fa640 1 -- 172.21.15.117:0/1919049871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80bd2f0 con 0x55d6ffb15910 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6ffb1c100 con 0x55d6ffb15910 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f32b97fa640 1 -- 172.21.15.117:0/1919049871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80b01e0 con 0x55d6ffb15910 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f32b97fa640 1 -- 172.21.15.117:0/1919049871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80bd4d0 con 0x55d6ffb15910 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6ffb1c100 con 0x55d6ffb15910 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f32b97fa640 1 -- 172.21.15.117:0/1919049871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f33c8104040 con 0x55d6ffb15910 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f32b97fa640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32a00399d0 0x7f32a003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f32b97fa640 1 -- 172.21.15.117:0/1919049871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f33c8102020 con 0x55d6ffb15910 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32a00399d0 0x7f32a003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffb26c20 0x55d6ffb290b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb29800 con 0x55d6ffb26c20 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffb26c20 0x55d6ffb290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32a00399d0 0x7f32a003be90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d6ffaf6c70 tx=0x7f33cc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffb26c20 0x55d6ffb290b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 realm 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb29c10 con 0x55d6ffb26c20 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a4e0 con 0x55d6ffb26c20 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffb2b370 0x55d6ffb2d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2dea0 con 0x55d6ffb2b370 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.589+0000 7f33d76b7640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffb2b370 0x55d6ffb2d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d76b7640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffb2b370 0x55d6ffb2d760 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d9bb19c0 20 searching for the correct realm 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffb2fe40 0x55d6ffb322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb329b0 con 0x55d6ffb2fe40 2024-09-10T06:22:55.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffb2fe40 0x55d6ffb322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d6eb6640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffb2fe40 0x55d6ffb322e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb329b0 con 0x55d6ffb2b370 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d76b7640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f33c8107040 0x7f33c80ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb329b0 con 0x7f33c8107040 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f33c8107040 0x7f33c80ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f33c8107040 0x7f33c80ef9d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d00083f0 con 0x7f33c8107040 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d00083f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.593+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2b370 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2b370 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.597+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2b370 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.601+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2b370 2024-09-10T06:22:55.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2fe40 2024-09-10T06:22:55.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x7f33c8107040 2024-09-10T06:22:55.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb26c20 2024-09-10T06:22:55.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2a880 con 0x55d6ffb2b370 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2e760 con 0x55d6ffb26c20 2024-09-10T06:22:55.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.605+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2eb50 con 0x55d6ffb26c20 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb2eb50 con 0x55d6ffb2fe40 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 zone default found 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 4 Realm: () 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:55.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 zonegroup default 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb32e30 con 0x7f33c8107040 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb34820 con 0x55d6ffb2fe40 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb34bc0 con 0x55d6ffb2fe40 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 started sync module instance, tier type = 2024-09-10T06:22:55.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:55.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb33cc0 con 0x55d6ffb2b370 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94381901299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb35460 con 0x55d6ffb2b370 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.609+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb35cb0 con 0x55d6ffb26c20 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.613+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94381901299936] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.613+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.613+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94381901303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb35880 con 0x55d6ffb26c20 2024-09-10T06:22:55.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.613+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb363a0 con 0x55d6ffb2fe40 2024-09-10T06:22:55.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94381901307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb36c40 con 0x55d6ffb2fe40 2024-09-10T06:22:55.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb37640 con 0x55d6ffb2b370 2024-09-10T06:22:55.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94381901303728] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94381901304784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb37a60 con 0x55d6ffb2b370 2024-09-10T06:22:55.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb38420 con 0x55d6ffb26c20 2024-09-10T06:22:55.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94381901307504] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94381901304784] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94381901312336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb37f70 con 0x55d6ffb26c20 2024-09-10T06:22:55.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.617+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb38800 con 0x7f33c8107040 2024-09-10T06:22:55.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.621+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94381901312336] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.621+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.621+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94381901309840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb38420 con 0x7f33c8107040 2024-09-10T06:22:55.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.621+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb39210 con 0x7f33c8107040 2024-09-10T06:22:55.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94381901319520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb39630 con 0x7f33c8107040 2024-09-10T06:22:55.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb3a080 con 0x7f33c8107040 2024-09-10T06:22:55.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94381901309840] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94381901323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb3a040 con 0x7f33c8107040 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94381901319520] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=0 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=1 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=2 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=3 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=4 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=5 2024-09-10T06:22:55.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.625+0000 7f33d9bb19c0 20 add_watcher() i=6 2024-09-10T06:22:55.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94381901323120] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 20 add_watcher() i=7 2024-09-10T06:22:55.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:55.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb3d070 con 0x55d6ffb26c20 2024-09-10T06:22:55.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94381901315952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb3a4f0 con 0x55d6ffb26c20 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94381901315952] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f328dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 5 note: GC not initialized 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f328cfe1640 20 reqs_thread_entry: start 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:55.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.629+0000 7f33d9bb19c0 20 Filter name: none 2024-09-10T06:22:55.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f32067fc640 20 reqs_thread_entry: start 2024-09-10T06:22:55.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb600e0 con 0x55d6ffb26c20 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb60ad0 con 0x55d6ffb26c20 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb61ae0 con 0x55d6ffb2b370 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5f2a0 con 0x55d6ffb2b370 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb61880 con 0x55d6ffb26c20 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 4.23 4:c456ee1c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb60cd0 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 4.4 4:210bc693:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb66410 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 4.37 4:ed00a776:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb66410 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 4.2d 4:b41aa053:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb66410 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 4.2b 4:d64dd120:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb6da10 con 0x55d6ffb26c20 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 4.35 4:ac74c6ce:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb70510 con 0x55d6ffb26c20 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb72f20 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 4.37 4:ed2df8df:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb758f0 con 0x7f33c8107040 2024-09-10T06:22:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:75 4.34 4:2c42ad31:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb78280 con 0x55d6ffb2b370 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:76 4.25 4:a75a5a58:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb7ad60 con 0x55d6ffb2fe40 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 4.35 4:ac804643:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb7dbb0 con 0x55d6ffb26c20 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(71 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(72 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(75 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(76 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(67 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(68 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(77 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(70 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.633+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(69 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(73 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(74 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f328dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94381901315952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb26c20 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94381901315952] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.637+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94381901299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb2b370 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94381901299936] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d9bb19c0 20 remove_watcher() i=0 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d9bb19c0 2 removed watcher, disabling cache 2024-09-10T06:22:55.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94381901303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb26c20 2024-09-10T06:22:55.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94381901303728] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d9bb19c0 20 remove_watcher() i=1 2024-09-10T06:22:55.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.641+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94381901307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb2fe40 2024-09-10T06:22:55.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d6eb6640 1 -- 172.21.15.117:0/1919049871 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94381901307504] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33cc00f070 con 0x55d6ffb2fe40 2024-09-10T06:22:55.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 20 remove_watcher() i=2 2024-09-10T06:22:55.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94381901304784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb2b370 2024-09-10T06:22:55.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d76b7640 1 -- 172.21.15.117:0/1919049871 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94381901304784] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33c80b3040 con 0x55d6ffb2b370 2024-09-10T06:22:55.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 20 remove_watcher() i=3 2024-09-10T06:22:55.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94381901312336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x55d6ffb26c20 2024-09-10T06:22:55.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94381901312336] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x55d6ffb26c20 2024-09-10T06:22:55.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 20 remove_watcher() i=4 2024-09-10T06:22:55.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.645+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94381901309840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x7f33c8107040 2024-09-10T06:22:55.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94381901309840] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d9bb19c0 20 remove_watcher() i=5 2024-09-10T06:22:55.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94381901319520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x7f33c8107040 2024-09-10T06:22:55.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94381901319520] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d9bb19c0 20 remove_watcher() i=6 2024-09-10T06:22:55.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.649+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94381901323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6ffb5dec0 con 0x7f33c8107040 2024-09-10T06:22:55.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94381901323120] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33d0026040 con 0x7f33c8107040 2024-09-10T06:22:55.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 20 remove_watcher() i=7 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f33c8107040 msgr2=0x7f33c80ef9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f33c8107040 0x7f33c80ef9d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffb26c20 msgr2=0x55d6ffb290b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffb26c20 0x55d6ffb290b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffb2b370 msgr2=0x55d6ffb2d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffb2b370 0x55d6ffb2d760 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffb2fe40 msgr2=0x55d6ffb322e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffb2fe40 0x55d6ffb322e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32a00399d0 msgr2=0x7f32a003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32a00399d0 0x7f32a003be90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d6ffaf6c70 tx=0x7f33cc010000 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 msgr2=0x55d6ffb1bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/1919049871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb15910 0x55d6ffb1bba0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33c80a4640 tx=0x7f33c80eefd0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 reap_dead start 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d7eb8640 1 -- 172.21.15.117:0/1919049871 reap_dead start 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 shutdown_connections 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 >> 172.21.15.117:0/1919049871 conn(0x55d6ffb10d30 msgr2=0x55d6ffb0ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 shutdown_connections 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/1919049871 wait complete. 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 msgr2=0x7f32b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 0x7f32b003bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0062e0 tx=0x7f33cc00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 msgr2=0x55d6ffb08790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f33c8005410 tx=0x7f33c80aaf70 comp rx=0 tx=0).stop 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 shutdown_connections 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32b0039a70 0x7f32b003bf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/379419711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ffb08370 0x55d6ffb08790 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 >> 172.21.15.117:0/379419711 conn(0x55d6ffafdd20 msgr2=0x55d6ffafe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 shutdown_connections 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/379419711 wait complete. 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffaef320 msgr2=0x55d6ffaf1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d6ffaef320 0x55d6ffaf1710 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffaf3e10 msgr2=0x55d6ffaf6200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d6ffaf3e10 0x55d6ffaf6200 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffaf7d30 msgr2=0x55d6ffafa120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d6ffaf7d30 0x55d6ffafa120 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32bc039a70 msgr2=0x7f32bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f32bc039a70 0x7f32bc03bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33cc001650 tx=0x7f33cc006720 comp rx=0 tx=0).stop 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 msgr2=0x55d6ffaea1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 --2- 172.21.15.117:0/3367406153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6ff969b50 0x55d6ffaea1c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f33c80ab510 tx=0x7f33c8018020 comp rx=0 tx=0).stop 2024-09-10T06:22:55.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d7eb8640 1 -- 172.21.15.117:0/3367406153 reap_dead start 2024-09-10T06:22:55.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 shutdown_connections 2024-09-10T06:22:55.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 >> 172.21.15.117:0/3367406153 conn(0x55d6ff9efe90 msgr2=0x55d6ffadd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 shutdown_connections 2024-09-10T06:22:55.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.653+0000 7f33d9bb19c0 1 -- 172.21.15.117:0/3367406153 wait complete. 2024-09-10T06:22:55.668 INFO:teuthology.orchestra.run.smithi117.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1f11ec0c-dab3-4c88-849a-c22a32f07424","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T06:22:54.618518Z","creation_time":"2024-09-10T06:22:54.613572Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-10T06:22:55.669 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:22:54.618518Z', 'creation_time': '2024-09-10T06:22:54.613572Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T06:22:55.677 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T06:22:55.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:55.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:55.678 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T06:22:55.741 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:55.741 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:55.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c6ab09c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x561411502880 0x561411504c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c6ab09c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614113b29c0 con 0x5614114727b0 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c6ab09c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5614114026d0 con 0x561411502880 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c3db5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x561411502880 0x561411504c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c45b6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5614114727b0 0x561411501160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52454/0 (socket says 172.21.15.117:52454) 2024-09-10T06:22:55.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c45b6640 1 -- 172.21.15.117:0/3962646166 learned_addr learned my addr 172.21.15.117:0/3962646166 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:55.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c35b4640 1 -- 172.21.15.117:0/3962646166 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617759249 0 0) 0x5614113b29c0 con 0x5614114727b0 2024-09-10T06:22:55.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c35b4640 1 -- 172.21.15.117:0/3962646166 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00ac001e20 con 0x5614114727b0 2024-09-10T06:22:55.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c3db5640 1 -- 172.21.15.117:0/3962646166 >> v1:172.21.15.84:6789/0 conn(0x5614114727b0 legacy=0x561411501160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.741+0000 7f00c3db5640 1 -- 172.21.15.117:0/3962646166 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614113a6ca0 con 0x561411502880 2024-09-10T06:22:55.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c3db5640 1 --2- 172.21.15.117:0/3962646166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411502880 0x561411504c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f00b800a480 tx=0x7f00b801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e667789d8ca53480 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c35b4640 1 -- 172.21.15.117:0/3962646166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b80af070 con 0x561411502880 2024-09-10T06:22:55.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c35b4640 1 -- 172.21.15.117:0/3962646166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b80aa530 con 0x561411502880 2024-09-10T06:22:55.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c35b4640 1 -- 172.21.15.117:0/3962646166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b80aa830 con 0x561411502880 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3962646166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411502880 msgr2=0x561411504c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3962646166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411502880 0x561411504c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f00b800a480 tx=0x7f00b801b280 comp rx=0 tx=0).stop 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3962646166 shutdown_connections 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3962646166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411502880 0x561411504c70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3962646166 >> 172.21.15.117:0/3962646166 conn(0x5614114f8e90 msgr2=0x5614114fb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3962646166 shutdown_connections 2024-09-10T06:22:55.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.745+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3962646166 wait complete. 2024-09-10T06:22:55.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561411406680 con 0x5614114727b0 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51898/0 (socket says 172.21.15.117:51898) 2024-09-10T06:22:55.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c45b6640 1 -- 172.21.15.117:0/2062659223 learned_addr learned my addr 172.21.15.117:0/2062659223 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c45b6640 1 -- 172.21.15.117:0/2062659223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561411381da0 con 0x5614114727b0 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c45b6640 1 --2- 172.21.15.117:0/2062659223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0016a0 tx=0x7f00bc001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be68200cd282bb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7effb260c640 1 -- 172.21.15.117:0/2062659223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc004530 con 0x5614114727b0 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7effb260c640 1 -- 172.21.15.117:0/2062659223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc0046d0 con 0x5614114727b0 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7effb260c640 1 -- 172.21.15.117:0/2062659223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc0049f0 con 0x5614114727b0 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2062659223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 msgr2=0x5614115e9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/2062659223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0016a0 tx=0x7f00bc001b60 comp rx=0 tx=0).stop 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2062659223 shutdown_connections 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/2062659223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614115e9740 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2062659223 >> 172.21.15.117:0/2062659223 conn(0x5614114f8e90 msgr2=0x5614115e53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2062659223 shutdown_connections 2024-09-10T06:22:55.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.761+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2062659223 wait complete. 2024-09-10T06:22:55.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614114fe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5614113a8a50 con 0x5614114727b0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614114fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614114fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51906/0 (socket says 172.21.15.117:51906) 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c45b6640 1 -- 172.21.15.117:0/991736612 learned_addr learned my addr 172.21.15.117:0/991736612 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c45b6640 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614114feda0 con 0x5614114727b0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c45b6640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614114fe840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001ba0 tx=0x7f00bc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7effb0e09640 1 -- 172.21.15.117:0/991736612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc013760 con 0x5614114727b0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614114fd180 con 0x5614114727b0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7effb0e09640 1 -- 172.21.15.117:0/991736612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc013900 con 0x5614114727b0 2024-09-10T06:22:55.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7effb0e09640 1 -- 172.21.15.117:0/991736612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc013c00 con 0x5614114727b0 2024-09-10T06:22:55.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.765+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614114fd710 con 0x5614114727b0 2024-09-10T06:22:55.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7effb0e09640 1 -- 172.21.15.117:0/991736612 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f00bc010070 con 0x5614114727b0 2024-09-10T06:22:55.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7effb0e09640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7effac039ac0 0x7effac03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7effb0e09640 1 -- 172.21.15.117:0/991736612 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00bc018070 con 0x5614114727b0 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c3db5640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7effac039ac0 0x7effac03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561411502880 0x5614115fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614115fa6e0 con 0x561411502880 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c4db7640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561411502880 0x5614115fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c3db5640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7effac039ac0 0x7effac03bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00b80ac000 tx=0x7f00b80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c4db7640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561411502880 0x5614115fa1a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c4db7640 1 -- 172.21.15.117:0/991736612 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b40083f0 con 0x561411502880 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614114fdb10 con 0x561411502880 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c4db7640 1 -- 172.21.15.117:0/991736612 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b40083f0 con 0x561411502880 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5614115fc950 0x5614115fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614115ff430 con 0x5614115fc950 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c45b6640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5614115fc950 0x5614115fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c45b6640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5614115fc950 0x5614115fed40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c45b6640 1 -- 172.21.15.117:0/991736612 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00bc01b030 con 0x5614115fc950 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614115fb7f0 con 0x561411502880 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c4db7640 1 -- 172.21.15.117:0/991736612 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b40083f0 con 0x561411502880 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411600890 0x561411602c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116033c0 con 0x561411600890 2024-09-10T06:22:55.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c3db5640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411600890 0x561411602c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.769+0000 7f00c3db5640 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411600890 0x561411602c80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c3db5640 1 -- 172.21.15.117:0/991736612 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00b80a8070 con 0x561411600890 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561411413450 con 0x561411610e80 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51912/0 (socket says 172.21.15.117:51912) 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c45b6640 1 -- 172.21.15.117:0/3718711572 learned_addr learned my addr 172.21.15.117:0/3718711572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c45b6640 1 -- 172.21.15.117:0/3718711572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614116118e0 con 0x561411610e80 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c45b6640 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00bc010d00 tx=0x7f00bc043ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 -- 172.21.15.117:0/3718711572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc036020 con 0x561411610e80 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 -- 172.21.15.117:0/3718711572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc041d00 con 0x561411610e80 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561411612140 con 0x561411610e80 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 -- 172.21.15.117:0/3718711572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc028ab0 con 0x561411610e80 2024-09-10T06:22:55.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614116126b0 con 0x561411610e80 2024-09-10T06:22:55.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 -- 172.21.15.117:0/3718711572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f00bc039070 con 0x561411610e80 2024-09-10T06:22:55.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 0x7eff9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7effa9ffb640 1 -- 172.21.15.117:0/3718711572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00bc03caf0 con 0x561411610e80 2024-09-10T06:22:55.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.773+0000 7f00c3db5640 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 0x7eff9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c3db5640 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 0x7eff9c03bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5614115fab20 tx=0x7f00b8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5614115e9f90 con 0x56141161e5e0 2024-09-10T06:22:55.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51926/0 (socket says 172.21.15.117:51926) 2024-09-10T06:22:55.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 -- 172.21.15.117:0/2528401446 learned_addr learned my addr 172.21.15.117:0/2528401446 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 -- 172.21.15.117:0/2528401446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141161ef90 con 0x56141161e5e0 2024-09-10T06:22:55.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 --2- 172.21.15.117:0/2528401446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00bc01dfd0 tx=0x7f00bc0434a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1c09f28332b994 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7effa37fe640 1 -- 172.21.15.117:0/2528401446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc01d480 con 0x56141161e5e0 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7effa37fe640 1 -- 172.21.15.117:0/2528401446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc028c50 con 0x56141161e5e0 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7effa37fe640 1 -- 172.21.15.117:0/2528401446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc01da10 con 0x56141161e5e0 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2528401446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 msgr2=0x56141161e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/2528401446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f00bc01dfd0 tx=0x7f00bc0434a0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2528401446 shutdown_connections 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/2528401446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x56141161e9c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2528401446 >> 172.21.15.117:0/2528401446 conn(0x5614116199a0 msgr2=0x561411617be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2528401446 shutdown_connections 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/2528401446 wait complete. 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 Processor -- start 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- start start 2024-09-10T06:22:55.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c6ab09c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56141161d350 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51932/0 (socket says 172.21.15.117:51932) 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.777+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 learned_addr learned my addr 172.21.15.117:0/1523824273 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561411624db0 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c45b6640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00bc04d780 tx=0x7f00bc008f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 -- 172.21.15.117:0/1523824273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc06a070 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561411624db0 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 -- 172.21.15.117:0/1523824273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc047130 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561411624db0 con 0x56141161e5e0 2024-09-10T06:22:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 -- 172.21.15.117:0/1523824273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00bc047410 con 0x56141161e5e0 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 -- 172.21.15.117:0/1523824273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f00bc06d070 con 0x56141161e5e0 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff94039a70 0x7eff9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7effa1ffb640 1 -- 172.21.15.117:0/1523824273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f00bc070af0 con 0x56141161e5e0 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c3db5640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff94039a70 0x7eff9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56141162f900 0x561411631d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116324e0 con 0x56141162f900 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c4db7640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56141162f900 0x561411631d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c3db5640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff94039a70 0x7eff9403bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00b80aafd0 tx=0x7f00b80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c4db7640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56141162f900 0x561411631d90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b40083f0 con 0x56141162f900 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 realm 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116328f0 con 0x56141162f900 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b40083f0 con 0x56141162f900 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.781+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116331c0 con 0x56141162f900 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b40083f0 con 0x56141162f900 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b40083f0 con 0x56141162f900 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561411634090 0x561411636480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411636bc0 con 0x561411634090 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561411634090 0x561411636480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561411634090 0x561411636480 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 20 searching for the correct realm 2024-09-10T06:22:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411638b60 0x56141163afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56141163b6a0 con 0x561411638b60 2024-09-10T06:22:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c3db5640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411638b60 0x56141163afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c3db5640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411638b60 0x56141163afd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56141163b6a0 con 0x561411634090 2024-09-10T06:22:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f00bc06f060 0x7f00bc050600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56141163b6a0 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c4db7640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f00bc06f060 0x7f00bc050600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.785+0000 7f00c4db7640 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f00bc06f060 0x7f00bc050600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40083f0 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40083f0 con 0x56141162f900 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411634090 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.789+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411634090 2024-09-10T06:22:55.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.793+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411634090 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411634090 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411638b60 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x7f00bc06f060 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x56141162f900 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.797+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561411633560 con 0x561411634090 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411637480 con 0x56141162f900 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411637870 con 0x56141162f900 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411637870 con 0x561411638b60 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 zone default found 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 4 Realm: () 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:55.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 zonegroup default 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141163bb20 con 0x7f00bc06f060 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141163d510 con 0x561411638b60 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141163d8b0 con 0x561411638b60 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 started sync module instance, tier type = 2024-09-10T06:22:55.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:55.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163c9b0 con 0x561411634090 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644191088080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163e100 con 0x561411634090 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.801+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163e950 con 0x56141162f900 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.805+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644191088080] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.805+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.805+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644191091792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163e950 con 0x56141162f900 2024-09-10T06:22:55.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.805+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163f3e0 con 0x561411638b60 2024-09-10T06:22:55.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644191091792] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644191093920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56141163e8c0 con 0x561411638b60 2024-09-10T06:22:55.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411640130 con 0x561411634090 2024-09-10T06:22:55.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644191100336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5614116409d0 con 0x561411634090 2024-09-10T06:22:55.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411641390 con 0x56141162f900 2024-09-10T06:22:55.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644191093920] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.809+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644191100336] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644191104736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5614116409d0 con 0x56141162f900 2024-09-10T06:22:55.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411641300 con 0x7f00bc06f060 2024-09-10T06:22:55.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644191106800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411641300 con 0x7f00bc06f060 2024-09-10T06:22:55.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411642620 con 0x7f00bc06f060 2024-09-10T06:22:55.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.813+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644191104736] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644191102240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5614116425e0 con 0x7f00bc06f060 2024-09-10T06:22:55.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411642fe0 con 0x7f00bc06f060 2024-09-10T06:22:55.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644191106800] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644191102240] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644191107856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411642130 con 0x7f00bc06f060 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=0 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=1 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=2 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=3 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=4 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=5 2024-09-10T06:22:55.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.817+0000 7f00c6ab09c0 20 add_watcher() i=6 2024-09-10T06:22:55.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644191107856] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 20 add_watcher() i=7 2024-09-10T06:22:55.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:55.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116460e0 con 0x56141162f900 2024-09-10T06:22:55.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644191111920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411643560 con 0x56141162f900 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644191111920] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7eff7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 5 note: GC not initialized 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7eff797e2640 20 reqs_thread_entry: start 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.821+0000 7f00c6ab09c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 Filter name: none 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7efeeaffd640 20 reqs_thread_entry: start 2024-09-10T06:22:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411669560 con 0x561411634090 2024-09-10T06:22:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411669df0 con 0x56141162f900 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(63 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411668830 con 0x561411634090 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141166b450 con 0x56141162f900 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 4.23 4:c456ee1c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141166cec0 con 0x7f00bc06f060 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 4.4 4:210bc693:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141166fa60 con 0x7f00bc06f060 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 4.37 4:ed00a776:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411672680 con 0x7f00bc06f060 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 4.2d 4:b41aa053:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411675250 con 0x7f00bc06f060 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 4.2b 4:d64dd120:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411677d10 con 0x56141162f900 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 4.35 4:ac74c6ce:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141167a730 con 0x56141162f900 2024-09-10T06:22:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56141167d5b0 con 0x7f00bc06f060 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 4.37 4:ed2df8df:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116803e0 con 0x7f00bc06f060 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 4.34 4:2c42ad31:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411683250 con 0x561411634090 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 4.25 4:a75a5a58:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561411685da0 con 0x561411638b60 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 4.35 4:ac804643:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5614116803e0 con 0x56141162f900 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(74 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(71 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(75 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(70 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(66 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(68 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(69 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(72 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.825+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(73 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7eff7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644191111920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x56141162f900 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94644191111920] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644191088080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x561411634090 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94644191088080] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c6ab09c0 20 remove_watcher() i=0 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c6ab09c0 2 removed watcher, disabling cache 2024-09-10T06:22:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.829+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644191091792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x56141162f900 2024-09-10T06:22:55.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.833+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94644191091792] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.833+0000 7f00c6ab09c0 20 remove_watcher() i=1 2024-09-10T06:22:55.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.833+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644191093920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x561411638b60 2024-09-10T06:22:55.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c3db5640 1 -- 172.21.15.117:0/1523824273 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94644191093920] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b80d9070 con 0x561411638b60 2024-09-10T06:22:55.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 20 remove_watcher() i=2 2024-09-10T06:22:55.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644191100336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x561411634090 2024-09-10T06:22:55.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c45b6640 1 -- 172.21.15.117:0/1523824273 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94644191100336] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc06c030 con 0x561411634090 2024-09-10T06:22:55.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 20 remove_watcher() i=3 2024-09-10T06:22:55.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644191104736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x56141162f900 2024-09-10T06:22:55.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94644191104736] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x56141162f900 2024-09-10T06:22:55.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 20 remove_watcher() i=4 2024-09-10T06:22:55.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.837+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644191106800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x7f00bc06f060 2024-09-10T06:22:55.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.841+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94644191106800] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.841+0000 7f00c6ab09c0 20 remove_watcher() i=5 2024-09-10T06:22:55.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.841+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644191102240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x7f00bc06f060 2024-09-10T06:22:55.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94644191102240] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 20 remove_watcher() i=6 2024-09-10T06:22:55.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644191107856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561411666e40 con 0x7f00bc06f060 2024-09-10T06:22:55.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94644191107856] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b4026040 con 0x7f00bc06f060 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 20 remove_watcher() i=7 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f00bc06f060 msgr2=0x7f00bc050600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f00bc06f060 0x7f00bc050600 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56141162f900 msgr2=0x561411631d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56141162f900 0x561411631d90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561411634090 msgr2=0x561411636480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x561411634090 0x561411636480 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411638b60 msgr2=0x56141163afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411638b60 0x56141163afd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff94039a70 msgr2=0x7eff9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff94039a70 0x7eff9403bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00b80aafd0 tx=0x7f00b80a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:55.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c4db7640 1 -- 172.21.15.117:0/1523824273 reap_dead start 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 msgr2=0x561411624850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f00bc04d780 tx=0x7f00bc008f20 comp rx=0 tx=0).stop 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 shutdown_connections 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/1523824273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56141161e5e0 0x561411624850 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 >> 172.21.15.117:0/1523824273 conn(0x5614116199a0 msgr2=0x561411617bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 shutdown_connections 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/1523824273 wait complete. 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 msgr2=0x7eff9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 0x7eff9c03bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5614115fab20 tx=0x7f00b8005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 msgr2=0x5614116112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00bc010d00 tx=0x7f00bc043ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 shutdown_connections 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7eff9c039a70 0x7eff9c03bf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/3718711572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561411610e80 0x5614116112a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 >> 172.21.15.117:0/3718711572 conn(0x561411606830 msgr2=0x561411606c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 shutdown_connections 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/3718711572 wait complete. 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561411502880 msgr2=0x5614115fa1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x561411502880 0x5614115fa1a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5614115fc950 msgr2=0x5614115fed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5614115fc950 0x5614115fed40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411600890 msgr2=0x561411602c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x561411600890 0x561411602c80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7effac039ac0 msgr2=0x7effac03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7effac039ac0 0x7effac03bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00b80ac000 tx=0x7f00b80a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 msgr2=0x5614114fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 --2- 172.21.15.117:0/991736612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5614114727b0 0x5614114fe840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001ba0 tx=0x7f00bc004470 comp rx=0 tx=0).stop 2024-09-10T06:22:55.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c4db7640 1 -- 172.21.15.117:0/991736612 reap_dead start 2024-09-10T06:22:55.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 shutdown_connections 2024-09-10T06:22:55.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 >> 172.21.15.117:0/991736612 conn(0x5614114f8e90 msgr2=0x5614115e3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 shutdown_connections 2024-09-10T06:22:55.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.845+0000 7f00c6ab09c0 1 -- 172.21.15.117:0/991736612 wait complete. 2024-09-10T06:22:55.860 INFO:teuthology.orchestra.run.smithi117.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1f11ec0c-dab3-4c88-849a-c22a32f07424","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T06:22:54.618518Z","creation_time":"2024-09-10T06:22:54.613572Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T06:22:55.860 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:22:54.618518Z', 'creation_time': '2024-09-10T06:22:54.613572Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T06:22:55.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T06:22:55.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T06:22:55.861 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-10T06:22:55.942 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:55.942 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:55.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159ccc79c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f8a1d0c8c0 0x55f8a1d0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159ccc79c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8a1bba9c0 con 0x55f8a1d08770 2024-09-10T06:22:55.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159ccc79c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55f8a1c0a6d0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f1599fcc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f8a1d0c8c0 0x55f8a1d0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159a7cd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55f8a1d08770 0x55f8a1d08b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52456/0 (socket says 172.21.15.117:52456) 2024-09-10T06:22:55.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f159a7cd640 1 -- 172.21.15.117:0/3101813214 learned_addr learned my addr 172.21.15.117:0/3101813214 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:55.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f1599fcc640 1 -- 172.21.15.117:0/3101813214 >> v1:172.21.15.84:6789/0 conn(0x55f8a1d08770 legacy=0x55f8a1d08b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.941+0000 7f1599fcc640 1 -- 172.21.15.117:0/3101813214 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1baeca0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f1599fcc640 1 --2- 172.21.15.117:0/3101813214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d0c8c0 0x55f8a1d0ecb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f159000a480 tx=0x7f159001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e8877a548ce916 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f15997cb640 1 -- 172.21.15.117:0/3101813214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15900aa570 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f15997cb640 1 -- 172.21.15.117:0/3101813214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15900af070 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f15997cb640 1 -- 172.21.15.117:0/3101813214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15900aa860 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 -- 172.21.15.117:0/3101813214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d0c8c0 msgr2=0x55f8a1d0ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/3101813214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d0c8c0 0x55f8a1d0ecb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f159000a480 tx=0x7f159001b310 comp rx=0 tx=0).stop 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 -- 172.21.15.117:0/3101813214 shutdown_connections 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/3101813214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d0c8c0 0x55f8a1d0ecb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 -- 172.21.15.117:0/3101813214 >> 172.21.15.117:0/3101813214 conn(0x55f8a1c7c080 msgr2=0x55f8a1c7c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 -- 172.21.15.117:0/3101813214 shutdown_connections 2024-09-10T06:22:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.945+0000 7f159ccc79c0 1 -- 172.21.15.117:0/3101813214 wait complete. 2024-09-10T06:22:55.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159ccc79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159ccc79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f8a1c0e680 con 0x55f8a1d08770 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51938/0 (socket says 172.21.15.117:51938) 2024-09-10T06:22:55.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159a7cd640 1 -- 172.21.15.117:0/804891999 learned_addr learned my addr 172.21.15.117:0/804891999 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159a7cd640 1 -- 172.21.15.117:0/804891999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1b89da0 con 0x55f8a1d08770 2024-09-10T06:22:55.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f159a7cd640 1 --2- 172.21.15.117:0/804891999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f158c001e50 tx=0x7f158c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43344b8dafc88aef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f1488608640 1 -- 172.21.15.117:0/804891999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c012020 con 0x55f8a1d08770 2024-09-10T06:22:55.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f1488608640 1 -- 172.21.15.117:0/804891999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c00e7c0 con 0x55f8a1d08770 2024-09-10T06:22:55.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.961+0000 7f1488608640 1 -- 172.21.15.117:0/804891999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c00eaa0 con 0x55f8a1d08770 2024-09-10T06:22:55.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/804891999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 msgr2=0x55f8a1df39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/804891999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f158c001e50 tx=0x7f158c001e80 comp rx=0 tx=0).stop 2024-09-10T06:22:55.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/804891999 shutdown_connections 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/804891999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1df39b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/804891999 >> 172.21.15.117:0/804891999 conn(0x55f8a1c7c080 msgr2=0x55f8a1def650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/804891999 shutdown_connections 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/804891999 wait complete. 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1dfb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f8a1bb0a50 con 0x55f8a1d08770 2024-09-10T06:22:55.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1dfb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1dfb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51946/0 (socket says 172.21.15.117:51946) 2024-09-10T06:22:55.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159a7cd640 1 -- 172.21.15.117:0/888478792 learned_addr learned my addr 172.21.15.117:0/888478792 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159a7cd640 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1dfb580 con 0x55f8a1d08770 2024-09-10T06:22:55.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159a7cd640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1dfb020 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55f8a1df49a0 tx=0x7f158c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f1486e05640 1 -- 172.21.15.117:0/888478792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c012030 con 0x55f8a1d08770 2024-09-10T06:22:55.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f1486e05640 1 -- 172.21.15.117:0/888478792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c01a680 con 0x55f8a1d08770 2024-09-10T06:22:55.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a1dfb810 con 0x55f8a1d08770 2024-09-10T06:22:55.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f1486e05640 1 -- 172.21.15.117:0/888478792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c01a980 con 0x55f8a1d08770 2024-09-10T06:22:55.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.965+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a1dfc1c0 con 0x55f8a1d08770 2024-09-10T06:22:55.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1486e05640 1 -- 172.21.15.117:0/888478792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f158c015020 con 0x55f8a1d08770 2024-09-10T06:22:55.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1486e05640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1480039a70 0x7f148003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1486e05640 1 -- 172.21.15.117:0/888478792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f158c020070 con 0x55f8a1d08770 2024-09-10T06:22:55.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1599fcc640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1480039a70 0x7f148003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1d0c8c0 0x55f8a1e02190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e026d0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159afce640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1d0c8c0 0x55f8a1e02190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1599fcc640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1480039a70 0x7f148003bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15900ae000 tx=0x7f15900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159afce640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1d0c8c0 0x55f8a1e02190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159afce640 1 -- 172.21.15.117:0/888478792 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1dfc500 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159afce640 1 -- 172.21.15.117:0/888478792 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e04940 0x55f8a1e06d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e07420 con 0x55f8a1e04940 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159a7cd640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e04940 0x55f8a1e06d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159a7cd640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e04940 0x55f8a1e06d30 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159a7cd640 1 -- 172.21.15.117:0/888478792 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f158c008030 con 0x55f8a1e04940 2024-09-10T06:22:55.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e037e0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159afce640 1 -- 172.21.15.117:0/888478792 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1d0c8c0 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e08880 0x55f8a1e0ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e0b3b0 con 0x55f8a1e08880 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1599fcc640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e08880 0x55f8a1e0ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.969+0000 7f1599fcc640 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e08880 0x55f8a1e0ac70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f1599fcc640 1 -- 172.21.15.117:0/888478792 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e08880 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f8a1c1b450 con 0x55f8a1e18e70 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51950/0 (socket says 172.21.15.117:51950) 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159a7cd640 1 -- 172.21.15.117:0/722758577 learned_addr learned my addr 172.21.15.117:0/722758577 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159a7cd640 1 -- 172.21.15.117:0/722758577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1e198d0 con 0x55f8a1e18e70 2024-09-10T06:22:55.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159a7cd640 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f158c04ecf0 tx=0x7f158c050260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f147ffff640 1 -- 172.21.15.117:0/722758577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c01adf0 con 0x55f8a1e18e70 2024-09-10T06:22:55.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a1e1a130 con 0x55f8a1e18e70 2024-09-10T06:22:55.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f147ffff640 1 -- 172.21.15.117:0/722758577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c02cb80 con 0x55f8a1e18e70 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f147ffff640 1 -- 172.21.15.117:0/722758577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c02cd70 con 0x55f8a1e18e70 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a1e1a130 con 0x55f8a1e18e70 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f147ffff640 1 -- 172.21.15.117:0/722758577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f158c049040 con 0x55f8a1e18e70 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.973+0000 7f147ffff640 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 0x7f147403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f147ffff640 1 -- 172.21.15.117:0/722758577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f158c005050 con 0x55f8a1e18e70 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f1599fcc640 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 0x7f147403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f1599fcc640 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 0x7f147403c0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f8a1e02b10 tx=0x7f1590005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f8a1df4200 con 0x55f8a1e25440 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51962/0 (socket says 172.21.15.117:51962) 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 -- 172.21.15.117:0/2526498989 learned_addr learned my addr 172.21.15.117:0/2526498989 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 -- 172.21.15.117:0/2526498989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1e25df0 con 0x55f8a1e25440 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 --2- 172.21.15.117:0/2526498989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f158c041c70 tx=0x7f158c024750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab411bfdd2dc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f147dffb640 1 -- 172.21.15.117:0/2526498989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c057040 con 0x55f8a1e25440 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f147dffb640 1 -- 172.21.15.117:0/2526498989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c036440 con 0x55f8a1e25440 2024-09-10T06:22:55.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f147dffb640 1 -- 172.21.15.117:0/2526498989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c050db0 con 0x55f8a1e25440 2024-09-10T06:22:55.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2526498989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 msgr2=0x55f8a1e25820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:55.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2526498989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f158c041c70 tx=0x7f158c024750 comp rx=0 tx=0).stop 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2526498989 shutdown_connections 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2526498989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e25820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2526498989 >> 172.21.15.117:0/2526498989 conn(0x55f8a1e21870 msgr2=0x55f8a1e1fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2526498989 shutdown_connections 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2526498989 wait complete. 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 Processor -- start 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- start start 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159ccc79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f8a1e262d0 con 0x55f8a1e25440 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51970/0 (socket says 172.21.15.117:51970) 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.977+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 learned_addr learned my addr 172.21.15.117:0/2737377823 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:55.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a1e2ccb0 con 0x55f8a1e25440 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159a7cd640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f158c018c60 tx=0x7f158c030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 -- 172.21.15.117:0/2737377823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c06a070 con 0x55f8a1e25440 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a1e2ccb0 con 0x55f8a1e25440 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 -- 172.21.15.117:0/2737377823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c04d440 con 0x55f8a1e25440 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 -- 172.21.15.117:0/2737377823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f158c040150 con 0x55f8a1e25440 2024-09-10T06:22:55.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a1e2d280 con 0x55f8a1e25440 2024-09-10T06:22:55.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 -- 172.21.15.117:0/2737377823 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f158c06d070 con 0x55f8a1e25440 2024-09-10T06:22:55.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1464039a70 0x7f146403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f146bfff640 1 -- 172.21.15.117:0/2737377823 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f158c070b00 con 0x55f8a1e25440 2024-09-10T06:22:55.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1e378c0 0x55f8a1e39d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3a4a0 con 0x55f8a1e378c0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f1599fcc640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1464039a70 0x7f146403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159afce640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1e378c0 0x55f8a1e39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f1599fcc640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1464039a70 0x7f146403bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f159000a480 tx=0x7f15900a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159afce640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1e378c0 0x55f8a1e39d50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 realm 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3a8b0 con 0x55f8a1e378c0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.981+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b180 con 0x55f8a1e378c0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:55.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e3c050 0x55f8a1e3e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3eb80 con 0x55f8a1e3c050 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e3c050 0x55f8a1e3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e3c050 0x55f8a1e3e440 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 20 searching for the correct realm 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e40b20 0x55f8a1e42fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e43690 con 0x55f8a1e40b20 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f1599fcc640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e40b20 0x55f8a1e42fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f1599fcc640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e40b20 0x55f8a1e42fc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:55.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e43690 con 0x55f8a1e3c050 2024-09-10T06:22:55.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:55.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f158c06f070 0x7f158c00ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:55.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e43690 con 0x7f158c06f070 2024-09-10T06:22:55.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159afce640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f158c06f070 0x7f158c00ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.985+0000 7f159afce640 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f158c06f070 0x7f158c00ab50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e3c050 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:55.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.989+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e3c050 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:55.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e3c050 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.993+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e3c050 2024-09-10T06:22:56.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e40b20 2024-09-10T06:22:56.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x7f158c06f070 2024-09-10T06:22:56.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e378c0 2024-09-10T06:22:56.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3b520 con 0x55f8a1e3c050 2024-09-10T06:22:56.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:55.997+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3f440 con 0x55f8a1e378c0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3f830 con 0x55f8a1e378c0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e3f830 con 0x55f8a1e40b20 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 zone default found 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 4 Realm: () 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 zonegroup default 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e43b10 con 0x7f158c06f070 2024-09-10T06:22:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e45500 con 0x55f8a1e40b20 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e458a0 con 0x55f8a1e40b20 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 started sync module instance, tier type = 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e449a0 con 0x55f8a1e3c050 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526356344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e44600 con 0x55f8a1e3c050 2024-09-10T06:22:56.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.001+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e46620 con 0x55f8a1e378c0 2024-09-10T06:22:56.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.005+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526356344256] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.005+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.005+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526356347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e46a10 con 0x55f8a1e378c0 2024-09-10T06:22:56.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.005+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e473d0 con 0x55f8a1e40b20 2024-09-10T06:22:56.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526356347968] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526356352800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e477c0 con 0x55f8a1e40b20 2024-09-10T06:22:56.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e48180 con 0x55f8a1e3c050 2024-09-10T06:22:56.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526356358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e48df0 con 0x55f8a1e3c050 2024-09-10T06:22:56.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e497b0 con 0x55f8a1e378c0 2024-09-10T06:22:56.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526356352800] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.009+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526356358432] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526356359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e48d60 con 0x55f8a1e378c0 2024-09-10T06:22:56.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e49c60 con 0x7f158c06f070 2024-09-10T06:22:56.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526356359488] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526356361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e49bd0 con 0x7f158c06f070 2024-09-10T06:22:56.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.013+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4a670 con 0x7f158c06f070 2024-09-10T06:22:56.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.017+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.017+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526356365760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4aa90 con 0x7f158c06f070 2024-09-10T06:22:56.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.017+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4b4e0 con 0x7f158c06f070 2024-09-10T06:22:56.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.017+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526356361984] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.017+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526356365760] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526356369360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4a5e0 con 0x7f158c06f070 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=0 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=1 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=2 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=3 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=4 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=5 2024-09-10T06:22:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=6 2024-09-10T06:22:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526356369360] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 20 add_watcher() i=7 2024-09-10T06:22:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4a5e0 con 0x55f8a1e378c0 2024-09-10T06:22:56.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.021+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526356363040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e4a5e0 con 0x55f8a1e378c0 2024-09-10T06:22:56.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526356363040] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f1450fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:56.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:56.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 5 note: GC not initialized 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f13cb7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 Filter name: none 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f13c97fa640 20 reqs_thread_entry: start 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e71550 con 0x55f8a1e378c0 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e72aa0 con 0x55f8a1e3c050 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e72aa0 con 0x55f8a1e378c0 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 4.23 4:c456ee1c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e74550 con 0x7f158c06f070 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 4.4 4:210bc693:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e77200 con 0x7f158c06f070 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 4.37 4:ed00a776:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e79ef0 con 0x7f158c06f070 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 4.2d 4:b41aa053:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e77200 con 0x7f158c06f070 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 4.2b 4:d64dd120:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e7ed30 con 0x55f8a1e378c0 2024-09-10T06:22:56.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 4.35 4:ac74c6ce:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e815a0 con 0x55f8a1e378c0 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e840a0 con 0x7f158c06f070 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 4.37 4:ed2df8df:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e86a20 con 0x7f158c06f070 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 4.34 4:2c42ad31:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e89290 con 0x55f8a1e3c050 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:74 4.25 4:a75a5a58:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e8bb00 con 0x55f8a1e40b20 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 4.35 4:ac804643:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e8e650 con 0x55f8a1e378c0 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(69 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(70 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(74 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(75 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(73 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(66 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.025+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(65 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(67 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(68 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(71 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(72 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e76b70 con 0x55f8a1e3c050 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(76 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.029+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e76b70 con 0x55f8a1e3c050 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(77 foo.buckets [call] v30'18 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e8e000 con 0x55f8a1e378c0 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e76b50 con 0x55f8a1e3c050 2024-09-10T06:22:56.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv18 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f1450fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526356363040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x55f8a1e378c0 2024-09-10T06:22:56.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94526356363040] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.033+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526356344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x55f8a1e3c050 2024-09-10T06:22:56.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94526356344256] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159ccc79c0 20 remove_watcher() i=0 2024-09-10T06:22:56.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159ccc79c0 2 removed watcher, disabling cache 2024-09-10T06:22:56.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526356347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e44dc0 con 0x55f8a1e378c0 2024-09-10T06:22:56.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94526356347968] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159ccc79c0 20 remove_watcher() i=1 2024-09-10T06:22:56.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.037+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526356352800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x55f8a1e40b20 2024-09-10T06:22:56.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f1599fcc640 1 -- 172.21.15.117:0/2737377823 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94526356352800] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15900a8070 con 0x55f8a1e40b20 2024-09-10T06:22:56.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f159ccc79c0 20 remove_watcher() i=2 2024-09-10T06:22:56.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526356358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e44dc0 con 0x55f8a1e3c050 2024-09-10T06:22:56.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f159a7cd640 1 -- 172.21.15.117:0/2737377823 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94526356358432] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f158c076070 con 0x55f8a1e3c050 2024-09-10T06:22:56.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f159ccc79c0 20 remove_watcher() i=3 2024-09-10T06:22:56.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.041+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526356359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x55f8a1e378c0 2024-09-10T06:22:56.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94526356359488] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x55f8a1e378c0 2024-09-10T06:22:56.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159ccc79c0 20 remove_watcher() i=4 2024-09-10T06:22:56.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526356361984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x7f158c06f070 2024-09-10T06:22:56.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94526356361984] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159ccc79c0 20 remove_watcher() i=5 2024-09-10T06:22:56.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.045+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526356365760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x7f158c06f070 2024-09-10T06:22:56.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94526356365760] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 20 remove_watcher() i=6 2024-09-10T06:22:56.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526356369360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f8a1e6f2e0 con 0x7f158c06f070 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94526356369360] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f159400a4d0 con 0x7f158c06f070 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 20 remove_watcher() i=7 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f158c06f070 msgr2=0x7f158c00ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f158c06f070 0x7f158c00ab50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1e378c0 msgr2=0x55f8a1e39d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1e378c0 0x55f8a1e39d50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e3c050 msgr2=0x55f8a1e3e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e3c050 0x55f8a1e3e440 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e40b20 msgr2=0x55f8a1e42fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e40b20 0x55f8a1e42fc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1464039a70 msgr2=0x7f146403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1464039a70 0x7f146403bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f159000a480 tx=0x7f15900a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 msgr2=0x55f8a1e2c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159afce640 1 -- 172.21.15.117:0/2737377823 reap_dead start 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f158c018c60 tx=0x7f158c030f90 comp rx=0 tx=0).stop 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 shutdown_connections 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/2737377823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e25440 0x55f8a1e2c750 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 >> 172.21.15.117:0/2737377823 conn(0x55f8a1e21870 msgr2=0x55f8a1e1fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 shutdown_connections 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.049+0000 7f159ccc79c0 1 -- 172.21.15.117:0/2737377823 wait complete. 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 msgr2=0x7f147403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 0x7f147403c0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f8a1e02b10 tx=0x7f1590005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 msgr2=0x55f8a1e19290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f158c04ecf0 tx=0x7f158c050260 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 shutdown_connections 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1474039c10 0x7f147403c0d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/722758577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1e18e70 0x55f8a1e19290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 >> 172.21.15.117:0/722758577 conn(0x55f8a1e0e820 msgr2=0x55f8a1e0ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 shutdown_connections 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/722758577 wait complete. 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1d0c8c0 msgr2=0x55f8a1e02190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f8a1d0c8c0 0x55f8a1e02190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e04940 msgr2=0x55f8a1e06d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f8a1e04940 0x55f8a1e06d30 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e08880 msgr2=0x55f8a1e0ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f8a1e08880 0x55f8a1e0ac70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1480039a70 msgr2=0x7f148003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1480039a70 0x7f148003bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15900ae000 tx=0x7f15900a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 msgr2=0x55f8a1dfb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 --2- 172.21.15.117:0/888478792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8a1d08770 0x55f8a1dfb020 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55f8a1df49a0 tx=0x7f158c000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159afce640 1 -- 172.21.15.117:0/888478792 reap_dead start 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 shutdown_connections 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 >> 172.21.15.117:0/888478792 conn(0x55f8a1c7c080 msgr2=0x55f8a1dee0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 shutdown_connections 2024-09-10T06:22:56.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.053+0000 7f159ccc79c0 1 -- 172.21.15.117:0/888478792 wait complete. 2024-09-10T06:22:56.065 INFO:teuthology.orchestra.run.smithi117.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-10T06:22:56.034120Z","last_stats_update":"2024-09-10T06:22:56.031909Z"} 2024-09-10T06:22:56.065 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-10T06:22:56.034120Z', 'last_stats_update': '2024-09-10T06:22:56.031909Z'} 2024-09-10T06:22:56.072 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:56.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T06:22:56.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T06:22:56.072 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-10T06:22:56.144 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:56.145 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:56.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.141+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ae0c7d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56473a4a8770 0x56473a5371a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ae0c7d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56473a3e89c0 con 0x56473a5376e0 2024-09-10T06:22:56.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ae0c7d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56473a4386d0 con 0x56473a4a8770 2024-09-10T06:22:56.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56473a4a8770 0x56473a5371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56473a4a8770 0x56473a5371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51982/0 (socket says 172.21.15.117:51982) 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 -- 172.21.15.117:0/1766783184 learned_addr learned my addr 172.21.15.117:0/1766783184 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8addf82640 1 --1- 172.21.15.117:0/1766783184 >> v1:172.21.15.84:6789/0 conn(0x56473a5376e0 0x56473a539ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52464/0 (socket says 172.21.15.117:52464) 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 -- 172.21.15.117:0/1766783184 >> v1:172.21.15.84:6789/0 conn(0x56473a5376e0 legacy=0x56473a539ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8add781640 1 -- 172.21.15.117:0/1766783184 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983510549 0 0) 0x56473a3e89c0 con 0x56473a5376e0 2024-09-10T06:22:56.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 -- 172.21.15.117:0/1766783184 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a3dcca0 con 0x56473a4a8770 2024-09-10T06:22:56.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.145+0000 7f8ade783640 1 --2- 172.21.15.117:0/1766783184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a5371a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000a5c0 tx=0x7f8ad001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03b192faefc5ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8add781640 1 -- 172.21.15.117:0/1766783184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00b1070 con 0x56473a4a8770 2024-09-10T06:22:56.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8add781640 1 -- 172.21.15.117:0/1766783184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00a8070 con 0x56473a4a8770 2024-09-10T06:22:56.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8add781640 1 -- 172.21.15.117:0/1766783184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00ac5b0 con 0x56473a4a8770 2024-09-10T06:22:56.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1766783184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 msgr2=0x56473a5371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1766783184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a5371a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000a5c0 tx=0x7f8ad001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:56.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1766783184 shutdown_connections 2024-09-10T06:22:56.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1766783184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a5371a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1766783184 >> 172.21.15.117:0/1766783184 conn(0x56473a52ee90 msgr2=0x56473a5312b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1766783184 shutdown_connections 2024-09-10T06:22:56.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.149+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1766783184 wait complete. 2024-09-10T06:22:56.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56473a43c680 con 0x56473a4a8770 2024-09-10T06:22:56.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:51994/0 (socket says 172.21.15.117:51994) 2024-09-10T06:22:56.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ade783640 1 -- 172.21.15.117:0/3138450163 learned_addr learned my addr 172.21.15.117:0/3138450163 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ade783640 1 -- 172.21.15.117:0/3138450163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a3b7da0 con 0x56473a4a8770 2024-09-10T06:22:56.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ade783640 1 --2- 172.21.15.117:0/3138450163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0018f70 tx=0x7f8ad0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997a9e481c73436f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f89cc608640 1 -- 172.21.15.117:0/3138450163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00bd070 con 0x56473a4a8770 2024-09-10T06:22:56.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f89cc608640 1 -- 172.21.15.117:0/3138450163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00ac7a0 con 0x56473a4a8770 2024-09-10T06:22:56.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f89cc608640 1 -- 172.21.15.117:0/3138450163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00b1040 con 0x56473a4a8770 2024-09-10T06:22:56.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/3138450163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 msgr2=0x56473a61f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/3138450163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0018f70 tx=0x7f8ad0003030 comp rx=0 tx=0).stop 2024-09-10T06:22:56.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/3138450163 shutdown_connections 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/3138450163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a61f740 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/3138450163 >> 172.21.15.117:0/3138450163 conn(0x56473a52ee90 msgr2=0x56473a61b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/3138450163 shutdown_connections 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/3138450163 wait complete. 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.165+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a626d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56473a3dea50 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a626d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a626d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52002/0 (socket says 172.21.15.117:52002) 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ade783640 1 -- 172.21.15.117:0/156847088 learned_addr learned my addr 172.21.15.117:0/156847088 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ade783640 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a627260 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ade783640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a626d00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ad001bbe0 tx=0x7f8ad00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 -- 172.21.15.117:0/156847088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00c5020 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 -- 172.21.15.117:0/156847088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00accb0 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473a6274f0 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 -- 172.21.15.117:0/156847088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00bd040 con 0x56473a4a8770 2024-09-10T06:22:56.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473a627ea0 con 0x56473a4a8770 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 -- 172.21.15.117:0/156847088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad00aa070 con 0x56473a4a8770 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89c4039a70 0x7f89c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f89cae05640 1 -- 172.21.15.117:0/156847088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8ad00e9fd0 con 0x56473a4a8770 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8addf82640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89c4039a70 0x7f89c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a5376e0 0x56473a62de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a62e3b0 con 0x56473a5376e0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.169+0000 7f8adef84640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a5376e0 0x56473a62de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8addf82640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89c4039a70 0x7f89c403bf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4000c10 tx=0x7f8ad40013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8adef84640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a5376e0 0x56473a62de70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8adef84640 1 -- 172.21.15.117:0/156847088 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a5376e0 2024-09-10T06:22:56.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a62e750 con 0x56473a5376e0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8adef84640 1 -- 172.21.15.117:0/156847088 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a5376e0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a630560 0x56473a632950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a633020 con 0x56473a630560 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ade783640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a630560 0x56473a632950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ade783640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a630560 0x56473a632950 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ade783640 1 -- 172.21.15.117:0/156847088 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a630560 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a62f400 con 0x56473a5376e0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8adef84640 1 -- 172.21.15.117:0/156847088 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a5376e0 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a634460 0x56473a636850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a636fe0 con 0x56473a634460 2024-09-10T06:22:56.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8addf82640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a634460 0x56473a636850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8addf82640 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a634460 0x56473a636850 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8addf82640 1 -- 172.21.15.117:0/156847088 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ad400f680 con 0x56473a634460 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.173+0000 7f8ae0c7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56473a449450 con 0x56473a644aa0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52014/0 (socket says 172.21.15.117:52014) 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 -- 172.21.15.117:0/1520391382 learned_addr learned my addr 172.21.15.117:0/1520391382 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 -- 172.21.15.117:0/1520391382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a645500 con 0x56473a644aa0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00b54e0 tx=0x7f8ad00c0ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 -- 172.21.15.117:0/1520391382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00c93b0 con 0x56473a644aa0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 -- 172.21.15.117:0/1520391382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00c9550 con 0x56473a644aa0 2024-09-10T06:22:56.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473a645d60 con 0x56473a644aa0 2024-09-10T06:22:56.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 -- 172.21.15.117:0/1520391382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00c9850 con 0x56473a644aa0 2024-09-10T06:22:56.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473a6462d0 con 0x56473a644aa0 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 -- 172.21.15.117:0/1520391382 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad00b7470 con 0x56473a644aa0 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 0x7f89b803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f89c3fff640 1 -- 172.21.15.117:0/1520391382 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8ad00ee020 con 0x56473a644aa0 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8addf82640 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 0x7f89b803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8addf82640 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 0x7f89b803bee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x56473a6373e0 tx=0x7f8ad4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ae0c7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56473a61ff30 con 0x56473a533160 2024-09-10T06:22:56.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52020/0 (socket says 172.21.15.117:52020) 2024-09-10T06:22:56.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.177+0000 7f8ade783640 1 -- 172.21.15.117:0/1175642508 learned_addr learned my addr 172.21.15.117:0/1175642508 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 -- 172.21.15.117:0/1175642508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a533b30 con 0x56473a533160 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 --2- 172.21.15.117:0/1175642508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00aefe0 tx=0x7f8ad00b8d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47588ff9f147dc0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89c1ffb640 1 -- 172.21.15.117:0/1175642508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00ff070 con 0x56473a533160 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89c1ffb640 1 -- 172.21.15.117:0/1175642508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00e18a0 con 0x56473a533160 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89c1ffb640 1 -- 172.21.15.117:0/1175642508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00a7180 con 0x56473a533160 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1175642508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 msgr2=0x56473a533560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1175642508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00aefe0 tx=0x7f8ad00b8d00 comp rx=0 tx=0).stop 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1175642508 shutdown_connections 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1175642508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a533560 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1175642508 >> 172.21.15.117:0/1175642508 conn(0x56473a64d690 msgr2=0x56473a64b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1175642508 shutdown_connections 2024-09-10T06:22:56.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1175642508 wait complete. 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 Processor -- start 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- start start 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56473a534030 con 0x56473a533160 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52024/0 (socket says 172.21.15.117:52024) 2024-09-10T06:22:56.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 learned_addr learned my addr 172.21.15.117:0/998670997 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473a65acf0 con 0x56473a533160 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ade783640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00e1fd0 tx=0x7f8ad00b7af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89affff640 1 -- 172.21.15.117:0/998670997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00ff040 con 0x56473a533160 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473a65acf0 con 0x56473a533160 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89affff640 1 -- 172.21.15.117:0/998670997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00dcb40 con 0x56473a533160 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473a65acf0 con 0x56473a533160 2024-09-10T06:22:56.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.181+0000 7f89affff640 1 -- 172.21.15.117:0/998670997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad00dce20 con 0x56473a533160 2024-09-10T06:22:56.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f89affff640 1 -- 172.21.15.117:0/998670997 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad010c020 con 0x56473a533160 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f89affff640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89a8039a70 0x7f89a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f89affff640 1 -- 172.21.15.117:0/998670997 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8ad010a020 con 0x56473a533160 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8addf82640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89a8039a70 0x7f89a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a6659b0 0x56473a667e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a668590 con 0x56473a6659b0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a6659b0 0x56473a667e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8addf82640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89a8039a70 0x7f89a803bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c010 tx=0x7f8ad4023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a6659b0 0x56473a667e40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 realm 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6689a0 con 0x56473a6659b0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a669270 con 0x56473a6659b0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a66a370 0x56473a66c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a66cd30 con 0x56473a66a370 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ade783640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a66a370 0x56473a66c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.185+0000 7f8ade783640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a66a370 0x56473a66c760 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ae0c7d9c0 20 searching for the correct realm 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a66ec80 0x56473a6710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a671730 con 0x56473a66ec80 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8addf82640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a66ec80 0x56473a6710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8addf82640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a66ec80 0x56473a6710b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a671730 con 0x56473a66a370 2024-09-10T06:22:56.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ade783640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8ad00ca020 0x7f8ad00dc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a671730 con 0x7f8ad00ca020 2024-09-10T06:22:56.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8ad00ca020 0x7f8ad00dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8ad00ca020 0x7f8ad00dc440 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.189+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66a370 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66a370 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.193+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66a370 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.197+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66a370 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66ec80 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x7f8ad00ca020 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a6659b0 2024-09-10T06:22:56.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56473a669610 con 0x56473a66a370 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a66d5f0 con 0x56473a6659b0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a66d9e0 con 0x56473a6659b0 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a66d9e0 con 0x56473a66ec80 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.201+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 zone default found 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 4 Realm: () 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:56.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 zonegroup default 2024-09-10T06:22:56.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a671bb0 con 0x7f8ad00ca020 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6736a0 con 0x56473a66ec80 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a673b10 con 0x56473a66ec80 2024-09-10T06:22:56.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a672a40 con 0x56473a66a370 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863922507584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a672a40 con 0x56473a66a370 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a674660 con 0x56473a6659b0 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.205+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863922507584] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863922512240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a672a40 con 0x56473a6659b0 2024-09-10T06:22:56.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6750a0 con 0x56473a66ec80 2024-09-10T06:22:56.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863922514928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a675940 con 0x56473a66ec80 2024-09-10T06:22:56.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a676340 con 0x56473a66a370 2024-09-10T06:22:56.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.209+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863922512240] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863922505104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a676730 con 0x56473a66a370 2024-09-10T06:22:56.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6770f0 con 0x56473a6659b0 2024-09-10T06:22:56.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863922514928] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863922505104] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863922519632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a676c40 con 0x56473a6659b0 2024-09-10T06:22:56.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.213+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6774f0 con 0x7f8ad00ca020 2024-09-10T06:22:56.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863922519632] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863922517136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6770f0 con 0x7f8ad00ca020 2024-09-10T06:22:56.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a677e30 con 0x7f8ad00ca020 2024-09-10T06:22:56.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863922517136] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863922526432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a678010 con 0x7f8ad00ca020 2024-09-10T06:22:56.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.217+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a678860 con 0x7f8ad00ca020 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863922528752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a678c20 con 0x7f8ad00ca020 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=0 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=1 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=2 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=3 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=4 2024-09-10T06:22:56.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.221+0000 7f8ae0c7d9c0 20 add_watcher() i=5 2024-09-10T06:22:56.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863922526432] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8ae0c7d9c0 20 add_watcher() i=6 2024-09-10T06:22:56.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863922528752] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8ae0c7d9c0 20 add_watcher() i=7 2024-09-10T06:22:56.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8ae0c7d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:56.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a676c40 con 0x56473a6659b0 2024-09-10T06:22:56.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.225+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863922529968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a676c40 con 0x56473a6659b0 2024-09-10T06:22:56.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863922529968] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8994fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:56.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:56.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 5 note: GC not initialized 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f890f7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 Filter name: none 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f890d7fa640 20 reqs_thread_entry: start 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a69f280 con 0x56473a6659b0 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:56.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6a1370 con 0x56473a66a370 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6a2b70 con 0x56473a6659b0 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:56.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.229+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6a62b0 con 0x56473a66a370 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6a5300 con 0x56473a66a370 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:56.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T06:22:56.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:56.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.233+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a6aa2c0 con 0x56473a66a370 2024-09-10T06:22:56.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8ae0c7d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T06:22:56.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8ae0c7d9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8ae0c7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:56.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94863922732496 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56473a6a5cf0 con 0x7f8ad00ca020 2024-09-10T06:22:56.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== watch-notify(notify (1) cookie 94863922526432 notify 128849018882 ret 0) ==== 380+0+0 (crc 0 0 0) 0x56473a6a2f60 con 0x7f8ad00ca020 2024-09-10T06:22:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(68 notify.6 [notify cookie 94863922732496 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f89c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94863922526432 notifier 4477 bl.length()=338 2024-09-10T06:22:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f89c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T06:22:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f89c1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f89c1ffb640 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f89a4003eb0 con 0x7f8ad00ca020 2024-09-10T06:22:56.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify_complete (2) cookie 94863922732496 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56473a6a2090 con 0x7f8ad00ca020 2024-09-10T06:22:56.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.237+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8994fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863922529968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a69cfb0 con 0x56473a6659b0 2024-09-10T06:22:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94863922529968] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863922507584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a69cfb0 con 0x56473a66a370 2024-09-10T06:22:56.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94863922507584] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ae0c7d9c0 20 remove_watcher() i=0 2024-09-10T06:22:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ae0c7d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.241+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863922512240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a672f40 con 0x56473a6659b0 2024-09-10T06:22:56.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94863922512240] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8ae0c7d9c0 20 remove_watcher() i=1 2024-09-10T06:22:56.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863922514928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a69cfb0 con 0x56473a66ec80 2024-09-10T06:22:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8addf82640 1 -- 172.21.15.117:0/998670997 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94863922514928] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad4037040 con 0x56473a66ec80 2024-09-10T06:22:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8ae0c7d9c0 20 remove_watcher() i=2 2024-09-10T06:22:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.245+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863922505104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a674170 con 0x56473a66a370 2024-09-10T06:22:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8ade783640 1 -- 172.21.15.117:0/998670997 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94863922505104] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad00c7020 con 0x56473a66a370 2024-09-10T06:22:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8ae0c7d9c0 20 remove_watcher() i=3 2024-09-10T06:22:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863922519632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a672f40 con 0x56473a6659b0 2024-09-10T06:22:56.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94863922519632] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x56473a6659b0 2024-09-10T06:22:56.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8ae0c7d9c0 20 remove_watcher() i=4 2024-09-10T06:22:56.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.249+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863922517136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a674bf0 con 0x7f8ad00ca020 2024-09-10T06:22:56.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94863922517136] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8ae0c7d9c0 20 remove_watcher() i=5 2024-09-10T06:22:56.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863922526432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a674170 con 0x7f8ad00ca020 2024-09-10T06:22:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94863922526432] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8ae0c7d9c0 20 remove_watcher() i=6 2024-09-10T06:22:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.253+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863922528752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56473a675e50 con 0x7f8ad00ca020 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94863922528752] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x7f8ad00ca020 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 20 remove_watcher() i=7 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8ad00ca020 msgr2=0x7f8ad00dc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8ad00ca020 0x7f8ad00dc440 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a6659b0 msgr2=0x56473a667e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a6659b0 0x56473a667e40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a66a370 msgr2=0x56473a66c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a66a370 0x56473a66c760 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a66ec80 msgr2=0x56473a6710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a66ec80 0x56473a6710b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89a8039a70 msgr2=0x7f89a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89a8039a70 0x7f89a803bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c010 tx=0x7f8ad4023040 comp rx=0 tx=0).stop 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 msgr2=0x56473a65a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00e1fd0 tx=0x7f8ad00b7af0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8adef84640 1 -- 172.21.15.117:0/998670997 reap_dead start 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 shutdown_connections 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/998670997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a533160 0x56473a65a790 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 >> 172.21.15.117:0/998670997 conn(0x56473a64d690 msgr2=0x56473a64b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 shutdown_connections 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/998670997 wait complete. 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 msgr2=0x7f89b803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 0x7f89b803bee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x56473a6373e0 tx=0x7f8ad4006000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 msgr2=0x56473a644ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00b54e0 tx=0x7f8ad00c0ac0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 shutdown_connections 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89b8039a20 0x7f89b803bee0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/1520391382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a644aa0 0x56473a644ec0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 >> 172.21.15.117:0/1520391382 conn(0x56473a63a450 msgr2=0x56473a63a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 shutdown_connections 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/1520391382 wait complete. 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a5376e0 msgr2=0x56473a62de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56473a5376e0 0x56473a62de70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a630560 msgr2=0x56473a632950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56473a630560 0x56473a632950 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a634460 msgr2=0x56473a636850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.257+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56473a634460 0x56473a636850 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89c4039a70 msgr2=0x7f89c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f89c4039a70 0x7f89c403bf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4000c10 tx=0x7f8ad40013c0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 msgr2=0x56473a626d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 --2- 172.21.15.117:0/156847088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56473a4a8770 0x56473a626d00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ad001bbe0 tx=0x7f8ad00180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8adef84640 1 -- 172.21.15.117:0/156847088 reap_dead start 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 shutdown_connections 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 >> 172.21.15.117:0/156847088 conn(0x56473a52ee90 msgr2=0x56473a619e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 shutdown_connections 2024-09-10T06:22:56.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.261+0000 7f8ae0c7d9c0 1 -- 172.21.15.117:0/156847088 wait complete. 2024-09-10T06:22:56.273 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T06:22:56.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T06:22:56.273 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T06:22:56.361 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:56.362 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:56.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b87af59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55feee920b80 0x55feee9b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b87af59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55feee8609c0 con 0x55feee9207a0 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b87af59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55feee8b06d0 con 0x55feee920b80 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b84dfa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55feee920b80 0x55feee9b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b855fb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55feee9207a0 0x55feee9b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52476/0 (socket says 172.21.15.117:52476) 2024-09-10T06:22:56.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b855fb640 1 -- 172.21.15.117:0/3588757913 learned_addr learned my addr 172.21.15.117:0/3588757913 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:56.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b77fff640 1 -- 172.21.15.117:0/3588757913 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810290613 0 0) 0x55feee8609c0 con 0x55feee9207a0 2024-09-10T06:22:56.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b77fff640 1 -- 172.21.15.117:0/3588757913 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b70001e20 con 0x55feee9207a0 2024-09-10T06:22:56.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b84dfa640 1 -- 172.21.15.117:0/3588757913 >> v1:172.21.15.84:6789/0 conn(0x55feee9207a0 legacy=0x55feee9b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.361+0000 7f7b84dfa640 1 -- 172.21.15.117:0/3588757913 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feee854ca0 con 0x55feee920b80 2024-09-10T06:22:56.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/3588757913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee920b80 0x55feee9b4d00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a480 tx=0x7f7b7c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61064422c0af053d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b77fff640 1 -- 172.21.15.117:0/3588757913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c0b0070 con 0x55feee920b80 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b77fff640 1 -- 172.21.15.117:0/3588757913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0ab540 con 0x55feee920b80 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b77fff640 1 -- 172.21.15.117:0/3588757913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c0ab820 con 0x55feee920b80 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3588757913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee920b80 msgr2=0x55feee9b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3588757913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee920b80 0x55feee9b4d00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a480 tx=0x7f7b7c01b280 comp rx=0 tx=0).stop 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3588757913 shutdown_connections 2024-09-10T06:22:56.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3588757913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee920b80 0x55feee9b4d00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3588757913 >> 172.21.15.117:0/3588757913 conn(0x55feee9a6ec0 msgr2=0x55feee9a92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3588757913 shutdown_connections 2024-09-10T06:22:56.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.365+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3588757913 wait complete. 2024-09-10T06:22:56.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b87af59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b87af59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55feee8b4680 con 0x55feee9207a0 2024-09-10T06:22:56.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52052/0 (socket says 172.21.15.117:52052) 2024-09-10T06:22:56.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b855fb640 1 -- 172.21.15.117:0/3909883707 learned_addr learned my addr 172.21.15.117:0/3909883707 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b855fb640 1 -- 172.21.15.117:0/3909883707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feee82fda0 con 0x55feee9207a0 2024-09-10T06:22:56.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7b855fb640 1 --2- 172.21.15.117:0/3909883707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b78001e40 tx=0x7f7b7800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f58032b39109f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7a73606640 1 -- 172.21.15.117:0/3909883707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b78012020 con 0x55feee9207a0 2024-09-10T06:22:56.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7a73606640 1 -- 172.21.15.117:0/3909883707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7800e690 con 0x55feee9207a0 2024-09-10T06:22:56.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.381+0000 7f7a73606640 1 -- 172.21.15.117:0/3909883707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7800e9b0 con 0x55feee9207a0 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3909883707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 msgr2=0x55feeea99940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3909883707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b78001e40 tx=0x7f7b7800b790 comp rx=0 tx=0).stop 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3909883707 shutdown_connections 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3909883707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeea99940 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3909883707 >> 172.21.15.117:0/3909883707 conn(0x55feee9a6ec0 msgr2=0x55feeea955e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3909883707 shutdown_connections 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3909883707 wait complete. 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeeaa0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55feee856a50 con 0x55feee9207a0 2024-09-10T06:22:56.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeeaa0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeeaa0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52066/0 (socket says 172.21.15.117:52066) 2024-09-10T06:22:56.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b855fb640 1 -- 172.21.15.117:0/2470518031 learned_addr learned my addr 172.21.15.117:0/2470518031 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b855fb640 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeeaa1540 con 0x55feee9207a0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b855fb640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeeaa0fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55feeea9a930 tx=0x7f7b780040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7a71e03640 1 -- 172.21.15.117:0/2470518031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b78012030 con 0x55feee9207a0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7a71e03640 1 -- 172.21.15.117:0/2470518031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7801a720 con 0x55feee9207a0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55feeeaa17d0 con 0x55feee9207a0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7a71e03640 1 -- 172.21.15.117:0/2470518031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7801aa60 con 0x55feee9207a0 2024-09-10T06:22:56.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feeeaa2180 con 0x55feee9207a0 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.385+0000 7f7a71e03640 1 -- 172.21.15.117:0/2470518031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b78015020 con 0x55feee9207a0 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7a71e03640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a6c039a70 0x7f7a6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7a71e03640 1 -- 172.21.15.117:0/2470518031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b78020070 con 0x55feee9207a0 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a6c039a70 0x7f7a6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feee920b80 0x55feeeaa8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaa8690 con 0x55feee920b80 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feee920b80 0x55feeeaa8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a6c039a70 0x7f7a6c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0ad000 tx=0x7f7b7c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feee920b80 0x55feeeaa8150 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b85dfc640 1 -- 172.21.15.117:0/2470518031 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feee920b80 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaa24c0 con 0x55feee920b80 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b85dfc640 1 -- 172.21.15.117:0/2470518031 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feee920b80 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeaaa900 0x55feeeaaccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaad3e0 con 0x55feeeaaa900 2024-09-10T06:22:56.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b855fb640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeaaa900 0x55feeeaaccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b855fb640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeaaa900 0x55feeeaaccf0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b855fb640 1 -- 172.21.15.117:0/2470518031 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeaaa900 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaa97a0 con 0x55feee920b80 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b85dfc640 1 -- 172.21.15.117:0/2470518031 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feee920b80 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeaae840 0x55feeeab0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeab1370 con 0x55feeeaae840 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeaae840 0x55feeeab0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeaae840 0x55feeeab0c30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.389+0000 7f7b84dfa640 1 -- 172.21.15.117:0/2470518031 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b7c0b3040 con 0x55feeeaae840 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55feee8c1450 con 0x55feeeabee30 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52070/0 (socket says 172.21.15.117:52070) 2024-09-10T06:22:56.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b855fb640 1 -- 172.21.15.117:0/2676496632 learned_addr learned my addr 172.21.15.117:0/2676496632 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b855fb640 1 -- 172.21.15.117:0/2676496632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeeabf890 con 0x55feeeabee30 2024-09-10T06:22:56.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b855fb640 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b7804eb60 tx=0x7f7b78040f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 -- 172.21.15.117:0/2676496632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b78045070 con 0x55feeeabee30 2024-09-10T06:22:56.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 -- 172.21.15.117:0/2676496632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b780503e0 con 0x55feeeabee30 2024-09-10T06:22:56.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55feeeac00f0 con 0x55feeeabee30 2024-09-10T06:22:56.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 -- 172.21.15.117:0/2676496632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7804d570 con 0x55feeeabee30 2024-09-10T06:22:56.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feeeac0660 con 0x55feeeabee30 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 -- 172.21.15.117:0/2676496632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b78009070 con 0x55feeeabee30 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 0x7f7a5c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7a6affd640 1 -- 172.21.15.117:0/2676496632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b78005050 con 0x55feeeabee30 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 0x7f7a5c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.393+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55feeea9a170 con 0x55feeeacb4e0 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 0x7f7a5c03bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55feeeaa8ad0 tx=0x7f7b7c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52072/0 (socket says 172.21.15.117:52072) 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 -- 172.21.15.117:0/3960485248 learned_addr learned my addr 172.21.15.117:0/3960485248 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 -- 172.21.15.117:0/3960485248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeeacbe90 con 0x55feeeacb4e0 2024-09-10T06:22:56.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 --2- 172.21.15.117:0/3960485248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7b78033fb0 tx=0x7f7b7800dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92deb2cde9e17bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7a68ff9640 1 -- 172.21.15.117:0/3960485248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7801c0e0 con 0x55feeeacb4e0 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7a68ff9640 1 -- 172.21.15.117:0/3960485248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b78047ad0 con 0x55feeeacb4e0 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7a68ff9640 1 -- 172.21.15.117:0/3960485248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7803ca80 con 0x55feeeacb4e0 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3960485248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 msgr2=0x55feeeacb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3960485248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7b78033fb0 tx=0x7f7b7800dc20 comp rx=0 tx=0).stop 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3960485248 shutdown_connections 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/3960485248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeeacb8c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3960485248 >> 172.21.15.117:0/3960485248 conn(0x55feeeac7910 msgr2=0x55feeeac5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3960485248 shutdown_connections 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- 172.21.15.117:0/3960485248 wait complete. 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 Processor -- start 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- start start 2024-09-10T06:22:56.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b87af59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55feeeacc370 con 0x55feeeacb4e0 2024-09-10T06:22:56.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52074/0 (socket says 172.21.15.117:52074) 2024-09-10T06:22:56.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 learned_addr learned my addr 172.21.15.117:0/1137385171 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.397+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeead2d80 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b855fb640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c10 tx=0x7f7b78033f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 -- 172.21.15.117:0/1137385171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7801c0e0 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55feeead2d80 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 -- 172.21.15.117:0/1137385171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b78047db0 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feeead2d80 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 -- 172.21.15.117:0/1137385171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7800d3e0 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 -- 172.21.15.117:0/1137385171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b7806f020 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a50039a70 0x7f7a5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7a5affd640 1 -- 172.21.15.117:0/1137385171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f7b7806d020 con 0x55feeeacb4e0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a50039a70 0x7f7a5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feeeadda30 0x55feeeadfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae0610 con 0x55feeeadda30 2024-09-10T06:22:56.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feeeadda30 0x55feeeadfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a50039a70 0x7f7a5003bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c018eb0 tx=0x7f7b7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feeeadda30 0x55feeeadfec0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 realm 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae0a20 con 0x55feeeadda30 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae12f0 con 0x55feeeadda30 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.401+0000 7f7b87af59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeae23f0 0x55feeeae47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae4e30 con 0x55feeeae23f0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeae23f0 0x55feeeae47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeae23f0 0x55feeeae47e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 20 searching for the correct realm 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeae6d10 0x55feeeae9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae97c0 con 0x55feeeae6d10 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeae6d10 0x55feeeae9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b84dfa640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeae6d10 0x55feeeae9140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae97c0 con 0x55feeeae23f0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7b78017050 0x7f7b7801e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae97c0 con 0x7f7b78017050 2024-09-10T06:22:56.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7b78017050 0x7f7b7801e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b85dfc640 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7b78017050 0x7f7b7801e990 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.405+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae23f0 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.409+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae23f0 2024-09-10T06:22:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.413+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae23f0 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae23f0 2024-09-10T06:22:56.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae6d10 2024-09-10T06:22:56.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x7f7b78017050 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeadda30 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.417+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae1690 con 0x55feeeae23f0 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae5680 con 0x55feeeadda30 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae5a70 con 0x55feeeadda30 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae5a70 con 0x55feeeae6d10 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 zone default found 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 4 Realm: () 2024-09-10T06:22:56.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 zonegroup default 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeae9c40 con 0x7f7b78017050 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaeb730 con 0x55feeeae6d10 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaebb70 con 0x55feeeae6d10 2024-09-10T06:22:56.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 started sync module instance, tier type = 2024-09-10T06:22:56.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:56.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaeaad0 con 0x55feeeae23f0 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553414479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaea730 con 0x55feeeae23f0 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.421+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaeca70 con 0x55feeeadda30 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.425+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553414479552] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.425+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.425+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553414485440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaec9e0 con 0x55feeeadda30 2024-09-10T06:22:56.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.425+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaed800 con 0x55feeeae6d10 2024-09-10T06:22:56.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553414488848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaee0a0 con 0x55feeeae6d10 2024-09-10T06:22:56.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaeeaa0 con 0x55feeeae23f0 2024-09-10T06:22:56.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553414485440] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553414487648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaeee90 con 0x55feeeae23f0 2024-09-10T06:22:56.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaef850 con 0x55feeeadda30 2024-09-10T06:22:56.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553414488848] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553414487648] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553414493616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaef3a0 con 0x55feeeadda30 2024-09-10T06:22:56.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.429+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaefc30 con 0x7f7b78017050 2024-09-10T06:22:56.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.433+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553414493616] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.433+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.433+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553414491120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaef850 con 0x7f7b78017050 2024-09-10T06:22:56.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.433+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf0640 con 0x7f7b78017050 2024-09-10T06:22:56.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.433+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553414491120] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553414497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf0640 con 0x7f7b78017050 2024-09-10T06:22:56.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf0ef0 con 0x7f7b78017050 2024-09-10T06:22:56.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553414497456] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553414501232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf0eb0 con 0x7f7b78017050 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=0 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=1 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=2 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=3 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=4 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=5 2024-09-10T06:22:56.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.437+0000 7f7b87af59c0 20 add_watcher() i=6 2024-09-10T06:22:56.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553414501232] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 20 add_watcher() i=7 2024-09-10T06:22:56.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:56.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf4310 con 0x55feeeadda30 2024-09-10T06:22:56.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553414502480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaf17d0 con 0x55feeeadda30 2024-09-10T06:22:56.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553414502480] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:56.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:56.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 5 note: GC not initialized 2024-09-10T06:22:56.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7a3a7e4640 20 reqs_thread_entry: start 2024-09-10T06:22:56.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.441+0000 7f7b87af59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:56.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 20 Filter name: none 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f79abfff640 20 reqs_thread_entry: start 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb17a60 con 0x7f7b78017050 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb16100 con 0x7f7b78017050 2024-09-10T06:22:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T06:22:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:22:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:22:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.445+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb16c00 con 0x7f7b78017050 2024-09-10T06:22:56.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b87af59c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T06:22:56.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b87af59c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:56.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b87af59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T06:22:56.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94553414658192 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb1b6d0 con 0x7f7b78017050 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== watch-notify(notify (1) cookie 94553414491120 notify 128849018883 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55feeeb1b050 con 0x7f7b78017050 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(65 notify.5 [notify cookie 94553414658192 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7a5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94553414491120 notifier 4484 bl.length()=556 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7a5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7a5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7a5bfff640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f79b8003440 con 0x7f7b78017050 2024-09-10T06:22:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== watch-notify(notify_complete (2) cookie 94553414658192 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55feeeb16520 con 0x7f7b78017050 2024-09-10T06:22:56.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.449+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb1b6d0 con 0x7f7b78017050 2024-09-10T06:22:56.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94553414677024 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb1b640 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 94553414488848 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f7b7c0e2040 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7a5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94553414488848 notifier 4484 bl.length()=177 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7a5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7a5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7a5bfff640 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f79b8003400 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 notify.2 [notify cookie 94553414677024 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== watch-notify(notify_complete (2) cookie 94553414677024 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55feee854ca0 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.455 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T06:22:56.449172Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:56.449147Z","tags":[],"group_ids":[]} 2024-09-10T06:22:56.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553414502480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb15700 con 0x55feeeadda30 2024-09-10T06:22:56.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94553414502480] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.453+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553414479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb15700 con 0x55feeeae23f0 2024-09-10T06:22:56.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94553414479552] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b87af59c0 20 remove_watcher() i=0 2024-09-10T06:22:56.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b87af59c0 2 removed watcher, disabling cache 2024-09-10T06:22:56.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553414485440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb15700 con 0x55feeeadda30 2024-09-10T06:22:56.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94553414485440] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b87af59c0 20 remove_watcher() i=1 2024-09-10T06:22:56.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.457+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553414488848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaec5c0 con 0x55feeeae6d10 2024-09-10T06:22:56.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b84dfa640 1 -- 172.21.15.117:0/1137385171 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94553414488848] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b7c0d9070 con 0x55feeeae6d10 2024-09-10T06:22:56.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b87af59c0 20 remove_watcher() i=2 2024-09-10T06:22:56.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553414487648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb15700 con 0x55feeeae23f0 2024-09-10T06:22:56.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b855fb640 1 -- 172.21.15.117:0/1137385171 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94553414487648] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b78008030 con 0x55feeeae23f0 2024-09-10T06:22:56.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b87af59c0 20 remove_watcher() i=3 2024-09-10T06:22:56.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.461+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553414493616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaec5c0 con 0x55feeeadda30 2024-09-10T06:22:56.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94553414493616] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x55feeeadda30 2024-09-10T06:22:56.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b87af59c0 20 remove_watcher() i=4 2024-09-10T06:22:56.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553414491120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaece60 con 0x7f7b78017050 2024-09-10T06:22:56.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94553414491120] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b87af59c0 20 remove_watcher() i=5 2024-09-10T06:22:56.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.465+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553414497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeb15700 con 0x7f7b78017050 2024-09-10T06:22:56.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.469+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94553414497456] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.469+0000 7f7b87af59c0 20 remove_watcher() i=6 2024-09-10T06:22:56.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.469+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553414501232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55feeeaec5c0 con 0x7f7b78017050 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94553414501232] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b8000a4d0 con 0x7f7b78017050 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 20 remove_watcher() i=7 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7b78017050 msgr2=0x7f7b7801e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7b78017050 0x7f7b7801e990 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feeeadda30 msgr2=0x55feeeadfec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feeeadda30 0x55feeeadfec0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeae23f0 msgr2=0x55feeeae47e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeae23f0 0x55feeeae47e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeae6d10 msgr2=0x55feeeae9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeae6d10 0x55feeeae9140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a50039a70 msgr2=0x7f7a5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a50039a70 0x7f7a5003bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c018eb0 tx=0x7f7b7c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 msgr2=0x55feeead2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b85dfc640 1 -- 172.21.15.117:0/1137385171 reap_dead start 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c10 tx=0x7f7b78033f10 comp rx=0 tx=0).stop 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 shutdown_connections 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/1137385171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeacb4e0 0x55feeead2820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 >> 172.21.15.117:0/1137385171 conn(0x55feeeac7910 msgr2=0x55feeeac5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 shutdown_connections 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/1137385171 wait complete. 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 msgr2=0x7f7a5c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 0x7f7a5c03bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55feeeaa8ad0 tx=0x7f7b7c005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:56.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 msgr2=0x55feeeabf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b7804eb60 tx=0x7f7b78040f70 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 shutdown_connections 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a5c039a70 0x7f7a5c03bf30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2676496632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feeeabee30 0x55feeeabf250 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 >> 172.21.15.117:0/2676496632 conn(0x55feeeab47e0 msgr2=0x55feeeab4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 shutdown_connections 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2676496632 wait complete. 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feee920b80 msgr2=0x55feeeaa8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55feee920b80 0x55feeeaa8150 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeaaa900 msgr2=0x55feeeaaccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55feeeaaa900 0x55feeeaaccf0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeaae840 msgr2=0x55feeeab0c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55feeeaae840 0x55feeeab0c30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a6c039a70 msgr2=0x7f7a6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7a6c039a70 0x7f7a6c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0ad000 tx=0x7f7b7c0a5040 comp rx=0 tx=0).stop 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 msgr2=0x55feeeaa0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 --2- 172.21.15.117:0/2470518031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55feee9207a0 0x55feeeaa0fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55feeea9a930 tx=0x7f7b780040f0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b85dfc640 1 -- 172.21.15.117:0/2470518031 reap_dead start 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 shutdown_connections 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 >> 172.21.15.117:0/2470518031 conn(0x55feee9a6ec0 msgr2=0x55feeea94070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 shutdown_connections 2024-09-10T06:22:56.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.473+0000 7f7b87af59c0 1 -- 172.21.15.117:0/2470518031 wait complete. 2024-09-10T06:22:56.487 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T06:22:56.449172Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:56.449147Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:56.494 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T06:22:56.500 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:56.500 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-10T06:22:56.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-10T06:22:56.500 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-10T06:22:56.530 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:56.530 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:56.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f78016b89c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56228f2488c0 0x56228f24acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f78016b89c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56228f0f69c0 con 0x56228f244770 2024-09-10T06:22:56.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f78016b89c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56228f1466d0 con 0x56228f2488c0 2024-09-10T06:22:56.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f77fe9bd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56228f2488c0 0x56228f24acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f77ff1be640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x56228f244770 0x56228f244b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52480/0 (socket says 172.21.15.117:52480) 2024-09-10T06:22:56.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f77ff1be640 1 -- 172.21.15.117:0/1032510410 learned_addr learned my addr 172.21.15.117:0/1032510410 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:56.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f77fe9bd640 1 -- 172.21.15.117:0/1032510410 >> v1:172.21.15.84:6789/0 conn(0x56228f244770 legacy=0x56228f244b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.529+0000 7f77fe9bd640 1 -- 172.21.15.117:0/1032510410 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f0eaca0 con 0x56228f2488c0 2024-09-10T06:22:56.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/1032510410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f24acb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f77f400a480 tx=0x7f77f401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a965fd0027f6ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f77fe1bc640 1 -- 172.21.15.117:0/1032510410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f40aa570 con 0x56228f2488c0 2024-09-10T06:22:56.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f77fe1bc640 1 -- 172.21.15.117:0/1032510410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f40af070 con 0x56228f2488c0 2024-09-10T06:22:56.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f77fe1bc640 1 -- 172.21.15.117:0/1032510410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f40aa860 con 0x56228f2488c0 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 -- 172.21.15.117:0/1032510410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 msgr2=0x56228f24acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1032510410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f24acb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f77f400a480 tx=0x7f77f401b310 comp rx=0 tx=0).stop 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 -- 172.21.15.117:0/1032510410 shutdown_connections 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1032510410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f24acb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 -- 172.21.15.117:0/1032510410 >> 172.21.15.117:0/1032510410 conn(0x56228f1b8080 msgr2=0x56228f1b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 -- 172.21.15.117:0/1032510410 shutdown_connections 2024-09-10T06:22:56.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.533+0000 7f78016b89c0 1 -- 172.21.15.117:0/1032510410 wait complete. 2024-09-10T06:22:56.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f78016b89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f78016b89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56228f14a680 con 0x56228f244770 2024-09-10T06:22:56.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52082/0 (socket says 172.21.15.117:52082) 2024-09-10T06:22:56.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f77ff1be640 1 -- 172.21.15.117:0/418558889 learned_addr learned my addr 172.21.15.117:0/418558889 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f77ff1be640 1 -- 172.21.15.117:0/418558889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f0c5da0 con 0x56228f244770 2024-09-10T06:22:56.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f77ff1be640 1 --2- 172.21.15.117:0/418558889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001e50 tx=0x7f77f0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2675c450618059df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f76ed60a640 1 -- 172.21.15.117:0/418558889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0012020 con 0x56228f244770 2024-09-10T06:22:56.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f76ed60a640 1 -- 172.21.15.117:0/418558889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f000e7c0 con 0x56228f244770 2024-09-10T06:22:56.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.549+0000 7f76ed60a640 1 -- 172.21.15.117:0/418558889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f000eaa0 con 0x56228f244770 2024-09-10T06:22:56.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/418558889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 msgr2=0x56228f32f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 --2- 172.21.15.117:0/418558889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001e50 tx=0x7f77f0001e80 comp rx=0 tx=0).stop 2024-09-10T06:22:56.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/418558889 shutdown_connections 2024-09-10T06:22:56.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 --2- 172.21.15.117:0/418558889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f244770 0x56228f32f9e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/418558889 >> 172.21.15.117:0/418558889 conn(0x56228f1b8080 msgr2=0x56228f32b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/418558889 shutdown_connections 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/418558889 wait complete. 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f337400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56228f0eca50 con 0x56228f2488c0 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f337400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f337400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52098/0 (socket says 172.21.15.117:52098) 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f77ff1be640 1 -- 172.21.15.117:0/864176502 learned_addr learned my addr 172.21.15.117:0/864176502 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f77ff1be640 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f337960 con 0x56228f2488c0 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f77ff1be640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f337400 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001ec0 tx=0x7f77f0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f76ebe07640 1 -- 172.21.15.117:0/864176502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0012030 con 0x56228f2488c0 2024-09-10T06:22:56.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56228f337bf0 con 0x56228f2488c0 2024-09-10T06:22:56.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f76ebe07640 1 -- 172.21.15.117:0/864176502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f00014b0 con 0x56228f2488c0 2024-09-10T06:22:56.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56228f3384b0 con 0x56228f2488c0 2024-09-10T06:22:56.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.553+0000 7f76ebe07640 1 -- 172.21.15.117:0/864176502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f001a830 con 0x56228f2488c0 2024-09-10T06:22:56.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f76ebe07640 1 -- 172.21.15.117:0/864176502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77f0015020 con 0x56228f2488c0 2024-09-10T06:22:56.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f76ebe07640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76e4039a70 0x7f76e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f76ebe07640 1 -- 172.21.15.117:0/864176502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f77f0020070 con 0x56228f2488c0 2024-09-10T06:22:56.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76e4039a70 0x7f76e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f33c470 0x56228f33e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f33eda0 con 0x56228f33c470 2024-09-10T06:22:56.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f33c470 0x56228f33e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76e4039a70 0x7f76e403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77f40ae000 tx=0x7f77f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f33c470 0x56228f33e860 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff9bf640 1 -- 172.21.15.117:0/864176502 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f33c470 2024-09-10T06:22:56.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f33f140 con 0x56228f33c470 2024-09-10T06:22:56.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff9bf640 1 -- 172.21.15.117:0/864176502 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f33c470 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f340f00 0x56228f3432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f3439c0 con 0x56228f340f00 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff1be640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f340f00 0x56228f3432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff1be640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f340f00 0x56228f3432f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff1be640 1 -- 172.21.15.117:0/864176502 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77f0008030 con 0x56228f340f00 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f33fda0 con 0x56228f33c470 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77ff9bf640 1 -- 172.21.15.117:0/864176502 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f33c470 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f344e00 0x56228f3471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f347980 con 0x56228f344e00 2024-09-10T06:22:56.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f344e00 0x56228f3471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f344e00 0x56228f3471f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.557+0000 7f77fe9bd640 1 -- 172.21.15.117:0/864176502 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f344e00 2024-09-10T06:22:56.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56228f157450 con 0x56228f355440 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52104/0 (socket says 172.21.15.117:52104) 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77ff1be640 1 -- 172.21.15.117:0/1441033599 learned_addr learned my addr 172.21.15.117:0/1441033599 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77ff1be640 1 -- 172.21.15.117:0/1441033599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f355ea0 con 0x56228f355440 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77ff1be640 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f77f004e9e0 tx=0x7f77f00236c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 -- 172.21.15.117:0/1441033599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0041e60 con 0x56228f355440 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 -- 172.21.15.117:0/1441033599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f000d5a0 con 0x56228f355440 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56228f356700 con 0x56228f355440 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 -- 172.21.15.117:0/1441033599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f000d8c0 con 0x56228f355440 2024-09-10T06:22:56.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56228f356c70 con 0x56228f355440 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 -- 172.21.15.117:0/1441033599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77f0009070 con 0x56228f355440 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 0x7f76d803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f76e9602640 1 -- 172.21.15.117:0/1441033599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f77f0005050 con 0x56228f355440 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 0x7f76d803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 0x7f76d803be90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005880 tx=0x7f77f4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.561+0000 7f78016b89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56228f330230 con 0x56228f362bf0 2024-09-10T06:22:56.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52116/0 (socket says 172.21.15.117:52116) 2024-09-10T06:22:56.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 -- 172.21.15.117:0/1142855323 learned_addr learned my addr 172.21.15.117:0/1142855323 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 -- 172.21.15.117:0/1142855323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f3635e0 con 0x56228f362bf0 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- 172.21.15.117:0/1142855323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77f0005e20 tx=0x7f77f00177f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f413276a5ab8b0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f76e2ffd640 1 -- 172.21.15.117:0/1142855323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0060070 con 0x56228f362bf0 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f76e2ffd640 1 -- 172.21.15.117:0/1142855323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f00179b0 con 0x56228f362bf0 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f76e2ffd640 1 -- 172.21.15.117:0/1142855323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0057040 con 0x56228f362bf0 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- 172.21.15.117:0/1142855323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 msgr2=0x56228f362ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1142855323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77f0005e20 tx=0x7f77f00177f0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- 172.21.15.117:0/1142855323 shutdown_connections 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1142855323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f362ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- 172.21.15.117:0/1142855323 >> 172.21.15.117:0/1142855323 conn(0x56228f35e010 msgr2=0x56228f35c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- 172.21.15.117:0/1142855323 shutdown_connections 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- 172.21.15.117:0/1142855323 wait complete. 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 Processor -- start 2024-09-10T06:22:56.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- start start 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f78016b89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56228f3619c0 con 0x56228f362bf0 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52122/0 (socket says 172.21.15.117:52122) 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 learned_addr learned my addr 172.21.15.117:0/51736828 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228f369460 con 0x56228f362bf0 2024-09-10T06:22:56.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.565+0000 7f77ff1be640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f77f000d4f0 tx=0x7f77f0031f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 -- 172.21.15.117:0/51736828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0060030 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56228f369460 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 -- 172.21.15.117:0/51736828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f00179b0 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 -- 172.21.15.117:0/51736828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f0005b00 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56228f369a30 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 -- 172.21.15.117:0/51736828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77f006e020 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76c8039a70 0x7f76c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f76e17fa640 1 -- 172.21.15.117:0/51736828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f77f006c020 con 0x56228f362bf0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76c8039a70 0x7f76c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f3740d0 0x56228f376560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f376cb0 con 0x56228f3740d0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f3740d0 0x56228f376560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76c8039a70 0x7f76c803bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77f401b350 tx=0x7f77f40a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f3740d0 0x56228f376560 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 realm 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f3770c0 con 0x56228f3740d0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:56.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f377990 con 0x56228f3740d0 2024-09-10T06:22:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f378860 0x56228f37ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f37b390 con 0x56228f378860 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.569+0000 7f77ff1be640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f378860 0x56228f37ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff1be640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f378860 0x56228f37ac50 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f78016b89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f78016b89c0 20 searching for the correct realm 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f37d330 0x56228f37f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f37fe70 con 0x56228f37d330 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f37d330 0x56228f37f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77fe9bd640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f37d330 0x56228f37f7a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f37fe70 con 0x56228f378860 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff1be640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77f0017050 0x7f77f0034340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f37fe70 con 0x7f77f0017050 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77f0017050 0x7f77f0034340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77f0017050 0x7f77f0034340 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.573+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f378860 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f378860 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.577+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f378860 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.581+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f378860 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f37d330 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x7f77f0017050 2024-09-10T06:22:56.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f3740d0 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56228f377d30 con 0x56228f378860 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f37bc50 con 0x56228f3740d0 2024-09-10T06:22:56.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f37c040 con 0x56228f3740d0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.585+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f37c040 con 0x56228f37d330 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 zone default found 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 4 Realm: () 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:56.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:56.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:56.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 zonegroup default 2024-09-10T06:22:56.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f3802f0 con 0x7f77f0017050 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f381ce0 con 0x56228f37d330 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f382080 con 0x56228f37d330 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 started sync module instance, tier type = 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f381180 con 0x56228f378860 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706431694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f382920 con 0x56228f378860 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f383170 con 0x56228f3740d0 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.589+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94706431694240] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94706431698032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f383170 con 0x56228f3740d0 2024-09-10T06:22:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f383c10 con 0x56228f37d330 2024-09-10T06:22:56.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94706431698032] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94706431700160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3830e0 con 0x56228f37d330 2024-09-10T06:22:56.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.593+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f384960 con 0x56228f378860 2024-09-10T06:22:56.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94706431706592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f385200 con 0x56228f378860 2024-09-10T06:22:56.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f385c00 con 0x56228f3740d0 2024-09-10T06:22:56.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94706431700160] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94706431706592] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94706431705088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f384d50 con 0x56228f3740d0 2024-09-10T06:22:56.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.597+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3864a0 con 0x7f77f0017050 2024-09-10T06:22:56.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.601+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94706431705088] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.601+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.601+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706431710992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f384d50 con 0x7f77f0017050 2024-09-10T06:22:56.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.601+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3869b0 con 0x7f77f0017050 2024-09-10T06:22:56.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.601+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94706431710992] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706431712832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3869b0 con 0x7f77f0017050 2024-09-10T06:22:56.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3873b0 con 0x7f77f0017050 2024-09-10T06:22:56.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94706431712832] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94706431714448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f387370 con 0x7f77f0017050 2024-09-10T06:22:56.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=0 2024-09-10T06:22:56.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=1 2024-09-10T06:22:56.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=2 2024-09-10T06:22:56.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=3 2024-09-10T06:22:56.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=4 2024-09-10T06:22:56.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=5 2024-09-10T06:22:56.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.605+0000 7f78016b89c0 20 add_watcher() i=6 2024-09-10T06:22:56.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94706431714448] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 add_watcher() i=7 2024-09-10T06:22:56.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:56.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f38a800 con 0x56228f3740d0 2024-09-10T06:22:56.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94706431717520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f387d20 con 0x56228f3740d0 2024-09-10T06:22:56.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94706431717520] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f76b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 5 note: GC not initialized 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f76b4fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 Filter name: none 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f762e7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ad8b0 con 0x56228f378860 2024-09-10T06:22:56.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.609+0000 7f78016b89c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:56.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f76b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94706431717520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f3740d0 2024-09-10T06:22:56.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94706431717520] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94706431694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f378860 2024-09-10T06:22:56.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94706431694240] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f78016b89c0 20 remove_watcher() i=0 2024-09-10T06:22:56.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f78016b89c0 2 removed watcher, disabling cache 2024-09-10T06:22:56.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.613+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94706431698032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f3740d0 2024-09-10T06:22:56.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94706431698032] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f78016b89c0 20 remove_watcher() i=1 2024-09-10T06:22:56.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94706431700160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f37d330 2024-09-10T06:22:56.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f77fe9bd640 1 -- 172.21.15.117:0/51736828 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94706431700160] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f40a8070 con 0x56228f37d330 2024-09-10T06:22:56.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f78016b89c0 20 remove_watcher() i=2 2024-09-10T06:22:56.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.617+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94706431706592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f378860 2024-09-10T06:22:56.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f77ff1be640 1 -- 172.21.15.117:0/51736828 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94706431706592] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f0008030 con 0x56228f378860 2024-09-10T06:22:56.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f78016b89c0 20 remove_watcher() i=3 2024-09-10T06:22:56.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94706431705088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x56228f3740d0 2024-09-10T06:22:56.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94706431705088] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x56228f3740d0 2024-09-10T06:22:56.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f78016b89c0 20 remove_watcher() i=4 2024-09-10T06:22:56.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.621+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94706431710992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x7f77f0017050 2024-09-10T06:22:56.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94706431710992] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f78016b89c0 20 remove_watcher() i=5 2024-09-10T06:22:56.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94706431712832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x7f77f0017050 2024-09-10T06:22:56.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94706431712832] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f78016b89c0 20 remove_watcher() i=6 2024-09-10T06:22:56.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.625+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94706431714448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56228f3ab720 con 0x7f77f0017050 2024-09-10T06:22:56.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94706431714448] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f800a4d0 con 0x7f77f0017050 2024-09-10T06:22:56.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 20 remove_watcher() i=7 2024-09-10T06:22:56.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77f0017050 msgr2=0x7f77f0034340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77f0017050 0x7f77f0034340 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f3740d0 msgr2=0x56228f376560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f3740d0 0x56228f376560 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f378860 msgr2=0x56228f37ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f378860 0x56228f37ac50 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f37d330 msgr2=0x56228f37f7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f37d330 0x56228f37f7a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76c8039a70 msgr2=0x7f76c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76c8039a70 0x7f76c803bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f77f401b350 tx=0x7f77f40a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f77ff9bf640 1 -- 172.21.15.117:0/51736828 reap_dead start 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 msgr2=0x56228f368f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f77f000d4f0 tx=0x7f77f0031f00 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 shutdown_connections 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/51736828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f362bf0 0x56228f368f00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 >> 172.21.15.117:0/51736828 conn(0x56228f35e010 msgr2=0x56228f35c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 shutdown_connections 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/51736828 wait complete. 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 msgr2=0x7f76d803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 0x7f76d803be90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005880 tx=0x7f77f4005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 msgr2=0x56228f355860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f77f004e9e0 tx=0x7f77f00236c0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 shutdown_connections 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76d80399d0 0x7f76d803be90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/1441033599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f355440 0x56228f355860 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 >> 172.21.15.117:0/1441033599 conn(0x56228f34adf0 msgr2=0x56228f34b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 shutdown_connections 2024-09-10T06:22:56.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/1441033599 wait complete. 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f33c470 msgr2=0x56228f33e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56228f33c470 0x56228f33e860 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f340f00 msgr2=0x56228f3432f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56228f340f00 0x56228f3432f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f344e00 msgr2=0x56228f3471f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56228f344e00 0x56228f3471f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76e4039a70 msgr2=0x7f76e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76e4039a70 0x7f76e403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77f40ae000 tx=0x7f77f40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 msgr2=0x56228f337400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 --2- 172.21.15.117:0/864176502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56228f2488c0 0x56228f337400 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001ec0 tx=0x7f77f0000ee0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f77ff9bf640 1 -- 172.21.15.117:0/864176502 reap_dead start 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 shutdown_connections 2024-09-10T06:22:56.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 >> 172.21.15.117:0/864176502 conn(0x56228f1b8080 msgr2=0x56228f32a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 shutdown_connections 2024-09-10T06:22:56.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.629+0000 7f78016b89c0 1 -- 172.21.15.117:0/864176502 wait complete. 2024-09-10T06:22:56.644 INFO:teuthology.orchestra.run.smithi117.stdout:{"key":"bucket:myfoo","ver":{"tag":"_1Qi_OvoUt0ADYKtHQv-XpOC","ver":2},"mtime":"2024-09-10T06:22:56.237545Z","data":{"bucket":{"name":"myfoo","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","bucket_id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-10T06:22:54.613572Z","linked":false,"has_bucket_info":false}} 2024-09-10T06:22:56.644 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_1Qi_OvoUt0ADYKtHQv-XpOC', 'ver': 2}, 'mtime': '2024-09-10T06:22:56.237545Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'bucket_id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-10T06:22:54.613572Z', 'linked': False, 'has_bucket_info': False}} 2024-09-10T06:22:56.644 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1'] 2024-09-10T06:22:56.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1'] 2024-09-10T06:22:56.645 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f6bb6d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc0bd3a700 0x55cc0bd3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f6bb6d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc0bbec9c0 con 0x55cc0bd3d840 2024-09-10T06:22:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f6bb6d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55cc0bc3c6d0 con 0x55cc0bd3a700 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f69673640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc0bd3a700 0x55cc0bd3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f69673640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc0bd3a700 0x55cc0bd3aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52132/0 (socket says 172.21.15.117:52132) 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f69673640 1 -- 172.21.15.117:0/3033424631 learned_addr learned my addr 172.21.15.117:0/3033424631 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f68e72640 1 --1- 172.21.15.117:0/3033424631 >> v1:172.21.15.84:6789/0 conn(0x55cc0bd3d840 0x55cc0bd3fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52490/0 (socket says 172.21.15.117:52490) 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f69673640 1 -- 172.21.15.117:0/3033424631 >> v1:172.21.15.84:6789/0 conn(0x55cc0bd3d840 legacy=0x55cc0bd3fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.725+0000 7f8f69673640 1 -- 172.21.15.117:0/3033424631 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0bbe0ca0 con 0x55cc0bd3a700 2024-09-10T06:22:56.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f69673640 1 --2- 172.21.15.117:0/3033424631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0bd3aae0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00a5c0 tx=0x7f8f5c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7c8c8157e836fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f63fff640 1 -- 172.21.15.117:0/3033424631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0a6070 con 0x55cc0bd3a700 2024-09-10T06:22:56.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f63fff640 1 -- 172.21.15.117:0/3033424631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0af070 con 0x55cc0bd3a700 2024-09-10T06:22:56.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f63fff640 1 -- 172.21.15.117:0/3033424631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0aa5c0 con 0x55cc0bd3a700 2024-09-10T06:22:56.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3033424631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 msgr2=0x55cc0bd3aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3033424631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0bd3aae0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00a5c0 tx=0x7f8f5c01b340 comp rx=0 tx=0).stop 2024-09-10T06:22:56.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3033424631 shutdown_connections 2024-09-10T06:22:56.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3033424631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0bd3aae0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3033424631 >> 172.21.15.117:0/3033424631 conn(0x55cc0bcae010 msgr2=0x55cc0bcae420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3033424631 shutdown_connections 2024-09-10T06:22:56.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.729+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3033424631 wait complete. 2024-09-10T06:22:56.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc0bc40680 con 0x55cc0bd3a700 2024-09-10T06:22:56.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52134/0 (socket says 172.21.15.117:52134) 2024-09-10T06:22:56.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f69673640 1 -- 172.21.15.117:0/912315191 learned_addr learned my addr 172.21.15.117:0/912315191 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f69673640 1 -- 172.21.15.117:0/912315191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0bbbbda0 con 0x55cc0bd3a700 2024-09-10T06:22:56.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f69673640 1 --2- 172.21.15.117:0/912315191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ac040 tx=0x7f8f5c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eca1906b13bed63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8e57606640 1 -- 172.21.15.117:0/912315191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0aa970 con 0x55cc0bd3a700 2024-09-10T06:22:56.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8e57606640 1 -- 172.21.15.117:0/912315191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0aab10 con 0x55cc0bd3a700 2024-09-10T06:22:56.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8e57606640 1 -- 172.21.15.117:0/912315191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0aae30 con 0x55cc0bd3a700 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/912315191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 msgr2=0x55cc0be25ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/912315191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ac040 tx=0x7f8f5c003030 comp rx=0 tx=0).stop 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/912315191 shutdown_connections 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/912315191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be25ab0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/912315191 >> 172.21.15.117:0/912315191 conn(0x55cc0bcae010 msgr2=0x55cc0be21750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/912315191 shutdown_connections 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.745+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/912315191 wait complete. 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be2cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc0bbe2a50 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be2cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be2cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52144/0 (socket says 172.21.15.117:52144) 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69673640 1 -- 172.21.15.117:0/3328043506 learned_addr learned my addr 172.21.15.117:0/3328043506 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69673640 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0be2d520 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69673640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be2cfc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c01b170 tx=0x7f8f5c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 -- 172.21.15.117:0/3328043506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0cb020 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0be2d7b0 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 -- 172.21.15.117:0/3328043506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0c6650 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 -- 172.21.15.117:0/3328043506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0c6950 con 0x55cc0bd3a700 2024-09-10T06:22:56.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0be2e110 con 0x55cc0bd3a700 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 -- 172.21.15.117:0/3328043506 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f5c0ce020 con 0x55cc0bd3a700 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e50039a70 0x7f8e5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8e55e03640 1 -- 172.21.15.117:0/3328043506 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f5c0eba70 con 0x55cc0bd3a700 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f68e72640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e50039a70 0x7f8e5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0bd3d840 0x55cc0be340e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be34620 con 0x55cc0bd3d840 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.749+0000 7f8f69e74640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0bd3d840 0x55cc0be340e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f68e72640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e50039a70 0x7f8e5003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001e90 tx=0x7f8f540013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69e74640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0bd3d840 0x55cc0be340e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69e74640 1 -- 172.21.15.117:0/3328043506 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0bd3d840 2024-09-10T06:22:56.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be34a70 con 0x55cc0bd3d840 2024-09-10T06:22:56.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69e74640 1 -- 172.21.15.117:0/3328043506 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0bd3d840 2024-09-10T06:22:56.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be36880 0x55cc0be38c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be39360 con 0x55cc0be36880 2024-09-10T06:22:56.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69673640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be36880 0x55cc0be38c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69673640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be36880 0x55cc0be38c70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69673640 1 -- 172.21.15.117:0/3328043506 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be36880 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be35720 con 0x55cc0bd3d840 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f69e74640 1 -- 172.21.15.117:0/3328043506 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0bd3d840 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be3a7c0 0x55cc0be3cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be3d2f0 con 0x55cc0be3a7c0 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f68e72640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be3a7c0 0x55cc0be3cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f68e72640 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be3a7c0 0x55cc0be3cbb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f68e72640 1 -- 172.21.15.117:0/3328043506 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f5400f6e0 con 0x55cc0be3a7c0 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.753+0000 7f8f6bb6d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc0bc4d450 con 0x55cc0be4adf0 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52152/0 (socket says 172.21.15.117:52152) 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 -- 172.21.15.117:0/780399924 learned_addr learned my addr 172.21.15.117:0/780399924 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 -- 172.21.15.117:0/780399924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0be4b850 con 0x55cc0be4adf0 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0b3fd0 tx=0x7f8f5c00a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 -- 172.21.15.117:0/780399924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0cf5c0 con 0x55cc0be4adf0 2024-09-10T06:22:56.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 -- 172.21.15.117:0/780399924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0ebe50 con 0x55cc0be4adf0 2024-09-10T06:22:56.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0be4c0b0 con 0x55cc0be4adf0 2024-09-10T06:22:56.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 -- 172.21.15.117:0/780399924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0cf890 con 0x55cc0be4adf0 2024-09-10T06:22:56.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0be4c620 con 0x55cc0be4adf0 2024-09-10T06:22:56.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 -- 172.21.15.117:0/780399924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f5c0f2060 con 0x55cc0be4adf0 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 0x7f8e4003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8e4effd640 1 -- 172.21.15.117:0/780399924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f5c0e6070 con 0x55cc0be4adf0 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f68e72640 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 0x7f8e4003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f68e72640 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 0x7f8e4003bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55cc0be2e430 tx=0x7f8f5400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f6bb6d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc0be26220 con 0x55cc0be58550 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52166/0 (socket says 172.21.15.117:52166) 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.757+0000 7f8f69673640 1 -- 172.21.15.117:0/3181212507 learned_addr learned my addr 172.21.15.117:0/3181212507 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 -- 172.21.15.117:0/3181212507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0be58f20 con 0x55cc0be58550 2024-09-10T06:22:56.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 --2- 172.21.15.117:0/3181212507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0dbd90 tx=0x7f8f5c0dbd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c0b306cf50be6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e4cff9640 1 -- 172.21.15.117:0/3181212507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c102020 con 0x55cc0be58550 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e4cff9640 1 -- 172.21.15.117:0/3181212507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0dbe00 con 0x55cc0be58550 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e4cff9640 1 -- 172.21.15.117:0/3181212507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0b3c70 con 0x55cc0be58550 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3181212507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 msgr2=0x55cc0be58930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3181212507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0dbd90 tx=0x7f8f5c0dbd00 comp rx=0 tx=0).stop 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3181212507 shutdown_connections 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3181212507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be58930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3181212507 >> 172.21.15.117:0/3181212507 conn(0x55cc0be53910 msgr2=0x55cc0be51b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3181212507 shutdown_connections 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3181212507 wait complete. 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 Processor -- start 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- start start 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc0be58f20 con 0x55cc0be58550 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52178/0 (socket says 172.21.15.117:52178) 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 learned_addr learned my addr 172.21.15.117:0/119804748 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0be5ec10 con 0x55cc0be58550 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f69673640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0dbd90 tx=0x7f8f5c0c54f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e3effd640 1 -- 172.21.15.117:0/119804748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0dbe00 con 0x55cc0be58550 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0be5ec10 con 0x55cc0be58550 2024-09-10T06:22:56.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e3effd640 1 -- 172.21.15.117:0/119804748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0eb1c0 con 0x55cc0be58550 2024-09-10T06:22:56.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0be5ec10 con 0x55cc0be58550 2024-09-10T06:22:56.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.761+0000 7f8e3effd640 1 -- 172.21.15.117:0/119804748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0b36e0 con 0x55cc0be58550 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8e3effd640 1 -- 172.21.15.117:0/119804748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f5c105020 con 0x55cc0be58550 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8e3effd640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e34039c10 0x7f8e3403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8e3effd640 1 -- 172.21.15.117:0/119804748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f8f5c10e050 con 0x55cc0be58550 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f68e72640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e34039c10 0x7f8e3403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0be696d0 0x55cc0be6bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6c2e0 con 0x55cc0be696d0 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0be696d0 0x55cc0be6bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f68e72640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e34039c10 0x7f8e3403c0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55cc0be3d6f0 tx=0x7f8f54010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0be696d0 0x55cc0be6bb90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 realm 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6c6f0 con 0x55cc0be696d0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6cfc0 con 0x55cc0be696d0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be6e0c0 0x55cc0be704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be70ac0 con 0x55cc0be6e0c0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69673640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be6e0c0 0x55cc0be704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.765+0000 7f8f69673640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be6e0c0 0x55cc0be704b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:56.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f6bb6d9c0 20 searching for the correct realm 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be72a10 0x55cc0be74e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be754a0 con 0x55cc0be72a10 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f68e72640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be72a10 0x55cc0be74e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f68e72640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be72a10 0x55cc0be74e20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be754a0 con 0x55cc0be6e0c0 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69673640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8f5c107040 0x7f8f5c0df790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be754a0 con 0x7f8f5c107040 2024-09-10T06:22:56.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8f5c107040 0x7f8f5c0df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8f5c107040 0x7f8f5c0df790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.769+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be6e0c0 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be6e0c0 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.773+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be6e0c0 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.777+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be6e0c0 2024-09-10T06:22:56.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be72a10 2024-09-10T06:22:56.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x7f8f5c107040 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be696d0 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be6d360 con 0x55cc0be6e0c0 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:56.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be71380 con 0x55cc0be696d0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be71770 con 0x55cc0be696d0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.781+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be71770 con 0x55cc0be72a10 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:56.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 zone default found 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 4 Realm: () 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 zonegroup default 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be75920 con 0x7f8f5c107040 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be77410 con 0x55cc0be72a10 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be77900 con 0x55cc0be72a10 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 started sync module instance, tier type = 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:56.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be71cc0 con 0x55cc0be6e0c0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334861404288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be77d60 con 0x55cc0be6e0c0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.785+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be78820 con 0x55cc0be696d0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.789+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334861404288] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.789+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.789+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334861411056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be78c10 con 0x55cc0be696d0 2024-09-10T06:22:56.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.789+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be795d0 con 0x55cc0be72a10 2024-09-10T06:22:56.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.789+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334861411056] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334861414688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be799c0 con 0x55cc0be72a10 2024-09-10T06:22:56.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7a380 con 0x55cc0be6e0c0 2024-09-10T06:22:56.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334861420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7b040 con 0x55cc0be6e0c0 2024-09-10T06:22:56.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7ba00 con 0x55cc0be696d0 2024-09-10T06:22:56.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334861414688] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334861420400] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334861405536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7ba00 con 0x55cc0be696d0 2024-09-10T06:22:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.793+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7c250 con 0x7f8f5c107040 2024-09-10T06:22:56.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.797+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334861405536] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.797+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.797+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334861424224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7bff0 con 0x7f8f5c107040 2024-09-10T06:22:56.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.797+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7caf0 con 0x7f8f5c107040 2024-09-10T06:22:56.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.801+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334861424224] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334861428192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7cab0 con 0x7f8f5c107040 2024-09-10T06:22:56.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7d4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334861430720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7d940 con 0x7f8f5c107040 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=0 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=1 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=2 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=3 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=4 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=5 2024-09-10T06:22:56.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334861428192] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=6 2024-09-10T06:22:56.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334861430720] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.805+0000 7f8f6bb6d9c0 20 add_watcher() i=7 2024-09-10T06:22:56.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:56.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7ba80 con 0x55cc0be696d0 2024-09-10T06:22:56.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334861425280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be7de50 con 0x55cc0be696d0 2024-09-10T06:22:56.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334861425280] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8e1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:56.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:56.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 5 note: GC not initialized 2024-09-10T06:22:56.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8e1e7e4640 20 reqs_thread_entry: start 2024-09-10T06:22:56.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:56.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 20 Filter name: none 2024-09-10T06:22:56.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8d8ffff640 20 reqs_thread_entry: start 2024-09-10T06:22:56.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:56.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.809+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea3ff0 con 0x7f8f5c107040 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea60e0 con 0x55cc0be6e0c0 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea7b70 con 0x55cc0be696d0 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:56.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:56.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beac170 con 0x55cc0be6e0c0 2024-09-10T06:22:56.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 foo.buckets [call] v30'21 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.813+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beb24a0 con 0x55cc0be696d0 2024-09-10T06:22:56.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f6bb6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:56.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f6bb6d9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:56.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f6bb6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:56.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f6bb6d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:56.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94334861607472 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beaca50 con 0x7f8f5c107040 2024-09-10T06:22:56.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== watch-notify(notify (1) cookie 94334861424224 notify 128849018884 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55cc0bea7f60 con 0x7f8f5c107040 2024-09-10T06:22:56.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8e4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94334861424224 notifier 4498 bl.length()=760 2024-09-10T06:22:56.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8e4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:56.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8e4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(67 notify.5 [notify cookie 94334861607472 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8e4cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8e4cff9640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8e2c003eb0 con 0x7f8f5c107040 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.817+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== watch-notify(notify_complete (2) cookie 94334861607472 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc0bea70a0 con 0x7f8f5c107040 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:56.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beac560 con 0x7f8f5c107040 2024-09-10T06:22:56.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.821+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beaf890 con 0x55cc0be6e0c0 2024-09-10T06:22:56.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'22 uv22 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f6bb6d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f6bb6d9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f6bb6d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94334861607440 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc0beafe90 con 0x7f8f5c107040 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== watch-notify(notify (1) cookie 94334861428192 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f8f64034410 con 0x7f8f5c107040 2024-09-10T06:22:56.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8e4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94334861428192 notifier 4498 bl.length()=314 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(71 notify.6 [notify cookie 94334861607440 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8e4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8e4cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8e4cff9640 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8e2c003eb0 con 0x7f8f5c107040 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.825+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== watch-notify(notify_complete (2) cookie 94334861607440 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f640345e0 con 0x7f8f5c107040 2024-09-10T06:22:56.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8e1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:56.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334861425280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea1d20 con 0x55cc0be696d0 2024-09-10T06:22:56.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94334861425280] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334861404288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea1d20 con 0x55cc0be6e0c0 2024-09-10T06:22:56.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94334861404288] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f6bb6d9c0 20 remove_watcher() i=0 2024-09-10T06:22:56.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f6bb6d9c0 2 removed watcher, disabling cache 2024-09-10T06:22:56.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.829+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334861411056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea1d20 con 0x55cc0be696d0 2024-09-10T06:22:56.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94334861411056] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f6bb6d9c0 20 remove_watcher() i=1 2024-09-10T06:22:56.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334861414688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0bea1d20 con 0x55cc0be72a10 2024-09-10T06:22:56.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f68e72640 1 -- 172.21.15.117:0/119804748 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94334861414688] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54037040 con 0x55cc0be72a10 2024-09-10T06:22:56.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f6bb6d9c0 20 remove_watcher() i=2 2024-09-10T06:22:56.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.833+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334861420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be79120 con 0x55cc0be6e0c0 2024-09-10T06:22:56.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f69673640 1 -- 172.21.15.117:0/119804748 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94334861420400] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0bd910 con 0x55cc0be6e0c0 2024-09-10T06:22:56.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f6bb6d9c0 20 remove_watcher() i=3 2024-09-10T06:22:56.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334861405536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be782f0 con 0x55cc0be696d0 2024-09-10T06:22:56.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94334861405536] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x55cc0be696d0 2024-09-10T06:22:56.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f6bb6d9c0 20 remove_watcher() i=4 2024-09-10T06:22:56.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.837+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334861424224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be782f0 con 0x7f8f5c107040 2024-09-10T06:22:56.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94334861424224] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f6bb6d9c0 20 remove_watcher() i=5 2024-09-10T06:22:56.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334861428192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be782f0 con 0x7f8f5c107040 2024-09-10T06:22:56.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94334861428192] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f6bb6d9c0 20 remove_watcher() i=6 2024-09-10T06:22:56.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.841+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334861430720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc0be782f0 con 0x7f8f5c107040 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94334861430720] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f6400a4d0 con 0x7f8f5c107040 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 20 remove_watcher() i=7 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8f5c107040 msgr2=0x7f8f5c0df790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8f5c107040 0x7f8f5c0df790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0be696d0 msgr2=0x55cc0be6bb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0be696d0 0x55cc0be6bb90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be6e0c0 msgr2=0x55cc0be704b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be6e0c0 0x55cc0be704b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be72a10 msgr2=0x55cc0be74e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be72a10 0x55cc0be74e20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e34039c10 msgr2=0x7f8e3403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e34039c10 0x7f8e3403c0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55cc0be3d6f0 tx=0x7f8f54010000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 msgr2=0x55cc0be5e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0dbd90 tx=0x7f8f5c0c54f0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f69e74640 1 -- 172.21.15.117:0/119804748 reap_dead start 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 shutdown_connections 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/119804748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be58550 0x55cc0be5e6b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 >> 172.21.15.117:0/119804748 conn(0x55cc0be53910 msgr2=0x55cc0be51b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 shutdown_connections 2024-09-10T06:22:56.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/119804748 wait complete. 2024-09-10T06:22:56.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 msgr2=0x7f8e4003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 0x7f8e4003bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55cc0be2e430 tx=0x7f8f5400f000 comp rx=0 tx=0).stop 2024-09-10T06:22:56.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 msgr2=0x55cc0be4b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0b3fd0 tx=0x7f8f5c00a3a0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 shutdown_connections 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e40039a70 0x7f8e4003bf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/780399924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0be4adf0 0x55cc0be4b210 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 >> 172.21.15.117:0/780399924 conn(0x55cc0be407a0 msgr2=0x55cc0be40b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 shutdown_connections 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/780399924 wait complete. 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0bd3d840 msgr2=0x55cc0be340e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc0bd3d840 0x55cc0be340e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be36880 msgr2=0x55cc0be38c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc0be36880 0x55cc0be38c70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be3a7c0 msgr2=0x55cc0be3cbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc0be3a7c0 0x55cc0be3cbb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e50039a70 msgr2=0x7f8e5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8e50039a70 0x7f8e5003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001e90 tx=0x7f8f540013f0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 msgr2=0x55cc0be2cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 --2- 172.21.15.117:0/3328043506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc0bd3a700 0x55cc0be2cfc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c01b170 tx=0x7f8f5c0180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f69e74640 1 -- 172.21.15.117:0/3328043506 reap_dead start 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 shutdown_connections 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 >> 172.21.15.117:0/3328043506 conn(0x55cc0bcae010 msgr2=0x55cc0be201e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 shutdown_connections 2024-09-10T06:22:56.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.845+0000 7f8f6bb6d9c0 1 -- 172.21.15.117:0/3328043506 wait complete. 2024-09-10T06:22:56.860 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:56.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:56.860 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T06:22:56.936 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:56.937 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:56.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4318f339c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x560bee7918c0 0x560bee793cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4318f339c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560bee6419c0 con 0x560bee701770 2024-09-10T06:22:56.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4318f339c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x560bee6916d0 con 0x560bee7918c0 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x560bee7918c0 0x560bee793cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x560bee7918c0 0x560bee793cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52182/0 (socket says 172.21.15.117:52182) 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 -- 172.21.15.117:0/1630381404 learned_addr learned my addr 172.21.15.117:0/1630381404 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316a39640 1 --1- 172.21.15.117:0/1630381404 >> v1:172.21.15.84:6789/0 conn(0x560bee701770 0x560bee7901a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52502/0 (socket says 172.21.15.117:52502) 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 -- 172.21.15.117:0/1630381404 >> v1:172.21.15.84:6789/0 conn(0x560bee701770 legacy=0x560bee7901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 -- 172.21.15.117:0/1630381404 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee635ca0 con 0x560bee7918c0 2024-09-10T06:22:56.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.937+0000 7f4316238640 1 --2- 172.21.15.117:0/1630381404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee7918c0 0x560bee793cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f430000a5c0 tx=0x7f430001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ebbae7e2ca1bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4315a37640 1 -- 172.21.15.117:0/1630381404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43000b1070 con 0x560bee7918c0 2024-09-10T06:22:56.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4315a37640 1 -- 172.21.15.117:0/1630381404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43000a8070 con 0x560bee7918c0 2024-09-10T06:22:56.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4315a37640 1 -- 172.21.15.117:0/1630381404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43000ac5b0 con 0x560bee7918c0 2024-09-10T06:22:56.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 -- 172.21.15.117:0/1630381404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee7918c0 msgr2=0x560bee793cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 --2- 172.21.15.117:0/1630381404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee7918c0 0x560bee793cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f430000a5c0 tx=0x7f430001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:56.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 -- 172.21.15.117:0/1630381404 shutdown_connections 2024-09-10T06:22:56.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 --2- 172.21.15.117:0/1630381404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee7918c0 0x560bee793cb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 -- 172.21.15.117:0/1630381404 >> 172.21.15.117:0/1630381404 conn(0x560bee787e90 msgr2=0x560bee78a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 -- 172.21.15.117:0/1630381404 shutdown_connections 2024-09-10T06:22:56.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.941+0000 7f4318f339c0 1 -- 172.21.15.117:0/1630381404 wait complete. 2024-09-10T06:22:56.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bee695680 con 0x560bee701770 2024-09-10T06:22:56.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52198/0 (socket says 172.21.15.117:52198) 2024-09-10T06:22:56.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4316a39640 1 -- 172.21.15.117:0/2597556293 learned_addr learned my addr 172.21.15.117:0/2597556293 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4316a39640 1 -- 172.21.15.117:0/2597556293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee610da0 con 0x560bee701770 2024-09-10T06:22:56.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4316a39640 1 --2- 172.21.15.117:0/2597556293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4308001680 tx=0x7f4308001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4375676293d895c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4204e09640 1 -- 172.21.15.117:0/2597556293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308013420 con 0x560bee701770 2024-09-10T06:22:56.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4204e09640 1 -- 172.21.15.117:0/2597556293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43080135c0 con 0x560bee701770 2024-09-10T06:22:56.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4204e09640 1 -- 172.21.15.117:0/2597556293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43080138e0 con 0x560bee701770 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 -- 172.21.15.117:0/2597556293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 msgr2=0x560bee8788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.957+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2597556293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4308001680 tx=0x7f4308001b40 comp rx=0 tx=0).stop 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/2597556293 shutdown_connections 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2597556293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee8788d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/2597556293 >> 172.21.15.117:0/2597556293 conn(0x560bee787e90 msgr2=0x560bee874570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/2597556293 shutdown_connections 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/2597556293 wait complete. 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee87ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bee637a50 con 0x560bee701770 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee87ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee87ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52210/0 (socket says 172.21.15.117:52210) 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4316a39640 1 -- 172.21.15.117:0/913078192 learned_addr learned my addr 172.21.15.117:0/913078192 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4316a39640 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee8804d0 con 0x560bee701770 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4316a39640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee87ff70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x560bee8798c0 tx=0x7f4308000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4203606640 1 -- 172.21.15.117:0/913078192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43080037a0 con 0x560bee701770 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4203606640 1 -- 172.21.15.117:0/913078192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308023070 con 0x560bee701770 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4203606640 1 -- 172.21.15.117:0/913078192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308003ad0 con 0x560bee701770 2024-09-10T06:22:56.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bee880760 con 0x560bee701770 2024-09-10T06:22:56.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bee881110 con 0x560bee701770 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4203606640 1 -- 172.21.15.117:0/913078192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4308010070 con 0x560bee701770 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.961+0000 7f4203606640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41fc039a70 0x7f41fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4203606640 1 -- 172.21.15.117:0/913078192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4308050160 con 0x560bee701770 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316238640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41fc039a70 0x7f41fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee7918c0 0x560bee8870e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee887620 con 0x560bee7918c0 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f431723a640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee7918c0 0x560bee8870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316238640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41fc039a70 0x7f41fc03bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae000 tx=0x7f43000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f431723a640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee7918c0 0x560bee8870e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f431723a640 1 -- 172.21.15.117:0/913078192 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43100083f0 con 0x560bee7918c0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee887a70 con 0x560bee7918c0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f431723a640 1 -- 172.21.15.117:0/913078192 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43100083f0 con 0x560bee7918c0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee889880 0x560bee88bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee88c340 con 0x560bee889880 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316a39640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee889880 0x560bee88bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316a39640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee889880 0x560bee88bc70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316a39640 1 -- 172.21.15.117:0/913078192 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f430800f030 con 0x560bee889880 2024-09-10T06:22:56.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8886f0 con 0x560bee7918c0 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f431723a640 1 -- 172.21.15.117:0/913078192 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43100083f0 con 0x560bee7918c0 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee88d780 0x560bee88fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8902e0 con 0x560bee88d780 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316238640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee88d780 0x560bee88fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316238640 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee88d780 0x560bee88fb70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.965+0000 7f4316238640 1 -- 172.21.15.117:0/913078192 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43000b4040 con 0x560bee88d780 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bee6a2450 con 0x560bee89dd60 2024-09-10T06:22:56.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52214/0 (socket says 172.21.15.117:52214) 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316a39640 1 -- 172.21.15.117:0/2921374476 learned_addr learned my addr 172.21.15.117:0/2921374476 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316a39640 1 -- 172.21.15.117:0/2921374476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee89e7c0 con 0x560bee89dd60 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316a39640 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f43080500d0 tx=0x7f430801d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 -- 172.21.15.117:0/2921374476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308035070 con 0x560bee89dd60 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bee89f020 con 0x560bee89dd60 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 -- 172.21.15.117:0/2921374476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308019040 con 0x560bee89dd60 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 -- 172.21.15.117:0/2921374476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308011550 con 0x560bee89dd60 2024-09-10T06:22:56.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bee89f590 con 0x560bee89dd60 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 -- 172.21.15.117:0/2921374476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4308038070 con 0x560bee89dd60 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 0x7f41f003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4200e01640 1 -- 172.21.15.117:0/2921374476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f4308051b30 con 0x560bee89dd60 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316238640 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 0x7f41f003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4318f339c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bee879120 con 0x560bee78c160 2024-09-10T06:22:56.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.969+0000 7f4316238640 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 0x7f41f003bee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c10 tx=0x7f4300005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52228/0 (socket says 172.21.15.117:52228) 2024-09-10T06:22:56.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 -- 172.21.15.117:0/1313941856 learned_addr learned my addr 172.21.15.117:0/1313941856 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 -- 172.21.15.117:0/1313941856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee78caa0 con 0x560bee78c160 2024-09-10T06:22:56.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- 172.21.15.117:0/1313941856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f430804d420 tx=0x7f4308041680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd34a63f2256143 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f41fa7fc640 1 -- 172.21.15.117:0/1313941856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f430805e020 con 0x560bee78c160 2024-09-10T06:22:56.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f41fa7fc640 1 -- 172.21.15.117:0/1313941856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430803ad00 con 0x560bee78c160 2024-09-10T06:22:56.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f41fa7fc640 1 -- 172.21.15.117:0/1313941856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308027750 con 0x560bee78c160 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/1313941856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 msgr2=0x560bee78c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 --2- 172.21.15.117:0/1313941856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f430804d420 tx=0x7f4308041680 comp rx=0 tx=0).stop 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/1313941856 shutdown_connections 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 --2- 172.21.15.117:0/1313941856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee78c560 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/1313941856 >> 172.21.15.117:0/1313941856 conn(0x560bee8a6930 msgr2=0x560bee8a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/1313941856 shutdown_connections 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/1313941856 wait complete. 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 Processor -- start 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- start start 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bee78d070 con 0x560bee78c160 2024-09-10T06:22:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52236/0 (socket says 172.21.15.117:52236) 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 learned_addr learned my addr 172.21.15.117:0/30832032 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bee8b3f90 con 0x560bee78c160 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4316a39640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4308041fd0 tx=0x7f4308035f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f41f8ff9640 1 -- 172.21.15.117:0/30832032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4308072070 con 0x560bee78c160 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.973+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560bee8b3f90 con 0x560bee78c160 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f41f8ff9640 1 -- 172.21.15.117:0/30832032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430803ad00 con 0x560bee78c160 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bee8b3f90 con 0x560bee78c160 2024-09-10T06:22:56.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f41f8ff9640 1 -- 172.21.15.117:0/30832032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43080417e0 con 0x560bee78c160 2024-09-10T06:22:56.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f41f8ff9640 1 -- 172.21.15.117:0/30832032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4308075070 con 0x560bee78c160 2024-09-10T06:22:56.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f41f8ff9640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41e0039ac0 0x7f41e003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f41f8ff9640 1 -- 172.21.15.117:0/30832032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f430806a070 con 0x560bee78c160 2024-09-10T06:22:56.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4316238640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41e0039ac0 0x7f41e003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee8beae0 0x560bee8c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c16f0 con 0x560bee8beae0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee8beae0 0x560bee8c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4316238640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41e0039ac0 0x7f41e003bf80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43000af040 tx=0x7f43000a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee8beae0 0x560bee8c0fa0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43100083f0 con 0x560bee8beae0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 realm 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c1b00 con 0x560bee8beae0 2024-09-10T06:22:56.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43100083f0 con 0x560bee8beae0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c23d0 con 0x560bee8beae0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43100083f0 con 0x560bee8beae0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43100083f0 con 0x560bee8beae0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:56.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee8c34d0 0x560bee8c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c5e80 con 0x560bee8c34d0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.977+0000 7f4316a39640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee8c34d0 0x560bee8c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316a39640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee8c34d0 0x560bee8c58c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4318f339c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4318f339c0 20 searching for the correct realm 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee8c7dd0 0x560bee8ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ca8b0 con 0x560bee8c7dd0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316238640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee8c7dd0 0x560bee8ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316238640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee8c7dd0 0x560bee8ca1e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ca8b0 con 0x560bee8c34d0 2024-09-10T06:22:56.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:56.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316a39640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4308077060 0x7f4308063a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:56.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ca8b0 con 0x7f4308077060 2024-09-10T06:22:56.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4308077060 0x7f4308063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4308077060 0x7f4308063a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43100083f0 con 0x7f4308077060 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43100083f0 con 0x560bee8beae0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.981+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c34d0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c34d0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.985+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c34d0 2024-09-10T06:22:56.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.989+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c34d0 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c7dd0 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x7f4308077060 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8beae0 2024-09-10T06:22:57.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c2770 con 0x560bee8c34d0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c6740 con 0x560bee8beae0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.993+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c6b30 con 0x560bee8beae0 2024-09-10T06:22:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8c6b30 con 0x560bee8c7dd0 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 zone default found 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 4 Realm: () 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 zonegroup default 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cad30 con 0x7f4308077060 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cc820 con 0x560bee8c7dd0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ccc90 con 0x560bee8c7dd0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 started sync module instance, tier type = 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cbbc0 con 0x560bee8c34d0 2024-09-10T06:22:57.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609246830512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cd580 con 0x560bee8c34d0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:56.997+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cddd0 con 0x560bee8beae0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.001+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609246830512] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.001+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.001+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609246834896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cddd0 con 0x560bee8beae0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.001+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ce880 con 0x560bee8c7dd0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609246839648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cf120 con 0x560bee8c7dd0 2024-09-10T06:22:57.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cfb40 con 0x560bee8c34d0 2024-09-10T06:22:57.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609246834896] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609246844464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cff30 con 0x560bee8c34d0 2024-09-10T06:22:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d08f0 con 0x560bee8beae0 2024-09-10T06:22:57.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609246839648] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609246844464] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609246837024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d0440 con 0x560bee8beae0 2024-09-10T06:22:57.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.005+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d0c90 con 0x7f4308077060 2024-09-10T06:22:57.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.009+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609246837024] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.009+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.009+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609246848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1080 con 0x7f4308077060 2024-09-10T06:22:57.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.009+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d18d0 con 0x7f4308077060 2024-09-10T06:22:57.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609246851200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d19f0 con 0x7f4308077060 2024-09-10T06:22:57.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d24e0 con 0x7f4308077060 2024-09-10T06:22:57.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609246848064] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609246851200] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609246852256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d24a0 con 0x7f4308077060 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=0 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=1 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=2 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=3 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=4 2024-09-10T06:22:57.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=5 2024-09-10T06:22:57.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.013+0000 7f4318f339c0 20 add_watcher() i=6 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609246852256] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 20 add_watcher() i=7 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d0860 con 0x560bee8beae0 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609246855088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d2c40 con 0x560bee8beae0 2024-09-10T06:22:57.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609246855088] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f41cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:57.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:57.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.017+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ddd30 con 0x560bee8beae0 2024-09-10T06:22:57.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.021+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.021+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ddd30 con 0x7f4308077060 2024-09-10T06:22:57.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8de790 con 0x560bee8c7dd0 2024-09-10T06:22:57.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df080 con 0x560bee8beae0 2024-09-10T06:22:57.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.025+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df5f0 con 0x560bee8c34d0 2024-09-10T06:22:57.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df5f0 con 0x560bee8c7dd0 2024-09-10T06:22:57.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df9d0 con 0x560bee8beae0 2024-09-10T06:22:57.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.029+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df9a0 con 0x7f4308077060 2024-09-10T06:22:57.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.033+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.033+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8df9c0 con 0x560bee8c34d0 2024-09-10T06:22:57.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfb90 con 0x560bee8c7dd0 2024-09-10T06:22:57.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0010 con 0x560bee8c34d0 2024-09-10T06:22:57.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.037+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0010 con 0x7f4308077060 2024-09-10T06:22:57.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.041+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.041+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0010 con 0x560bee8c34d0 2024-09-10T06:22:57.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.041+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.041+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfff0 con 0x7f4308077060 2024-09-10T06:22:57.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.045+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.045+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfeb0 con 0x560bee8beae0 2024-09-10T06:22:57.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.045+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.045+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfe90 con 0x560bee8c7dd0 2024-09-10T06:22:57.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfe90 con 0x560bee8c34d0 2024-09-10T06:22:57.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dfe90 con 0x560bee8c7dd0 2024-09-10T06:22:57.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.049+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dff80 con 0x560bee8beae0 2024-09-10T06:22:57.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.053+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.053+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dff80 con 0x560bee8beae0 2024-09-10T06:22:57.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.053+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.053+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dff80 con 0x560bee8c7dd0 2024-09-10T06:22:57.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dff80 con 0x560bee8c34d0 2024-09-10T06:22:57.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dffc0 con 0x560bee8c7dd0 2024-09-10T06:22:57.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0000 con 0x560bee8c7dd0 2024-09-10T06:22:57.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.057+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.061+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0040 con 0x560bee8c7dd0 2024-09-10T06:22:57.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.061+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.061+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0040 con 0x560bee8c7dd0 2024-09-10T06:22:57.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.061+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.061+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0080 con 0x7f4308077060 2024-09-10T06:22:57.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.065+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.065+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e00c0 con 0x560bee8c7dd0 2024-09-10T06:22:57.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.065+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.065+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e00c0 con 0x7f4308077060 2024-09-10T06:22:57.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.069+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.069+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e00c0 con 0x560bee8c7dd0 2024-09-10T06:22:57.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.069+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.069+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e00c0 con 0x7f4308077060 2024-09-10T06:22:57.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8e0100 con 0x560bee8c34d0 2024-09-10T06:22:57.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4147fff640 20 reqs_thread_entry: start 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 20 Filter name: none 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4145ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:57.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.073+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8dc870 con 0x7f4308077060 2024-09-10T06:22:57.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560bee8fde00 con 0x7f4308077060 2024-09-10T06:22:57.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.079 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T06:22:57.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f41cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609246855088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d8180 con 0x560bee8beae0 2024-09-10T06:22:57.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94609246855088] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.077+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609246830512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1fb0 con 0x560bee8c34d0 2024-09-10T06:22:57.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94609246830512] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4318f339c0 20 remove_watcher() i=0 2024-09-10T06:22:57.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4318f339c0 2 removed watcher, disabling cache 2024-09-10T06:22:57.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609246834896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1fb0 con 0x560bee8beae0 2024-09-10T06:22:57.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94609246834896] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4318f339c0 20 remove_watcher() i=1 2024-09-10T06:22:57.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.081+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609246839648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1fb0 con 0x560bee8c7dd0 2024-09-10T06:22:57.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4316238640 1 -- 172.21.15.117:0/30832032 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94609246839648] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43000d9070 con 0x560bee8c7dd0 2024-09-10T06:22:57.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4318f339c0 20 remove_watcher() i=2 2024-09-10T06:22:57.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609246844464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ce360 con 0x560bee8c34d0 2024-09-10T06:22:57.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4316a39640 1 -- 172.21.15.117:0/30832032 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94609246844464] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4308074030 con 0x560bee8c34d0 2024-09-10T06:22:57.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4318f339c0 20 remove_watcher() i=3 2024-09-10T06:22:57.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.085+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609246837024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1fb0 con 0x560bee8beae0 2024-09-10T06:22:57.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94609246837024] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x560bee8beae0 2024-09-10T06:22:57.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f4318f339c0 20 remove_watcher() i=4 2024-09-10T06:22:57.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609246848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8ce360 con 0x7f4308077060 2024-09-10T06:22:57.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94609246848064] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f4318f339c0 20 remove_watcher() i=5 2024-09-10T06:22:57.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.089+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609246851200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8cd920 con 0x7f4308077060 2024-09-10T06:22:57.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94609246851200] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 20 remove_watcher() i=6 2024-09-10T06:22:57.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609246852256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560bee8d1fb0 con 0x7f4308077060 2024-09-10T06:22:57.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94609246852256] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4310026040 con 0x7f4308077060 2024-09-10T06:22:57.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 20 remove_watcher() i=7 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4308077060 msgr2=0x7f4308063a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4308077060 0x7f4308063a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee8beae0 msgr2=0x560bee8c0fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee8beae0 0x560bee8c0fa0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee8c34d0 msgr2=0x560bee8c58c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee8c34d0 0x560bee8c58c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee8c7dd0 msgr2=0x560bee8ca1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee8c7dd0 0x560bee8ca1e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41e0039ac0 msgr2=0x7f41e003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41e0039ac0 0x7f41e003bf80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43000af040 tx=0x7f43000a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 msgr2=0x560bee8b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f431723a640 1 -- 172.21.15.117:0/30832032 reap_dead start 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4308041fd0 tx=0x7f4308035f90 comp rx=0 tx=0).stop 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 shutdown_connections 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 --2- 172.21.15.117:0/30832032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee78c160 0x560bee8b3a30 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4308041fd0 tx=0x7f4308035f90 comp rx=0 tx=0).stop 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 >> 172.21.15.117:0/30832032 conn(0x560bee8a6930 msgr2=0x560bee8a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 shutdown_connections 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.093+0000 7f4318f339c0 1 -- 172.21.15.117:0/30832032 wait complete. 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 msgr2=0x7f41f003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 0x7f41f003bee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c10 tx=0x7f4300005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 msgr2=0x560bee89e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f43080500d0 tx=0x7f430801d650 comp rx=0 tx=0).stop 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 shutdown_connections 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41f0039a20 0x7f41f003bee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/2921374476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee89dd60 0x560bee89e180 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 >> 172.21.15.117:0/2921374476 conn(0x560bee893710 msgr2=0x560bee893af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 shutdown_connections 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/2921374476 wait complete. 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee7918c0 msgr2=0x560bee8870e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x560bee7918c0 0x560bee8870e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee889880 msgr2=0x560bee88bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x560bee889880 0x560bee88bc70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee88d780 msgr2=0x560bee88fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560bee88d780 0x560bee88fb70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41fc039a70 msgr2=0x7f41fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f41fc039a70 0x7f41fc03bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae000 tx=0x7f43000a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 msgr2=0x560bee87ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 --2- 172.21.15.117:0/913078192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bee701770 0x560bee87ff70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x560bee8798c0 tx=0x7f4308000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f431723a640 1 -- 172.21.15.117:0/913078192 reap_dead start 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 shutdown_connections 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 >> 172.21.15.117:0/913078192 conn(0x560bee787e90 msgr2=0x560bee873000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 shutdown_connections 2024-09-10T06:22:57.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.097+0000 7f4318f339c0 1 -- 172.21.15.117:0/913078192 wait complete. 2024-09-10T06:22:57.110 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T06:22:57.111 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T06:22:57.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T06:22:57.111 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-10T06:22:57.192 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:57.192 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.189+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.189+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.189+0000 7f6baa4b79c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557c1252f060 0x557c1252f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.189+0000 7f6baa4b79c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c1246c9c0 con 0x557c1252da60 2024-09-10T06:22:57.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.189+0000 7f6baa4b79c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x557c124bc6d0 con 0x557c1252f060 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557c1252f060 0x557c1252f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557c1252f060 0x557c1252f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52240/0 (socket says 172.21.15.117:52240) 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1020637244 learned_addr learned my addr 172.21.15.117:0/1020637244 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba77bc640 1 --1- 172.21.15.117:0/1020637244 >> v1:172.21.15.84:6789/0 conn(0x557c1252da60 0x557c1252de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52516/0 (socket says 172.21.15.117:52516) 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1020637244 >> v1:172.21.15.84:6789/0 conn(0x557c1252da60 legacy=0x557c1252de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1020637244 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c12460ca0 con 0x557c1252f060 2024-09-10T06:22:57.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1020637244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252f060 0x557c1252f440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000a4e0 tx=0x7f6ba001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e088efe5200b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba6fbb640 1 -- 172.21.15.117:0/1020637244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00aa540 con 0x557c1252f060 2024-09-10T06:22:57.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba6fbb640 1 -- 172.21.15.117:0/1020637244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00aa6e0 con 0x557c1252f060 2024-09-10T06:22:57.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.193+0000 7f6ba6fbb640 1 -- 172.21.15.117:0/1020637244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00aaa40 con 0x557c1252f060 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1020637244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252f060 msgr2=0x557c1252f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1020637244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252f060 0x557c1252f440 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000a4e0 tx=0x7f6ba001b090 comp rx=0 tx=0).stop 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1020637244 shutdown_connections 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1020637244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252f060 0x557c1252f440 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1020637244 >> 172.21.15.117:0/1020637244 conn(0x557c125b4040 msgr2=0x557c125b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1020637244 shutdown_connections 2024-09-10T06:22:57.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.197+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1020637244 wait complete. 2024-09-10T06:22:57.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c124c0680 con 0x557c1252da60 2024-09-10T06:22:57.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52252/0 (socket says 172.21.15.117:52252) 2024-09-10T06:22:57.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/3954087393 learned_addr learned my addr 172.21.15.117:0/3954087393 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/3954087393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1243bda0 con 0x557c1252da60 2024-09-10T06:22:57.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/3954087393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ac040 tx=0x7f6ba0003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3af7a363c45fcc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6a95e0b640 1 -- 172.21.15.117:0/3954087393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00aaa80 con 0x557c1252da60 2024-09-10T06:22:57.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6a95e0b640 1 -- 172.21.15.117:0/3954087393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00aac20 con 0x557c1252da60 2024-09-10T06:22:57.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6a95e0b640 1 -- 172.21.15.117:0/3954087393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b4460 con 0x557c1252da60 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/3954087393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 msgr2=0x557c126a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/3954087393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ac040 tx=0x7f6ba0003340 comp rx=0 tx=0).stop 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/3954087393 shutdown_connections 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/3954087393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126a5ce0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/3954087393 >> 172.21.15.117:0/3954087393 conn(0x557c125b4040 msgr2=0x557c126a1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/3954087393 shutdown_connections 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/3954087393 wait complete. 2024-09-10T06:22:57.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.213+0000 7f6baa4b79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c12462a50 con 0x557c1252da60 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52268/0 (socket says 172.21.15.117:52268) 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/2713185458 learned_addr learned my addr 172.21.15.117:0/2713185458 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c126ad6f0 con 0x557c1252da60 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126ad190 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000f90 tx=0x557c1252e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 -- 172.21.15.117:0/2713185458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b4860 con 0x557c1252da60 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 -- 172.21.15.117:0/2713185458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00c1070 con 0x557c1252da60 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c126ad980 con 0x557c1252da60 2024-09-10T06:22:57.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 -- 172.21.15.117:0/2713185458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b4b50 con 0x557c1252da60 2024-09-10T06:22:57.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c126ae330 con 0x557c1252da60 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 -- 172.21.15.117:0/2713185458 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba00bd440 con 0x557c1252da60 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a90039a70 0x7f6a9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6a8ffff640 1 -- 172.21.15.117:0/2713185458 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6ba00eae30 con 0x557c1252da60 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a90039a70 0x7f6a9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c1252f060 0x557c126b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126b4840 con 0x557c1252f060 2024-09-10T06:22:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba87be640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c1252f060 0x557c126b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a90039a70 0x7f6a9003bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c001e90 tx=0x7f6b9c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba87be640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c1252f060 0x557c126b4300 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6ba87be640 1 -- 172.21.15.117:0/2713185458 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x557c1252f060 2024-09-10T06:22:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.217+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126ae670 con 0x557c1252f060 2024-09-10T06:22:57.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba87be640 1 -- 172.21.15.117:0/2713185458 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x557c1252f060 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126b6ab0 0x557c126b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126b9590 con 0x557c126b6ab0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126b6ab0 0x557c126b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126b6ab0 0x557c126b8ea0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/2713185458 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ba00bc440 con 0x557c126b6ab0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126b5950 con 0x557c1252f060 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba87be640 1 -- 172.21.15.117:0/2713185458 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x557c1252f060 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126ba9f0 0x557c126bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126bd520 con 0x557c126ba9f0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126ba9f0 0x557c126bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126ba9f0 0x557c126bcde0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba77bc640 1 -- 172.21.15.117:0/2713185458 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b9c00f6e0 con 0x557c126ba9f0 2024-09-10T06:22:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6baa4b79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c124cd450 con 0x557c126cb020 2024-09-10T06:22:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52276/0 (socket says 172.21.15.117:52276) 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.221+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1788615426 learned_addr learned my addr 172.21.15.117:0/1788615426 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1788615426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c126cba80 con 0x557c126cb020 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00bd010 tx=0x7f6ba00e2dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 -- 172.21.15.117:0/1788615426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00d4070 con 0x557c126cb020 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 -- 172.21.15.117:0/1788615426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00bd940 con 0x557c126cb020 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c126cc2e0 con 0x557c126cb020 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 -- 172.21.15.117:0/1788615426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00bdc60 con 0x557c126cb020 2024-09-10T06:22:57.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c126cc850 con 0x557c126cb020 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 -- 172.21.15.117:0/1788615426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba00e21e0 con 0x557c126cb020 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6a8d7fa640 1 -- 172.21.15.117:0/1788615426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6ba00ed060 con 0x557c126cb020 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x557c126b4c80 tx=0x7f6b9c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6baa4b79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c126a64b0 con 0x557c126d8770 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52288/0 (socket says 172.21.15.117:52288) 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/4201550374 learned_addr learned my addr 172.21.15.117:0/4201550374 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.225+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/4201550374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c126d9140 con 0x557c126d8770 2024-09-10T06:22:57.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/4201550374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00b7e50 tx=0x7f6ba00cf440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1873e656e05f74e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a86ffd640 1 -- 172.21.15.117:0/4201550374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00f8020 con 0x557c126d8770 2024-09-10T06:22:57.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a86ffd640 1 -- 172.21.15.117:0/4201550374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00ec020 con 0x557c126d8770 2024-09-10T06:22:57.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a86ffd640 1 -- 172.21.15.117:0/4201550374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00e40b0 con 0x557c126d8770 2024-09-10T06:22:57.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/4201550374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 msgr2=0x557c126d8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/4201550374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00b7e50 tx=0x7f6ba00cf440 comp rx=0 tx=0).stop 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/4201550374 shutdown_connections 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/4201550374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126d8b50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/4201550374 >> 172.21.15.117:0/4201550374 conn(0x557c126d3b90 msgr2=0x557c126d1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/4201550374 shutdown_connections 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/4201550374 wait complete. 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 Processor -- start 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- start start 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557c126d7540 con 0x557c126d8770 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52300/0 (socket says 172.21.15.117:52300) 2024-09-10T06:22:57.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 learned_addr learned my addr 172.21.15.117:0/1713941899 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c126defb0 con 0x557c126d8770 2024-09-10T06:22:57.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00d9040 tx=0x7f6ba00cce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a857fa640 1 -- 172.21.15.117:0/1713941899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b3e10 con 0x557c126d8770 2024-09-10T06:22:57.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c126defb0 con 0x557c126d8770 2024-09-10T06:22:57.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a857fa640 1 -- 172.21.15.117:0/1713941899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00ec040 con 0x557c126d8770 2024-09-10T06:22:57.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6a857fa640 1 -- 172.21.15.117:0/1713941899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00c7bd0 con 0x557c126d8770 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.229+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c126df580 con 0x557c126d8770 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6a857fa640 1 -- 172.21.15.117:0/1713941899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba00fb020 con 0x557c126d8770 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6a857fa640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a700399d0 0x7f6a7003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6a857fa640 1 -- 172.21.15.117:0/1713941899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f6ba010aaf0 con 0x557c126d8770 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a700399d0 0x7f6a7003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c126e9c40 0x557c126ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126ec850 con 0x557c126e9c40 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c126e9c40 0x557c126ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a700399d0 0x7f6a7003be90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557c126bd920 tx=0x7f6b9c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c126e9c40 0x557c126ec100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x557c126e9c40 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 realm 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126ecc60 con 0x557c126e9c40 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x557c126e9c40 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed530 con 0x557c126e9c40 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x557c126e9c40 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x557c126e9c40 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126ee630 0x557c126f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f0ff0 con 0x557c126ee630 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126ee630 0x557c126f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126ee630 0x557c126f0a20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 20 searching for the correct realm 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126f2f40 0x557c126f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126f59f0 con 0x557c126f2f40 2024-09-10T06:22:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.233+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126f2f40 0x557c126f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba77bc640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126f2f40 0x557c126f5370 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126f59f0 con 0x557c126ee630 2024-09-10T06:22:57.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba7fbd640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba00fd030 0x7f6ba00ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126f59f0 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba00fd030 0x7f6ba00ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba00fd030 0x7f6ba00ffa90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b980083f0 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b980083f0 con 0x557c126e9c40 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.237+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126ee630 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126ee630 2024-09-10T06:22:57.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.241+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126ee630 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.245+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126ee630 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126f2f40 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x7f6ba00fd030 2024-09-10T06:22:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126e9c40 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c126ed8d0 con 0x557c126ee630 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f18b0 con 0x557c126e9c40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f1ca0 con 0x557c126e9c40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f1ca0 con 0x557c126f2f40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 zone default found 2024-09-10T06:22:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 4 Realm: () 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 zonegroup default 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f5e70 con 0x7f6ba00fd030 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f79c0 con 0x557c126f2f40 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.249+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c126f7ec0 con 0x557c126f2f40 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 20 started sync module instance, tier type = 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f6d00 con 0x557c126ee630 2024-09-10T06:22:57.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93991373598960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f87d0 con 0x557c126ee630 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f9020 con 0x557c126e9c40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93991373598960] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93991373603616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f9020 con 0x557c126e9c40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.253+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f9a80 con 0x557c126f2f40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93991373603616] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93991373605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f8f90 con 0x557c126f2f40 2024-09-10T06:22:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fa850 con 0x557c126ee630 2024-09-10T06:22:57.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93991373614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fb510 con 0x557c126ee630 2024-09-10T06:22:57.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.257+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fbed0 con 0x557c126e9c40 2024-09-10T06:22:57.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93991373605744] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93991373614144] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93991373617696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fb510 con 0x557c126e9c40 2024-09-10T06:22:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fbe40 con 0x7f6ba00fd030 2024-09-10T06:22:57.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93991373617696] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93991373619760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fbe40 con 0x7f6ba00fd030 2024-09-10T06:22:57.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.261+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fb0a0 con 0x7f6ba00fd030 2024-09-10T06:22:57.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.265+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93991373619760] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.265+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.265+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93991373615200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fcca0 con 0x7f6ba00fd030 2024-09-10T06:22:57.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.265+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fd660 con 0x7f6ba00fd030 2024-09-10T06:22:57.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.265+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93991373615200] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93991373620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fd660 con 0x7f6ba00fd030 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=0 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=1 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=2 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=3 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=4 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=5 2024-09-10T06:22:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=6 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93991373620816] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 20 add_watcher() i=7 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c127009d0 con 0x557c126e9c40 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.269+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93991373636544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fd7d0 con 0x557c126e9c40 2024-09-10T06:22:57.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93991373636544] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 5 note: GC not initialized 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6a5cfe1640 20 reqs_thread_entry: start 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 Filter name: none 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f69d67fc640 20 reqs_thread_entry: start 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c127240c0 con 0x7f6ba00fd030 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:57.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c127261b0 con 0x557c126ee630 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c12727bb0 con 0x557c126e9c40 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.273+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:57.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c1272b2f0 con 0x7f6ba00fd030 2024-09-10T06:22:57.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T06:22:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c1272a340 con 0x557c126ee630 2024-09-10T06:22:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T06:22:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.277+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c1272f360 con 0x557c126ee630 2024-09-10T06:22:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6baa4b79c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T06:22:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6baa4b79c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6baa4b79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93991373827600 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c1272ad30 con 0x7f6ba00fd030 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify (1) cookie 93991373615200 notify 128849018886 ret 0) ==== 380+0+0 (crc 0 0 0) 0x557c12727fa0 con 0x7f6ba00fd030 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6a86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93991373615200 notifier 4512 bl.length()=338 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6a86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6a86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6a86ffd640 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6a6c003eb0 con 0x7f6ba00fd030 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(68 notify.6 [notify cookie 93991373827600 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.281+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== watch-notify(notify_complete (2) cookie 93991373827600 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c127270f0 con 0x7f6ba00fd030 2024-09-10T06:22:57.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93991373636544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c1272f350 con 0x557c126e9c40 2024-09-10T06:22:57.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93991373636544] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93991373598960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c127003c0 con 0x557c126ee630 2024-09-10T06:22:57.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93991373598960] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6baa4b79c0 20 remove_watcher() i=0 2024-09-10T06:22:57.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6baa4b79c0 2 removed watcher, disabling cache 2024-09-10T06:22:57.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.285+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93991373603616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f70f0 con 0x557c126e9c40 2024-09-10T06:22:57.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93991373603616] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6baa4b79c0 20 remove_watcher() i=1 2024-09-10T06:22:57.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93991373605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c127003c0 con 0x557c126f2f40 2024-09-10T06:22:57.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6ba77bc640 1 -- 172.21.15.117:0/1713941899 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93991373605744] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c037040 con 0x557c126f2f40 2024-09-10T06:22:57.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6baa4b79c0 20 remove_watcher() i=2 2024-09-10T06:22:57.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.289+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93991373614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f8320 con 0x557c126ee630 2024-09-10T06:22:57.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6ba7fbd640 1 -- 172.21.15.117:0/1713941899 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93991373614144] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba010f020 con 0x557c126ee630 2024-09-10T06:22:57.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6baa4b79c0 20 remove_watcher() i=3 2024-09-10T06:22:57.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93991373617696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f70f0 con 0x557c126e9c40 2024-09-10T06:22:57.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93991373617696] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x557c126e9c40 2024-09-10T06:22:57.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6baa4b79c0 20 remove_watcher() i=4 2024-09-10T06:22:57.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.293+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93991373619760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f8b70 con 0x7f6ba00fd030 2024-09-10T06:22:57.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93991373619760] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6baa4b79c0 20 remove_watcher() i=5 2024-09-10T06:22:57.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93991373615200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126f8320 con 0x7f6ba00fd030 2024-09-10T06:22:57.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93991373615200] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6baa4b79c0 20 remove_watcher() i=6 2024-09-10T06:22:57.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.297+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93991373620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c126fba20 con 0x7f6ba00fd030 2024-09-10T06:22:57.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93991373620816] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba00fd030 2024-09-10T06:22:57.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 20 remove_watcher() i=7 2024-09-10T06:22:57.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba00fd030 msgr2=0x7f6ba00ffa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba00fd030 0x7f6ba00ffa90 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c126e9c40 msgr2=0x557c126ec100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c126e9c40 0x557c126ec100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126ee630 msgr2=0x557c126f0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126ee630 0x557c126f0a20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126f2f40 msgr2=0x557c126f5370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126f2f40 0x557c126f5370 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a700399d0 msgr2=0x7f6a7003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a700399d0 0x7f6a7003be90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557c126bd920 tx=0x7f6b9c010000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6ba87be640 1 -- 172.21.15.117:0/1713941899 reap_dead start 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 msgr2=0x557c126dea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00d9040 tx=0x7f6ba00cce30 comp rx=0 tx=0).stop 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 shutdown_connections 2024-09-10T06:22:57.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1713941899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126d8770 0x557c126dea50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 >> 172.21.15.117:0/1713941899 conn(0x557c126d3b90 msgr2=0x557c126d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 shutdown_connections 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1713941899 wait complete. 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 msgr2=0x7f6a8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x557c126b4c80 tx=0x7f6b9c00f000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 msgr2=0x557c126cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00bd010 tx=0x7f6ba00e2dd0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 shutdown_connections 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/1788615426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c126cb020 0x557c126cb440 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 >> 172.21.15.117:0/1788615426 conn(0x557c126c09d0 msgr2=0x557c126c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 shutdown_connections 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/1788615426 wait complete. 2024-09-10T06:22:57.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c1252f060 msgr2=0x557c126b4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557c1252f060 0x557c126b4300 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126b6ab0 msgr2=0x557c126b8ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557c126b6ab0 0x557c126b8ea0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126ba9f0 msgr2=0x557c126bcde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557c126ba9f0 0x557c126bcde0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a90039a70 msgr2=0x7f6a9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a90039a70 0x7f6a9003bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c001e90 tx=0x7f6b9c0013f0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 msgr2=0x557c126ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 --2- 172.21.15.117:0/2713185458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557c1252da60 0x557c126ad190 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000f90 tx=0x557c1252e9a0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6ba87be640 1 -- 172.21.15.117:0/2713185458 reap_dead start 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 shutdown_connections 2024-09-10T06:22:57.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 >> 172.21.15.117:0/2713185458 conn(0x557c125b4040 msgr2=0x557c126a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 shutdown_connections 2024-09-10T06:22:57.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.301+0000 7f6baa4b79c0 1 -- 172.21.15.117:0/2713185458 wait complete. 2024-09-10T06:22:57.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1'] 2024-09-10T06:22:57.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1'] 2024-09-10T06:22:57.316 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:57.393 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:57.393 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fece02d49c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56515b5418a0 0x56515b543c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fece02d49c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56515b3f19c0 con 0x56515b4b1f20 2024-09-10T06:22:57.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fece02d49c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56515b4416d0 con 0x56515b5418a0 2024-09-10T06:22:57.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdd5d9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56515b5418a0 0x56515b543c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdddda640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x56515b4b1f20 0x56515b540180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52528/0 (socket says 172.21.15.117:52528) 2024-09-10T06:22:57.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdddda640 1 -- 172.21.15.117:0/2773361441 learned_addr learned my addr 172.21.15.117:0/2773361441 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:57.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdcdd8640 1 -- 172.21.15.117:0/2773361441 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454044948 0 0) 0x56515b3f19c0 con 0x56515b4b1f20 2024-09-10T06:22:57.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdcdd8640 1 -- 172.21.15.117:0/2773361441 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feccc001e20 con 0x56515b4b1f20 2024-09-10T06:22:57.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdd5d9640 1 -- 172.21.15.117:0/2773361441 >> v1:172.21.15.84:6789/0 conn(0x56515b4b1f20 legacy=0x56515b540180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.393+0000 7fecdd5d9640 1 -- 172.21.15.117:0/2773361441 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b3e5ca0 con 0x56515b5418a0 2024-09-10T06:22:57.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/2773361441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b5418a0 0x56515b543c90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a480 tx=0x7fecc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dba201f3663281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fecdcdd8640 1 -- 172.21.15.117:0/2773361441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc80af070 con 0x56515b5418a0 2024-09-10T06:22:57.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fecdcdd8640 1 -- 172.21.15.117:0/2773361441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc80aa530 con 0x56515b5418a0 2024-09-10T06:22:57.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fecdcdd8640 1 -- 172.21.15.117:0/2773361441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecc80aa810 con 0x56515b5418a0 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 -- 172.21.15.117:0/2773361441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b5418a0 msgr2=0x56515b543c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2773361441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b5418a0 0x56515b543c90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a480 tx=0x7fecc801b280 comp rx=0 tx=0).stop 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 -- 172.21.15.117:0/2773361441 shutdown_connections 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2773361441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b5418a0 0x56515b543c90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 -- 172.21.15.117:0/2773361441 >> 172.21.15.117:0/2773361441 conn(0x56515b537e70 msgr2=0x56515b53a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 -- 172.21.15.117:0/2773361441 shutdown_connections 2024-09-10T06:22:57.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.397+0000 7fece02d49c0 1 -- 172.21.15.117:0/2773361441 wait complete. 2024-09-10T06:22:57.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.409+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56515b445680 con 0x56515b4b1f20 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52314/0 (socket says 172.21.15.117:52314) 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 -- 172.21.15.117:0/3985744270 learned_addr learned my addr 172.21.15.117:0/3985744270 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 -- 172.21.15.117:0/3985744270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b3c0da0 con 0x56515b4b1f20 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 --2- 172.21.15.117:0/3985744270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fecd8001e40 tx=0x7fecd800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f844d47e7ca5f8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7febcbe07640 1 -- 172.21.15.117:0/3985744270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd8012020 con 0x56515b4b1f20 2024-09-10T06:22:57.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7febcbe07640 1 -- 172.21.15.117:0/3985744270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd800e690 con 0x56515b4b1f20 2024-09-10T06:22:57.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7febcbe07640 1 -- 172.21.15.117:0/3985744270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd800e9b0 con 0x56515b4b1f20 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- 172.21.15.117:0/3985744270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 msgr2=0x56515b6287f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3985744270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fecd8001e40 tx=0x7fecd800b790 comp rx=0 tx=0).stop 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- 172.21.15.117:0/3985744270 shutdown_connections 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3985744270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b6287f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- 172.21.15.117:0/3985744270 >> 172.21.15.117:0/3985744270 conn(0x56515b537e70 msgr2=0x56515b624490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- 172.21.15.117:0/3985744270 shutdown_connections 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- 172.21.15.117:0/3985744270 wait complete. 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b62fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fece02d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56515b3e7a50 con 0x56515b4b1f20 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.413+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b62fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b62fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52330/0 (socket says 172.21.15.117:52330) 2024-09-10T06:22:57.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdddda640 1 -- 172.21.15.117:0/2642848762 learned_addr learned my addr 172.21.15.117:0/2642848762 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdddda640 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b630370 con 0x56515b4b1f20 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdddda640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b62fe10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x56515b6297e0 tx=0x7fecd80040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 -- 172.21.15.117:0/2642848762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd8012030 con 0x56515b4b1f20 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 -- 172.21.15.117:0/2642848762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd801a7a0 con 0x56515b4b1f20 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56515b630600 con 0x56515b4b1f20 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 -- 172.21.15.117:0/2642848762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd801aac0 con 0x56515b4b1f20 2024-09-10T06:22:57.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56515b630fb0 con 0x56515b4b1f20 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 -- 172.21.15.117:0/2642848762 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecd8015020 con 0x56515b4b1f20 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febc4039a70 0x7febc403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7febca604640 1 -- 172.21.15.117:0/2642848762 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fecd8020070 con 0x56515b4b1f20 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febc4039a70 0x7febc403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b5418a0 0x56515b636f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6374c0 con 0x56515b5418a0 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecde5db640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b5418a0 0x56515b636f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febc4039a70 0x7febc403bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecc80ac000 tx=0x7fecc80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecde5db640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b5418a0 0x56515b636f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fecde5db640 1 -- 172.21.15.117:0/2642848762 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b5418a0 2024-09-10T06:22:57.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.417+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6378f0 con 0x56515b5418a0 2024-09-10T06:22:57.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecde5db640 1 -- 172.21.15.117:0/2642848762 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b5418a0 2024-09-10T06:22:57.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b639700 0x56515b63baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b63c1c0 con 0x56515b639700 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b639700 0x56515b63baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b639700 0x56515b63baf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 -- 172.21.15.117:0/2642848762 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fecd8008030 con 0x56515b639700 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6385a0 con 0x56515b5418a0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecde5db640 1 -- 172.21.15.117:0/2642848762 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b5418a0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b63d600 0x56515b63f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b640180 con 0x56515b63d600 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b63d600 0x56515b63f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b63d600 0x56515b63f9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdd5d9640 1 -- 172.21.15.117:0/2642848762 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fecc80a8070 con 0x56515b63d600 2024-09-10T06:22:57.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fece02d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56515b452450 con 0x56515b53d8c0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52342/0 (socket says 172.21.15.117:52342) 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 -- 172.21.15.117:0/3796109992 learned_addr learned my addr 172.21.15.117:0/3796109992 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 -- 172.21.15.117:0/3796109992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b53dde0 con 0x56515b53d8c0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.421+0000 7fecdddda640 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fecd804ecc0 tx=0x7fecd8016e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 -- 172.21.15.117:0/3796109992 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd800d3e0 con 0x56515b53d8c0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 -- 172.21.15.117:0/3796109992 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd8047b30 con 0x56515b53d8c0 2024-09-10T06:22:57.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56515b53c6a0 con 0x56515b53d8c0 2024-09-10T06:22:57.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 -- 172.21.15.117:0/3796109992 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd8047e70 con 0x56515b53d8c0 2024-09-10T06:22:57.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56515b53cc10 con 0x56515b53d8c0 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 -- 172.21.15.117:0/3796109992 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecd8009070 con 0x56515b53d8c0 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 0x7febb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc37fe640 1 -- 172.21.15.117:0/3796109992 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fecd8041e00 con 0x56515b53d8c0 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 0x7febb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 0x7febb803bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecc80ad040 tx=0x7fecc8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fece02d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56515b629020 con 0x56515b65c5c0 2024-09-10T06:22:57.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52356/0 (socket says 172.21.15.117:52356) 2024-09-10T06:22:57.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdddda640 1 -- 172.21.15.117:0/700356795 learned_addr learned my addr 172.21.15.117:0/700356795 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdddda640 1 -- 172.21.15.117:0/700356795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b65cf90 con 0x56515b65c5c0 2024-09-10T06:22:57.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7fecdddda640 1 --2- 172.21.15.117:0/700356795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fecd8018e20 tx=0x7fecd802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98df515677637f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc17fa640 1 -- 172.21.15.117:0/700356795 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd802d5b0 con 0x56515b65c5c0 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc17fa640 1 -- 172.21.15.117:0/700356795 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd8047830 con 0x56515b65c5c0 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.425+0000 7febc17fa640 1 -- 172.21.15.117:0/700356795 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd804d890 con 0x56515b65c5c0 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/700356795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 msgr2=0x56515b65c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 --2- 172.21.15.117:0/700356795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fecd8018e20 tx=0x7fecd802c7e0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/700356795 shutdown_connections 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 --2- 172.21.15.117:0/700356795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b65c9a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/700356795 >> 172.21.15.117:0/700356795 conn(0x56515b6589f0 msgr2=0x56515b656c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/700356795 shutdown_connections 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/700356795 wait complete. 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 Processor -- start 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- start start 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56515b65d450 con 0x56515b65c5c0 2024-09-10T06:22:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fecdddda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52368/0 (socket says 172.21.15.117:52368) 2024-09-10T06:22:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 learned_addr learned my addr 172.21.15.117:0/866243380 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56515b663e60 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fecdddda640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fecd802d7a0 tx=0x7fecd8019cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7febaf7fe640 1 -- 172.21.15.117:0/866243380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd802d5b0 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56515b663e60 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56515b663e60 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7febaf7fe640 1 -- 172.21.15.117:0/866243380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd8040780 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7febaf7fe640 1 -- 172.21.15.117:0/866243380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecd804d760 con 0x56515b65c5c0 2024-09-10T06:22:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7febaf7fe640 1 -- 172.21.15.117:0/866243380 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecd8066070 con 0x56515b65c5c0 2024-09-10T06:22:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.429+0000 7febaf7fe640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7feba8039a70 0x7feba803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7febaf7fe640 1 -- 172.21.15.117:0/866243380 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fecd8005050 con 0x56515b65c5c0 2024-09-10T06:22:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7feba8039a70 0x7feba803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b66e990 0x56515b670e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6715a0 con 0x56515b66e990 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b66e990 0x56515b670e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7feba8039a70 0x7feba803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecc80aafd0 tx=0x7fecc80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b66e990 0x56515b670e50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 realm 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6719b0 con 0x56515b66e990 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:57.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b672280 con 0x56515b66e990 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b673380 0x56515b675770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b675d40 con 0x56515b673380 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b673380 0x56515b675770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b673380 0x56515b675770 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 20 searching for the correct realm 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b677c90 0x56515b67a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b67a740 con 0x56515b677c90 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b677c90 0x56515b67a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b677c90 0x56515b67a0c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b67a740 con 0x56515b673380 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fecd8068030 0x7fecd8068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.433+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b67a740 con 0x7fecd8068030 2024-09-10T06:22:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fecd8068030 0x7fecd8068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fecd8068030 0x7fecd8068870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b673380 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.437+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b673380 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.441+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b673380 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b673380 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b677c90 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x7fecd8068030 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b66e990 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56515b672620 con 0x56515b673380 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.445+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b676600 con 0x56515b66e990 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6769f0 con 0x56515b66e990 2024-09-10T06:22:57.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6769f0 con 0x56515b677c90 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 zone default found 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 4 Realm: () 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 zonegroup default 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b67abc0 con 0x7fecd8068030 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b67c6e0 con 0x56515b677c90 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b67cb20 con 0x56515b677c90 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 started sync module instance, tier type = 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:57.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67ba50 con 0x56515b673380 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907425865280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67b6b0 con 0x56515b673380 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.449+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67da20 con 0x56515b66e990 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907425865280] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907425871216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67d990 con 0x56515b66e990 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67e7b0 con 0x56515b677c90 2024-09-10T06:22:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907425871216] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907425873424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67eba0 con 0x56515b677c90 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.453+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67f560 con 0x56515b673380 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907425880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6801d0 con 0x56515b673380 2024-09-10T06:22:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b680b90 con 0x56515b66e990 2024-09-10T06:22:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907425873424] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907425880320] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907425883872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6801d0 con 0x56515b66e990 2024-09-10T06:22:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.457+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b680b00 con 0x7fecd8068030 2024-09-10T06:22:57.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907425883872] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907425881376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b680140 con 0x7fecd8068030 2024-09-10T06:22:57.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6819c0 con 0x7fecd8068030 2024-09-10T06:22:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907425881376] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907425885936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6819c0 con 0x7fecd8068030 2024-09-10T06:22:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.461+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b682380 con 0x7fecd8068030 2024-09-10T06:22:57.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907425885936] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907425890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6827a0 con 0x7fecd8068030 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=0 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=1 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=2 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=3 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=4 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=5 2024-09-10T06:22:57.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=6 2024-09-10T06:22:57.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907425890000] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 20 add_watcher() i=7 2024-09-10T06:22:57.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:57.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6857d0 con 0x56515b66e990 2024-09-10T06:22:57.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.465+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907425891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b682c30 con 0x56515b66e990 2024-09-10T06:22:57.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907425891056] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7feb8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:57.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 5 note: GC not initialized 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7feb8e7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 Filter name: none 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7feafffff640 20 reqs_thread_entry: start 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a8db0 con 0x56515b66e990 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:57.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:57.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6aaea0 con 0x56515b673380 2024-09-10T06:22:57.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:57.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:57.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6ac760 con 0x56515b66e990 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.469+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6b0de0 con 0x7fecd8068030 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6b70c0 con 0x56515b66e990 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:57.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94907426065952 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6b16c0 con 0x7fecd8068030 2024-09-10T06:22:57.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== watch-notify(notify (1) cookie 94907425881376 notify 128849018887 ret 0) ==== 802+0+0 (crc 0 0 0) 0x56515b6acb50 con 0x7fecd8068030 2024-09-10T06:22:57.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(67 notify.5 [notify cookie 94907426065952 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7febc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94907425881376 notifier 4519 bl.length()=760 2024-09-10T06:22:57.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7febc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7febc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7febc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7febc17fa640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7feba0003eb0 con 0x7fecd8068030 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.473+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== watch-notify(notify_complete (2) cookie 94907426065952 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56515b6abc80 con 0x7fecd8068030 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6aaa90 con 0x56515b673380 2024-09-10T06:22:57.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(69 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.477+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6b1190 con 0x56515b673380 2024-09-10T06:22:57.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'25 uv25 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fece02d49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:57.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fece02d49c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fece02d49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:57.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94907426065920 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56515b6aaf40 con 0x7fecd8068030 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== watch-notify(notify (1) cookie 94907425885936 notify 128849018888 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fecd0034410 con 0x7fecd8068030 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7febc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94907425885936 notifier 4519 bl.length()=314 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(71 notify.6 [notify cookie 94907426065920 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7febc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7febc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:57.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7febc17fa640 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7feba0003eb0 con 0x7fecd8068030 2024-09-10T06:22:57.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== watch-notify(notify_complete (2) cookie 94907426065920 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fecd00346b0 con 0x7fecd8068030 2024-09-10T06:22:57.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7feb8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.481+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907425891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a6ae0 con 0x56515b66e990 2024-09-10T06:22:57.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94907425891056] v30'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907425865280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a6ae0 con 0x56515b673380 2024-09-10T06:22:57.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94907425865280] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 20 remove_watcher() i=0 2024-09-10T06:22:57.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 2 removed watcher, disabling cache 2024-09-10T06:22:57.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907425871216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a6ae0 con 0x56515b66e990 2024-09-10T06:22:57.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94907425871216] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 20 remove_watcher() i=1 2024-09-10T06:22:57.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.485+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907425873424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67d570 con 0x56515b677c90 2024-09-10T06:22:57.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fecdd5d9640 1 -- 172.21.15.117:0/866243380 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94907425873424] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecc80d9070 con 0x56515b677c90 2024-09-10T06:22:57.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fece02d49c0 20 remove_watcher() i=2 2024-09-10T06:22:57.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907425880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a6ae0 con 0x56515b673380 2024-09-10T06:22:57.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fecdddda640 1 -- 172.21.15.117:0/866243380 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94907425880320] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd806e020 con 0x56515b673380 2024-09-10T06:22:57.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fece02d49c0 20 remove_watcher() i=3 2024-09-10T06:22:57.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.489+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907425883872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67de10 con 0x56515b66e990 2024-09-10T06:22:57.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94907425883872] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x56515b66e990 2024-09-10T06:22:57.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fece02d49c0 20 remove_watcher() i=4 2024-09-10T06:22:57.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907425881376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b67f900 con 0x7fecd8068030 2024-09-10T06:22:57.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94907425881376] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fece02d49c0 20 remove_watcher() i=5 2024-09-10T06:22:57.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.493+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907425885936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6a6ae0 con 0x7fecd8068030 2024-09-10T06:22:57.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94907425885936] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 20 remove_watcher() i=6 2024-09-10T06:22:57.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907425890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56515b6806e0 con 0x7fecd8068030 2024-09-10T06:22:57.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94907425890000] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecd000a4d0 con 0x7fecd8068030 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 20 remove_watcher() i=7 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fecd8068030 msgr2=0x7fecd8068870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fecd8068030 0x7fecd8068870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b66e990 msgr2=0x56515b670e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b66e990 0x56515b670e50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b673380 msgr2=0x56515b675770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b673380 0x56515b675770 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b677c90 msgr2=0x56515b67a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b677c90 0x56515b67a0c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7feba8039a70 msgr2=0x7feba803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7feba8039a70 0x7feba803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecc80aafd0 tx=0x7fecc80a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 msgr2=0x56515b663900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fecde5db640 1 -- 172.21.15.117:0/866243380 reap_dead start 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fecd802d7a0 tx=0x7fecd8019cd0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 shutdown_connections 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/866243380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b65c5c0 0x56515b663900 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 >> 172.21.15.117:0/866243380 conn(0x56515b6589f0 msgr2=0x56515b656c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 shutdown_connections 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/866243380 wait complete. 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 msgr2=0x7febb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 0x7febb803bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fecc80ad040 tx=0x7fecc8005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 msgr2=0x56515b53c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.497+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fecd804ecc0 tx=0x7fecd8016e80 comp rx=0 tx=0).stop 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 shutdown_connections 2024-09-10T06:22:57.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febb8039a70 0x7febb803bf30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/3796109992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b53d8c0 0x56515b53c160 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 >> 172.21.15.117:0/3796109992 conn(0x56515b6435f0 msgr2=0x56515b6439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 shutdown_connections 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/3796109992 wait complete. 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b5418a0 msgr2=0x56515b636f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56515b5418a0 0x56515b636f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b639700 msgr2=0x56515b63baf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56515b639700 0x56515b63baf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b63d600 msgr2=0x56515b63f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56515b63d600 0x56515b63f9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febc4039a70 msgr2=0x7febc403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7febc4039a70 0x7febc403bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecc80ac000 tx=0x7fecc80a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 msgr2=0x56515b62fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 --2- 172.21.15.117:0/2642848762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56515b4b1f20 0x56515b62fe10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x56515b6297e0 tx=0x7fecd80040f0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fecde5db640 1 -- 172.21.15.117:0/2642848762 reap_dead start 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 shutdown_connections 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 >> 172.21.15.117:0/2642848762 conn(0x56515b537e70 msgr2=0x56515b622f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 shutdown_connections 2024-09-10T06:22:57.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.501+0000 7fece02d49c0 1 -- 172.21.15.117:0/2642848762 wait complete. 2024-09-10T06:22:57.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:57.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T06:22:57.511 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T06:22:57.584 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:57.584 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:57.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.581+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.581+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.581+0000 7f97c17e59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d0d08b4770 0x55d0d09455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.581+0000 7f97c17e59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0d07f49c0 con 0x55d0d08b4b50 2024-09-10T06:22:57.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.581+0000 7f97c17e59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55d0d08446d0 con 0x55d0d08b4770 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d0d08b4770 0x55d0d09455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55d0d08b4770 0x55d0d09455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52378/0 (socket says 172.21.15.117:52378) 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97beaea640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55d0d08b4b50 0x55d0d0947af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52530/0 (socket says 172.21.15.117:52530) 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 -- 172.21.15.117:0/3921443073 learned_addr learned my addr 172.21.15.117:0/3921443073 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 -- 172.21.15.117:0/3921443073 >> v1:172.21.15.84:6789/0 conn(0x55d0d08b4b50 legacy=0x55d0d0947af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 -- 172.21.15.117:0/3921443073 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d07e8ca0 con 0x55d0d08b4770 2024-09-10T06:22:57.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/3921443073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d09455a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97b000a5c0 tx=0x7f97b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d28b0e5804a19e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97be2e9640 1 -- 172.21.15.117:0/3921443073 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00a6070 con 0x55d0d08b4770 2024-09-10T06:22:57.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97be2e9640 1 -- 172.21.15.117:0/3921443073 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00af070 con 0x55d0d08b4770 2024-09-10T06:22:57.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97be2e9640 1 -- 172.21.15.117:0/3921443073 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00aa5c0 con 0x55d0d08b4770 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3921443073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 msgr2=0x55d0d09455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/3921443073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d09455a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97b000a5c0 tx=0x7f97b001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3921443073 shutdown_connections 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/3921443073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d09455a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3921443073 >> 172.21.15.117:0/3921443073 conn(0x55d0d093ae90 msgr2=0x55d0d093d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3921443073 shutdown_connections 2024-09-10T06:22:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.585+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3921443073 wait complete. 2024-09-10T06:22:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97c17e59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97c17e59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0d0848680 con 0x55d0d08b4770 2024-09-10T06:22:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52394/0 (socket says 172.21.15.117:52394) 2024-09-10T06:22:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97bf2eb640 1 -- 172.21.15.117:0/3888787581 learned_addr learned my addr 172.21.15.117:0/3888787581 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97bf2eb640 1 -- 172.21.15.117:0/3888787581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d07c3da0 con 0x55d0d08b4770 2024-09-10T06:22:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/3888787581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97b0018f70 tx=0x7f97b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775a47463293708d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f96ad60a640 1 -- 172.21.15.117:0/3888787581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00aa9e0 con 0x55d0d08b4770 2024-09-10T06:22:57.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f96ad60a640 1 -- 172.21.15.117:0/3888787581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00aab80 con 0x55d0d08b4770 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.601+0000 7f96ad60a640 1 -- 172.21.15.117:0/3888787581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00aae60 con 0x55d0d08b4770 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3888787581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 msgr2=0x55d0d0a2d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/3888787581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97b0018f70 tx=0x7f97b0003030 comp rx=0 tx=0).stop 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3888787581 shutdown_connections 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/3888787581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a2d990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3888787581 >> 172.21.15.117:0/3888787581 conn(0x55d0d093ae90 msgr2=0x55d0d0a29610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3888787581 shutdown_connections 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/3888787581 wait complete. 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a34ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0d07eaa50 con 0x55d0d08b4770 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a34ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a34ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52408/0 (socket says 172.21.15.117:52408) 2024-09-10T06:22:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97bf2eb640 1 -- 172.21.15.117:0/4294674647 learned_addr learned my addr 172.21.15.117:0/4294674647 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97bf2eb640 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d0a35430 con 0x55d0d08b4770 2024-09-10T06:22:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a34ed0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c10 tx=0x7f97b00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 -- 172.21.15.117:0/4294674647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00c6750 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0d0a356c0 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 -- 172.21.15.117:0/4294674647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00c68f0 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 -- 172.21.15.117:0/4294674647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00c6bf0 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0d0a36070 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 -- 172.21.15.117:0/4294674647 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f97b00ce030 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f96a4039a70 0x7f96a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f96abe07640 1 -- 172.21.15.117:0/4294674647 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f97b00cc020 con 0x55d0d08b4770 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97beaea640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f96a4039a70 0x7f96a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d08b4b50 0x55d0d0a3c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.605+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a3c580 con 0x55d0d08b4b50 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bfaec640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d08b4b50 0x55d0d0a3c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97beaea640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f96a4039a70 0x7f96a403bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f97a8001e90 tx=0x7f97a80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bfaec640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d08b4b50 0x55d0d0a3c040 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bfaec640 1 -- 172.21.15.117:0/4294674647 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d08b4b50 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a3c9d0 con 0x55d0d08b4b50 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bfaec640 1 -- 172.21.15.117:0/4294674647 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d08b4b50 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a3e7e0 0x55d0d0a40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a412a0 con 0x55d0d0a3e7e0 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a3e7e0 0x55d0d0a40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a3e7e0 0x55d0d0a40bd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 -- 172.21.15.117:0/4294674647 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a3e7e0 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a3d680 con 0x55d0d08b4b50 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bfaec640 1 -- 172.21.15.117:0/4294674647 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d08b4b50 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a426e0 0x55d0d0a44ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a45260 con 0x55d0d0a426e0 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97beaea640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a426e0 0x55d0d0a44ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97beaea640 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a426e0 0x55d0d0a44ad0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97beaea640 1 -- 172.21.15.117:0/4294674647 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97a800f6e0 con 0x55d0d0a426e0 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97c17e59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0d0855450 con 0x55d0d0a52d20 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52410/0 (socket says 172.21.15.117:52410) 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.609+0000 7f97bf2eb640 1 -- 172.21.15.117:0/75582319 learned_addr learned my addr 172.21.15.117:0/75582319 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 -- 172.21.15.117:0/75582319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d0a53780 con 0x55d0d0a52d20 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f97b0018f70 tx=0x7f97b00eb6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 -- 172.21.15.117:0/75582319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00cf790 con 0x55d0d0a52d20 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 -- 172.21.15.117:0/75582319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00ebb80 con 0x55d0d0a52d20 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0d0a53fe0 con 0x55d0d0a52d20 2024-09-10T06:22:57.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 -- 172.21.15.117:0/75582319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00ebe60 con 0x55d0d0a52d20 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0d0a54550 con 0x55d0d0a52d20 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 -- 172.21.15.117:0/75582319 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f97b00e0030 con 0x55d0d0a52d20 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 0x7f969803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f96a9602640 1 -- 172.21.15.117:0/75582319 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f97b00de070 con 0x55d0d0a52d20 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97beaea640 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 0x7f969803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97beaea640 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 0x7f969803bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55d0d0a45660 tx=0x7f97a800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97c17e59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0d0a2e120 con 0x55d0d0a60420 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52420/0 (socket says 172.21.15.117:52420) 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 -- 172.21.15.117:0/4223264653 learned_addr learned my addr 172.21.15.117:0/4223264653 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 -- 172.21.15.117:0/4223264653 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d0a60e10 con 0x55d0d0a60420 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.613+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/4223264653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f97b00bc6f0 tx=0x7f97b00e3330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939ab4dad546bb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a2ffd640 1 -- 172.21.15.117:0/4223264653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00f0040 con 0x55d0d0a60420 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a2ffd640 1 -- 172.21.15.117:0/4223264653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00b3ca0 con 0x55d0d0a60420 2024-09-10T06:22:57.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a2ffd640 1 -- 172.21.15.117:0/4223264653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00e8a70 con 0x55d0d0a60420 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4223264653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 msgr2=0x55d0d0a60820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4223264653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f97b00bc6f0 tx=0x7f97b00e3330 comp rx=0 tx=0).stop 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4223264653 shutdown_connections 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4223264653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a60820 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4223264653 >> 172.21.15.117:0/4223264653 conn(0x55d0d0a5b840 msgr2=0x55d0d0a59a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4223264653 shutdown_connections 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4223264653 wait complete. 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 Processor -- start 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- start start 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a66750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d0d0a5f1f0 con 0x55d0d0a60420 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a66750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97bf2eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a66750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52428/0 (socket says 172.21.15.117:52428) 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 learned_addr learned my addr 172.21.15.117:0/2190167181 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0d0a66cb0 con 0x55d0d0a60420 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a66750 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97b00c5970 tx=0x7f97b00c0fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a17fa640 1 -- 172.21.15.117:0/2190167181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b010e020 con 0x55d0d0a60420 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0d0a66cb0 con 0x55d0d0a60420 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0d0a66cb0 con 0x55d0d0a60420 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a17fa640 1 -- 172.21.15.117:0/2190167181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b00d0620 con 0x55d0d0a60420 2024-09-10T06:22:57.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.617+0000 7f96a17fa640 1 -- 172.21.15.117:0/2190167181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b00f0070 con 0x55d0d0a60420 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f96a17fa640 1 -- 172.21.15.117:0/2190167181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f97b0111020 con 0x55d0d0a60420 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f96a17fa640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9688039a70 0x7f968803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f96a17fa640 1 -- 172.21.15.117:0/2190167181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f97b0105050 con 0x55d0d0a60420 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9688039a70 0x7f968803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d0a71990 0x55d0d0a73e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a74570 con 0x55d0d0a71990 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d0a71990 0x55d0d0a73e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9688039a70 0x7f968803bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97a8001ec0 tx=0x7f97a8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d0a71990 0x55d0d0a73e20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 realm 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a74980 con 0x55d0d0a71990 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a75250 con 0x55d0d0a71990 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a76350 0x55d0d0a78740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a78d10 con 0x55d0d0a76350 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a76350 0x55d0d0a78740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a76350 0x55d0d0a78740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 20 searching for the correct realm 2024-09-10T06:22:57.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a7ac60 0x55d0d0a7d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7d710 con 0x55d0d0a7ac60 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a7ac60 0x55d0d0a7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a7ac60 0x55d0d0a7d090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7d710 con 0x55d0d0a76350 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f97b0113020 0x7f97b00d76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.621+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7d710 con 0x7f97b0113020 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f97b0113020 0x7f97b00d76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f97b0113020 0x7f97b00d76e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a76350 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.625+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a76350 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a76350 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.629+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a76350 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x7f97b0113020 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a71990 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a755f0 con 0x55d0d0a76350 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:57.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a795d0 con 0x55d0d0a71990 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a799c0 con 0x55d0d0a71990 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.633+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a799c0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:57.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 zone default found 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 4 Realm: () 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 zonegroup default 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7db90 con 0x7f97b0113020 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7f680 con 0x55d0d0a7ac60 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7fb80 con 0x55d0d0a7ac60 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 started sync module instance, tier type = 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:57.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7ea20 con 0x55d0d0a76350 2024-09-10T06:22:57.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94355342224912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a7e680 con 0x55d0d0a76350 2024-09-10T06:22:57.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a80ab0 con 0x55d0d0a71990 2024-09-10T06:22:57.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.637+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94355342224912] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94355342231040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a80ed0 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a817a0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94355342233600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a82040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a82a60 con 0x55d0d0a76350 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94355342231040] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94355342232096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83300 con 0x55d0d0a76350 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.641+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83b50 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94355342232096] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94355342233600] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94355342241360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83720 con 0x55d0d0a71990 2024-09-10T06:22:57.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a843f0 con 0x7f97b0113020 2024-09-10T06:22:57.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94355342241360] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.645+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94355342242416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83690 con 0x7f97b0113020 2024-09-10T06:22:57.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a848d0 con 0x7f97b0113020 2024-09-10T06:22:57.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94355342246912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a84d80 con 0x7f97b0113020 2024-09-10T06:22:57.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a857f0 con 0x7f97b0113020 2024-09-10T06:22:57.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94355342242416] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.649+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94355342246912] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94355342250688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a848d0 con 0x7f97b0113020 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=0 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=1 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=2 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=3 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=4 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=5 2024-09-10T06:22:57.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=6 2024-09-10T06:22:57.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94355342250688] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 add_watcher() i=7 2024-09-10T06:22:57.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:57.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a888f0 con 0x55d0d0a71990 2024-09-10T06:22:57.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94355342245264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a85d70 con 0x55d0d0a71990 2024-09-10T06:22:57.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94355342245264] v30'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:57.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:57.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.653+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a91040 con 0x55d0d0a71990 2024-09-10T06:22:57.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.657+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.657+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a91040 con 0x7f97b0113020 2024-09-10T06:22:57.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.657+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.657+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a91b60 con 0x55d0d0a7ac60 2024-09-10T06:22:57.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a92580 con 0x55d0d0a71990 2024-09-10T06:22:57.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a8f6a0 con 0x55d0d0a76350 2024-09-10T06:22:57.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a8f6a0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.661+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a8f6a0 con 0x55d0d0a71990 2024-09-10T06:22:57.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.665+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.665+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a930e0 con 0x7f97b0113020 2024-09-10T06:22:57.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.665+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.665+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a930e0 con 0x55d0d0a76350 2024-09-10T06:22:57.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93170 con 0x55d0d0a7ac60 2024-09-10T06:22:57.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93620 con 0x55d0d0a76350 2024-09-10T06:22:57.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.669+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93620 con 0x7f97b0113020 2024-09-10T06:22:57.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.673+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.673+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93620 con 0x55d0d0a76350 2024-09-10T06:22:57.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.673+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.673+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93590 con 0x7f97b0113020 2024-09-10T06:22:57.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93590 con 0x55d0d0a71990 2024-09-10T06:22:57.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93590 con 0x55d0d0a7ac60 2024-09-10T06:22:57.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93590 con 0x55d0d0a76350 2024-09-10T06:22:57.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.677+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93590 con 0x55d0d0a7ac60 2024-09-10T06:22:57.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93640 con 0x55d0d0a71990 2024-09-10T06:22:57.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93640 con 0x55d0d0a71990 2024-09-10T06:22:57.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.681+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93640 con 0x55d0d0a7ac60 2024-09-10T06:22:57.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.685+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.685+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93640 con 0x55d0d0a76350 2024-09-10T06:22:57.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.685+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.685+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.689+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x7f97b0113020 2024-09-10T06:22:57.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.693+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x7f97b0113020 2024-09-10T06:22:57.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.697+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.697+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.697+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.697+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x7f97b0113020 2024-09-10T06:22:57.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.701+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.701+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a93af0 con 0x55d0d0a76350 2024-09-10T06:22:57.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f9674fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 20 Filter name: none 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f95ee7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0aaec50 con 0x7f97b0113020 2024-09-10T06:22:57.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:22:57.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T06:22:57.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:22:57.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:57.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1580 con 0x7f97b0113020 2024-09-10T06:22:57.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T06:22:57.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.705+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0aaf560 con 0x7f97b0113020 2024-09-10T06:22:57.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:57.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94355342426224 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1bd0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== watch-notify(notify (1) cookie 94355342233600 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d0d0a930e0 con 0x55d0d0a7ac60 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f96a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94355342233600 notifier 4526 bl.length()=170 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(97 notify.2 [notify cookie 94355342426224 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f96a2ffd640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9684003d70 con 0x55d0d0a7ac60 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== watch-notify(notify_complete (2) cookie 94355342426224 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0d0a8fa40 con 0x55d0d0a7ac60 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 10 removing email index: 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 10 removing user buckets index 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1b30 con 0x7f97b0113020 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94355342433072 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1080 con 0x7f97b0113020 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== watch-notify(notify (1) cookie 94355342246912 notify 128849018889 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d0d0a8fdf0 con 0x7f97b0113020 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f96a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94355342246912 notifier 4526 bl.length()=160 2024-09-10T06:22:57.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f96a2ffd640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9684003d70 con 0x7f97b0113020 2024-09-10T06:22:57.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.709+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(100 notify.6 [notify cookie 94355342433072 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== watch-notify(notify_complete (2) cookie 94355342433072 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0d0a91880 con 0x7f97b0113020 2024-09-10T06:22:57.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97c17e59c0 10 removing user index: fud 2024-09-10T06:22:57.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1b30 con 0x7f97b0113020 2024-09-10T06:22:57.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(102 fud [call,call,delete] v30'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97c17e59c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T06:22:57.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97c17e59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T06:22:57.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94355342433072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab0070 con 0x7f97b0113020 2024-09-10T06:22:57.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== watch-notify(notify (1) cookie 94355342242416 notify 128849018890 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d0d0a91880 con 0x7f97b0113020 2024-09-10T06:22:57.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f96a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94355342242416 notifier 4526 bl.length()=152 2024-09-10T06:22:57.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(103 notify.5 [notify cookie 94355342433072 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.713+0000 7f96a27fc640 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f95f40032d0 con 0x7f97b0113020 2024-09-10T06:22:57.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== watch-notify(notify_complete (2) cookie 94355342433072 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0d0a916b0 con 0x7f97b0113020 2024-09-10T06:22:57.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94355342245264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1b30 con 0x55d0d0a71990 2024-09-10T06:22:57.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94355342245264] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94355342224912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x55d0d0a76350 2024-09-10T06:22:57.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94355342224912] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97c17e59c0 20 remove_watcher() i=0 2024-09-10T06:22:57.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97c17e59c0 2 removed watcher, disabling cache 2024-09-10T06:22:57.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.717+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94355342231040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x55d0d0a71990 2024-09-10T06:22:57.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94355342231040] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97c17e59c0 20 remove_watcher() i=1 2024-09-10T06:22:57.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94355342233600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x55d0d0a7ac60 2024-09-10T06:22:57.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97beaea640 1 -- 172.21.15.117:0/2190167181 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94355342233600] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97a8037040 con 0x55d0d0a7ac60 2024-09-10T06:22:57.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97c17e59c0 20 remove_watcher() i=2 2024-09-10T06:22:57.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.721+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94355342232096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x55d0d0a76350 2024-09-10T06:22:57.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97bf2eb640 1 -- 172.21.15.117:0/2190167181 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94355342232096] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b00c53e0 con 0x55d0d0a76350 2024-09-10T06:22:57.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97c17e59c0 20 remove_watcher() i=3 2024-09-10T06:22:57.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94355342241360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x55d0d0a71990 2024-09-10T06:22:57.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94355342241360] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x55d0d0a71990 2024-09-10T06:22:57.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97c17e59c0 20 remove_watcher() i=4 2024-09-10T06:22:57.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.725+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94355342242416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a83d90 con 0x7f97b0113020 2024-09-10T06:22:57.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94355342242416] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97c17e59c0 20 remove_watcher() i=5 2024-09-10T06:22:57.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94355342246912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0ab1b30 con 0x7f97b0113020 2024-09-10T06:22:57.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94355342246912] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97c17e59c0 20 remove_watcher() i=6 2024-09-10T06:22:57.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.729+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94355342250688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0d0a84400 con 0x7f97b0113020 2024-09-10T06:22:57.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94355342250688] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97b800a4d0 con 0x7f97b0113020 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 20 remove_watcher() i=7 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f97b0113020 msgr2=0x7f97b00d76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f97b0113020 0x7f97b00d76e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d0a71990 msgr2=0x55d0d0a73e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d0a71990 0x55d0d0a73e20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a76350 msgr2=0x55d0d0a78740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a76350 0x55d0d0a78740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a7ac60 msgr2=0x55d0d0a7d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a7ac60 0x55d0d0a7d090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9688039a70 msgr2=0x7f968803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9688039a70 0x7f968803bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97a8001ec0 tx=0x7f97a8010000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 msgr2=0x55d0d0a66750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/2190167181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a60420 0x55d0d0a66750 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97b00c5970 tx=0x7f97b00c0fa0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97bfaec640 1 -- 172.21.15.117:0/2190167181 reap_dead start 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 shutdown_connections 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 >> 172.21.15.117:0/2190167181 conn(0x55d0d0a5b840 msgr2=0x55d0d0a59a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 shutdown_connections 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/2190167181 wait complete. 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 msgr2=0x7f969803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 0x7f969803bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55d0d0a45660 tx=0x7f97a800f000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 msgr2=0x55d0d0a53140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f97b0018f70 tx=0x7f97b00eb6b0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 shutdown_connections 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9698039a70 0x7f969803bf30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/75582319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d0a52d20 0x55d0d0a53140 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 >> 172.21.15.117:0/75582319 conn(0x55d0d0a486d0 msgr2=0x55d0d0a48ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 shutdown_connections 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/75582319 wait complete. 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d08b4b50 msgr2=0x55d0d0a3c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55d0d08b4b50 0x55d0d0a3c040 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a3e7e0 msgr2=0x55d0d0a40bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55d0d0a3e7e0 0x55d0d0a40bd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a426e0 msgr2=0x55d0d0a44ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55d0d0a426e0 0x55d0d0a44ad0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f96a4039a70 msgr2=0x7f96a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f96a4039a70 0x7f96a403bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f97a8001e90 tx=0x7f97a80013f0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 msgr2=0x55d0d0a34ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 --2- 172.21.15.117:0/4294674647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0d08b4770 0x55d0d0a34ed0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c10 tx=0x7f97b00180e0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97bfaec640 1 -- 172.21.15.117:0/4294674647 reap_dead start 2024-09-10T06:22:57.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 shutdown_connections 2024-09-10T06:22:57.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 >> 172.21.15.117:0/4294674647 conn(0x55d0d093ae90 msgr2=0x55d0d0a280a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 shutdown_connections 2024-09-10T06:22:57.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.733+0000 7f97c17e59c0 1 -- 172.21.15.117:0/4294674647 wait complete. 2024-09-10T06:22:57.745 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T06:22:57.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T06:22:57.745 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T06:22:57.829 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:57.829 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:57.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf718759c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5581e2c131a0 0x5581e2c1a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf718759c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581e2ac89c0 con 0x5581e2c12680 2024-09-10T06:22:57.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf718759c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5581e2b186d0 con 0x5581e2c131a0 2024-09-10T06:22:57.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6eb7a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5581e2c131a0 0x5581e2c1a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6eb7a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5581e2c131a0 0x5581e2c1a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52430/0 (socket says 172.21.15.117:52430) 2024-09-10T06:22:57.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/1217869990 learned_addr learned my addr 172.21.15.117:0/1217869990 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6f37b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5581e2c12680 0x5581e2c12a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52544/0 (socket says 172.21.15.117:52544) 2024-09-10T06:22:57.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/1217869990 >> v1:172.21.15.84:6789/0 conn(0x5581e2c12680 legacy=0x5581e2c12a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.829+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/1217869990 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2abcca0 con 0x5581e2c131a0 2024-09-10T06:22:57.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/1217869990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c131a0 0x5581e2c1a9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800a5c0 tx=0x7fbf5801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f86dd990062b166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf6e379640 1 -- 172.21.15.117:0/1217869990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf580a6070 con 0x5581e2c131a0 2024-09-10T06:22:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf6e379640 1 -- 172.21.15.117:0/1217869990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf580af070 con 0x5581e2c131a0 2024-09-10T06:22:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf6e379640 1 -- 172.21.15.117:0/1217869990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf580aa5c0 con 0x5581e2c131a0 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 -- 172.21.15.117:0/1217869990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c131a0 msgr2=0x5581e2c1a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1217869990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c131a0 0x5581e2c1a9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800a5c0 tx=0x7fbf5801b340 comp rx=0 tx=0).stop 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 -- 172.21.15.117:0/1217869990 shutdown_connections 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1217869990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c131a0 0x5581e2c1a9d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 -- 172.21.15.117:0/1217869990 >> 172.21.15.117:0/1217869990 conn(0x5581e2c0e5d0 msgr2=0x5581e2c109f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 -- 172.21.15.117:0/1217869990 shutdown_connections 2024-09-10T06:22:57.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.833+0000 7fbf718759c0 1 -- 172.21.15.117:0/1217869990 wait complete. 2024-09-10T06:22:57.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf718759c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf718759c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5581e2b1c680 con 0x5581e2c12680 2024-09-10T06:22:57.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52434/0 (socket says 172.21.15.117:52434) 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.845+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3547599967 learned_addr learned my addr 172.21.15.117:0/3547599967 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3547599967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2a97da0 con 0x5581e2c12680 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3547599967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbf680016f0 tx=0x7fbf68001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7710a38b6e816b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbe5d60a640 1 -- 172.21.15.117:0/3547599967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68003460 con 0x5581e2c12680 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbe5d60a640 1 -- 172.21.15.117:0/3547599967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68003620 con 0x5581e2c12680 2024-09-10T06:22:57.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbe5d60a640 1 -- 172.21.15.117:0/3547599967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68003940 con 0x5581e2c12680 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3547599967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 msgr2=0x5581e2c14eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3547599967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbf680016f0 tx=0x7fbf68001bb0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3547599967 shutdown_connections 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3547599967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2c14eb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3547599967 >> 172.21.15.117:0/3547599967 conn(0x5581e2c0e5d0 msgr2=0x5581e2cfb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3547599967 shutdown_connections 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3547599967 wait complete. 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2d090b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5581e2abea50 con 0x5581e2c12680 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2d090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2d090b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52450/0 (socket says 172.21.15.117:52450) 2024-09-10T06:22:57.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3758191758 learned_addr learned my addr 172.21.15.117:0/3758191758 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2d09610 con 0x5581e2c12680 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2d090b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5581e2c14a70 tx=0x7fbf68001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbe5be07640 1 -- 172.21.15.117:0/3758191758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68022020 con 0x5581e2c12680 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbe5be07640 1 -- 172.21.15.117:0/3758191758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6801e480 con 0x5581e2c12680 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.849+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581e2d098a0 con 0x5581e2c12680 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e2d0a2d0 con 0x5581e2c12680 2024-09-10T06:22:57.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbe5be07640 1 -- 172.21.15.117:0/3758191758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf6801e760 con 0x5581e2c12680 2024-09-10T06:22:57.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbe5be07640 1 -- 172.21.15.117:0/3758191758 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbf68025020 con 0x5581e2c12680 2024-09-10T06:22:57.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbe5be07640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe54039a70 0x7fbe5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbe5be07640 1 -- 172.21.15.117:0/3758191758 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbf6804ffe0 con 0x5581e2c12680 2024-09-10T06:22:57.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2c131a0 0x5581e2d10220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe54039a70 0x7fbe5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d10760 con 0x5581e2c131a0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2c131a0 0x5581e2d10220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe54039a70 0x7fbe5403bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf580ae000 tx=0x7fbf580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2c131a0 0x5581e2d10220 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3758191758 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2c131a0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d0a560 con 0x5581e2c131a0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3758191758 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2c131a0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d129d0 0x5581e2d14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d15490 con 0x5581e2d129d0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d129d0 0x5581e2d14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d129d0 0x5581e2d14dc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3758191758 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf6801b040 con 0x5581e2d129d0 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d11870 con 0x5581e2c131a0 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3758191758 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2c131a0 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d168d0 0x5581e2d18cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d19450 con 0x5581e2d168d0 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.853+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d168d0 0x5581e2d18cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d168d0 0x5581e2d18cc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3758191758 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d168d0 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5581e2b29450 con 0x5581e2d26f10 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52456/0 (socket says 172.21.15.117:52456) 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6f37b640 1 -- 172.21.15.117:0/1948825044 learned_addr learned my addr 172.21.15.117:0/1948825044 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6f37b640 1 -- 172.21.15.117:0/1948825044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2d27970 con 0x5581e2d26f10 2024-09-10T06:22:57.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf6804e580 tx=0x7fbf68048c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbe59602640 1 -- 172.21.15.117:0/1948825044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf6804ea60 con 0x5581e2d26f10 2024-09-10T06:22:57.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581e2d281d0 con 0x5581e2d26f10 2024-09-10T06:22:57.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbe59602640 1 -- 172.21.15.117:0/1948825044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6804ec00 con 0x5581e2d26f10 2024-09-10T06:22:57.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e2d28740 con 0x5581e2d26f10 2024-09-10T06:22:57.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbe59602640 1 -- 172.21.15.117:0/1948825044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf6801e900 con 0x5581e2d26f10 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.857+0000 7fbe59602640 1 -- 172.21.15.117:0/1948825044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbf6801eaa0 con 0x5581e2d26f10 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbe59602640 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 0x7fbe4803bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbe59602640 1 -- 172.21.15.117:0/1948825044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbf68049030 con 0x5581e2d26f10 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 0x7fbe4803bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 0x7fbe4803bec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbf5801b380 tx=0x7fbf58005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5581e2c156a0 con 0x5581e2d34760 2024-09-10T06:22:57.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52460/0 (socket says 172.21.15.117:52460) 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3736058638 learned_addr learned my addr 172.21.15.117:0/3736058638 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3736058638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2d35110 con 0x5581e2d34760 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3736058638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbf68004e20 tx=0x7fbf6802f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a0a506aae46b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbe52ffd640 1 -- 172.21.15.117:0/3736058638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68039af0 con 0x5581e2d34760 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbe52ffd640 1 -- 172.21.15.117:0/3736058638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf680473f0 con 0x5581e2d34760 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbe52ffd640 1 -- 172.21.15.117:0/3736058638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68011d30 con 0x5581e2d34760 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- 172.21.15.117:0/3736058638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 msgr2=0x5581e2d34b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3736058638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbf68004e20 tx=0x7fbf6802f5c0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- 172.21.15.117:0/3736058638 shutdown_connections 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3736058638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d34b40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- 172.21.15.117:0/3736058638 >> 172.21.15.117:0/3736058638 conn(0x5581e2d2fb20 msgr2=0x5581e2d2dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- 172.21.15.117:0/3736058638 shutdown_connections 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- 172.21.15.117:0/3736058638 wait complete. 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 Processor -- start 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- start start 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf718759c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5581e2d334d0 con 0x5581e2d34760 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52472/0 (socket says 172.21.15.117:52472) 2024-09-10T06:22:57.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.861+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 learned_addr learned my addr 172.21.15.117:0/3114309655 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e2d3af70 con 0x5581e2d34760 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf68007e10 tx=0x7fbf68019f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 -- 172.21.15.117:0/3114309655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68039400 con 0x5581e2d34760 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581e2d3af70 con 0x5581e2d34760 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e2d3af70 con 0x5581e2d34760 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 -- 172.21.15.117:0/3114309655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68068070 con 0x5581e2d34760 2024-09-10T06:22:57.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 -- 172.21.15.117:0/3114309655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68039cd0 con 0x5581e2d34760 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 -- 172.21.15.117:0/3114309655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbf68030430 con 0x5581e2d34760 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe38039a20 0x7fbe3803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbe517fa640 1 -- 172.21.15.117:0/3114309655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fbf680660e0 con 0x5581e2d34760 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe38039a20 0x7fbe3803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2d45a20 0x5581e2d47ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.865+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d48630 con 0x5581e2d45a20 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2d45a20 0x5581e2d47ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe38039a20 0x7fbe3803bee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5581e2d19850 tx=0x7fbf580c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2d45a20 0x5581e2d47ee0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2d45a20 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 realm 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d48a40 con 0x5581e2d45a20 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2d45a20 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d49310 con 0x5581e2d45a20 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2d45a20 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2d45a20 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d4a410 0x5581e2d4c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d4ce10 con 0x5581e2d4a410 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d4a410 0x5581e2d4c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d4a410 0x5581e2d4c800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 20 searching for the correct realm 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d4ed60 0x5581e2d51170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d517f0 con 0x5581e2d4ed60 2024-09-10T06:22:57.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d4ed60 0x5581e2d51170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6eb7a640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d4ed60 0x5581e2d51170 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d517f0 con 0x5581e2d4a410 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbf68027020 0x7fbf680535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d517f0 con 0x7fbf68027020 2024-09-10T06:22:57.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.869+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbf68027020 0x7fbf680535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:57.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbf68027020 0x7fbf680535c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:57.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf600083f0 con 0x7fbf68027020 2024-09-10T06:22:57.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf600083f0 con 0x5581e2d45a20 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4a410 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.873+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4a410 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4a410 2024-09-10T06:22:57.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.877+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4a410 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4ed60 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x7fbf68027020 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d45a20 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d496b0 con 0x5581e2d4a410 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d4d6d0 con 0x5581e2d45a20 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d4dac0 con 0x5581e2d45a20 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d4dac0 con 0x5581e2d4ed60 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 zone default found 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 4 Realm: () 2024-09-10T06:22:57.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 zonegroup default 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.881+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d51c70 con 0x7fbf68027020 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d53760 con 0x5581e2d4ed60 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d53b80 con 0x5581e2d4ed60 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 started sync module instance, tier type = 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d52b00 con 0x5581e2d4a410 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94016344764144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d52760 con 0x5581e2d4a410 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d54a80 con 0x5581e2d45a20 2024-09-10T06:22:57.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94016344764144] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94016344770000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d549f0 con 0x5581e2d45a20 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.885+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d55810 con 0x5581e2d4ed60 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94016344770000] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94016344772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d55c30 con 0x5581e2d4ed60 2024-09-10T06:22:57.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d565f0 con 0x5581e2d4a410 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94016344777296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d56e90 con 0x5581e2d4a410 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d57850 con 0x5581e2d45a20 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.889+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94016344772208] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94016344777296] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94016344781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d56e90 con 0x5581e2d45a20 2024-09-10T06:22:57.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d577c0 con 0x7fbf68027020 2024-09-10T06:22:57.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94016344781728] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94016344779232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d56e00 con 0x7fbf68027020 2024-09-10T06:22:57.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.893+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d586c0 con 0x7fbf68027020 2024-09-10T06:22:57.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94016344779232] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94016344783856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d586c0 con 0x7fbf68027020 2024-09-10T06:22:57.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d59080 con 0x7fbf68027020 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94016344783856] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94016344785904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d59080 con 0x7fbf68027020 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=0 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=1 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=2 2024-09-10T06:22:57.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=3 2024-09-10T06:22:57.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=4 2024-09-10T06:22:57.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=5 2024-09-10T06:22:57.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.897+0000 7fbf718759c0 20 add_watcher() i=6 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94016344785904] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 add_watcher() i=7 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d5c3e0 con 0x5581e2d45a20 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94016344788288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d59610 con 0x5581e2d45a20 2024-09-10T06:22:57.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94016344788288] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbe267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:57.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:57.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 5 note: GC not initialized 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbe257e2640 20 reqs_thread_entry: start 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 Filter name: none 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbe1e7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.901+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7fcf0 con 0x7fbf68027020 2024-09-10T06:22:57.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7e2e0 con 0x7fbf68027020 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:22:57.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d82e70 con 0x7fbf68027020 2024-09-10T06:22:57.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94016344958992 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d839e0 con 0x5581e2d4a410 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== watch-notify(notify (1) cookie 94016344777296 notify 128849018898 ret 0) ==== 652+0+0 (crc 0 0 0) 0x5581e2d281d0 con 0x5581e2d4a410 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbe52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94016344777296 notifier 4533 bl.length()=610 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbe52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbe52ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 notify.3 [notify cookie 94016344958992 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.905+0000 7fbe52ffd640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbe34003eb0 con 0x5581e2d4a410 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== watch-notify(notify_complete (2) cookie 94016344958992 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581e2d27970 con 0x5581e2d4a410 2024-09-10T06:22:57.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d827e0 con 0x7fbf68027020 2024-09-10T06:22:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94016344958896 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d81cf0 con 0x5581e2d4ed60 2024-09-10T06:22:57.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 94016344772208 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x5581e2abcca0 con 0x5581e2d4ed60 2024-09-10T06:22:57.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbe527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94016344772208 notifier 4533 bl.length()=192 2024-09-10T06:22:57.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 notify.2 [notify cookie 94016344958896 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbe527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:22:57.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbe527fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:22:57.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbe527fc640 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbd98003410 con 0x5581e2d4ed60 2024-09-10T06:22:57.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== watch-notify(notify_complete (2) cookie 94016344958896 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbf580bf720 con 0x5581e2d4ed60 2024-09-10T06:22:57.916 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T06:22:57.908561Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:57.908547Z","tags":[],"group_ids":[]} 2024-09-10T06:22:57.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbe267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.909+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94016344788288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d45a20 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94016344788288] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94016344764144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d4a410 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94016344764144] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 20 remove_watcher() i=0 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 2 removed watcher, disabling cache 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94016344770000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d45a20 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94016344770000] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 20 remove_watcher() i=1 2024-09-10T06:22:57.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.913+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94016344772208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d4ed60 2024-09-10T06:22:57.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf6eb7a640 1 -- 172.21.15.117:0/3114309655 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94016344772208] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf580aaa70 con 0x5581e2d4ed60 2024-09-10T06:22:57.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf718759c0 20 remove_watcher() i=2 2024-09-10T06:22:57.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94016344777296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d4a410 2024-09-10T06:22:57.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf6f37b640 1 -- 172.21.15.117:0/3114309655 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94016344777296] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68036020 con 0x5581e2d4a410 2024-09-10T06:22:57.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf718759c0 20 remove_watcher() i=3 2024-09-10T06:22:57.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.917+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94016344781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x5581e2d45a20 2024-09-10T06:22:57.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94016344781728] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x5581e2d45a20 2024-09-10T06:22:57.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf718759c0 20 remove_watcher() i=4 2024-09-10T06:22:57.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94016344779232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x7fbf68027020 2024-09-10T06:22:57.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94016344779232] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf718759c0 20 remove_watcher() i=5 2024-09-10T06:22:57.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.921+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94016344783856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x7fbf68027020 2024-09-10T06:22:57.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94016344783856] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 20 remove_watcher() i=6 2024-09-10T06:22:57.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94016344785904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581e2d7d820 con 0x7fbf68027020 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94016344785904] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf60026040 con 0x7fbf68027020 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 20 remove_watcher() i=7 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbf68027020 msgr2=0x7fbf680535c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbf68027020 0x7fbf680535c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2d45a20 msgr2=0x5581e2d47ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2d45a20 0x5581e2d47ee0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d4a410 msgr2=0x5581e2d4c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d4a410 0x5581e2d4c800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d4ed60 msgr2=0x5581e2d51170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d4ed60 0x5581e2d51170 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe38039a20 msgr2=0x7fbe3803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe38039a20 0x7fbe3803bee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5581e2d19850 tx=0x7fbf580c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 msgr2=0x5581e2d3aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf68007e10 tx=0x7fbf68019f70 comp rx=0 tx=0).stop 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3114309655 reap_dead start 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 shutdown_connections 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3114309655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d34760 0x5581e2d3aa10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 >> 172.21.15.117:0/3114309655 conn(0x5581e2d2fb20 msgr2=0x5581e2d2dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 shutdown_connections 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3114309655 wait complete. 2024-09-10T06:22:57.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 msgr2=0x7fbe4803bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 0x7fbe4803bec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbf5801b380 tx=0x7fbf58005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 msgr2=0x5581e2d27330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbf6804e580 tx=0x7fbf68048c20 comp rx=0 tx=0).stop 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 shutdown_connections 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe48039a00 0x7fbe4803bec0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/1948825044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2d26f10 0x5581e2d27330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 >> 172.21.15.117:0/1948825044 conn(0x5581e2d1c8c0 msgr2=0x5581e2d1cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 shutdown_connections 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/1948825044 wait complete. 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2c131a0 msgr2=0x5581e2d10220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5581e2c131a0 0x5581e2d10220 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d129d0 msgr2=0x5581e2d14dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5581e2d129d0 0x5581e2d14dc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d168d0 msgr2=0x5581e2d18cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5581e2d168d0 0x5581e2d18cc0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe54039a70 msgr2=0x7fbe5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbe54039a70 0x7fbe5403bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf580ae000 tx=0x7fbf580a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 msgr2=0x5581e2d090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 --2- 172.21.15.117:0/3758191758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5581e2c12680 0x5581e2d090b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5581e2c14a70 tx=0x7fbf68001260 comp rx=0 tx=0).stop 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf6fb7c640 1 -- 172.21.15.117:0/3758191758 reap_dead start 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 shutdown_connections 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 >> 172.21.15.117:0/3758191758 conn(0x5581e2c0e5d0 msgr2=0x5581e2c13b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 shutdown_connections 2024-09-10T06:22:57.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:57.925+0000 7fbf718759c0 1 -- 172.21.15.117:0/3758191758 wait complete. 2024-09-10T06:22:57.938 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T06:22:57.908561Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:57.908547Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:57.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T06:22:57.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T06:22:57.939 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-10T06:22:58.019 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:58.019 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09d1009c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ce423ddae0 0x55ce42471c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09d1009c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce4231d9c0 con 0x55ce423dd700 2024-09-10T06:22:58.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09d1009c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55ce4236d6d0 con 0x55ce423ddae0 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09a405640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ce423ddae0 0x55ce42471c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09a405640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ce423ddae0 0x55ce42471c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52480/0 (socket says 172.21.15.117:52480) 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09ac06640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55ce423dd700 0x55ce4246e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52552/0 (socket says 172.21.15.117:52552) 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09a405640 1 -- 172.21.15.117:0/742739475 learned_addr learned my addr 172.21.15.117:0/742739475 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09a405640 1 -- 172.21.15.117:0/742739475 >> v1:172.21.15.84:6789/0 conn(0x55ce423dd700 legacy=0x55ce4246e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.017+0000 7fb09a405640 1 -- 172.21.15.117:0/742739475 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42311ca0 con 0x55ce423ddae0 2024-09-10T06:22:58.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09a405640 1 --2- 172.21.15.117:0/742739475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423ddae0 0x55ce42471c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb09000a5c0 tx=0x7fb09001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393813293c04847d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb099c04640 1 -- 172.21.15.117:0/742739475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0900a6070 con 0x55ce423ddae0 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb099c04640 1 -- 172.21.15.117:0/742739475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900af070 con 0x55ce423ddae0 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb099c04640 1 -- 172.21.15.117:0/742739475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0900aa5c0 con 0x55ce423ddae0 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 -- 172.21.15.117:0/742739475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423ddae0 msgr2=0x55ce42471c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/742739475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423ddae0 0x55ce42471c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb09000a5c0 tx=0x7fb09001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 -- 172.21.15.117:0/742739475 shutdown_connections 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/742739475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423ddae0 0x55ce42471c60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 -- 172.21.15.117:0/742739475 >> 172.21.15.117:0/742739475 conn(0x55ce42463e20 msgr2=0x55ce42466240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 -- 172.21.15.117:0/742739475 shutdown_connections 2024-09-10T06:22:58.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.021+0000 7fb09d1009c0 1 -- 172.21.15.117:0/742739475 wait complete. 2024-09-10T06:22:58.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.033+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.033+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.033+0000 7fb09d1009c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.033+0000 7fb09d1009c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce42371680 con 0x55ce423dd700 2024-09-10T06:22:58.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52484/0 (socket says 172.21.15.117:52484) 2024-09-10T06:22:58.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 -- 172.21.15.117:0/3775902471 learned_addr learned my addr 172.21.15.117:0/3775902471 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 -- 172.21.15.117:0/3775902471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce422ecda0 con 0x55ce423dd700 2024-09-10T06:22:58.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- 172.21.15.117:0/3775902471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb08c001ec0 tx=0x7fb08c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f628e9061727f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf88e09640 1 -- 172.21.15.117:0/3775902471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c00e5d0 con 0x55ce423dd700 2024-09-10T06:22:58.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf88e09640 1 -- 172.21.15.117:0/3775902471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c00e770 con 0x55ce423dd700 2024-09-10T06:22:58.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf88e09640 1 -- 172.21.15.117:0/3775902471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c00ea70 con 0x55ce423dd700 2024-09-10T06:22:58.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/3775902471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 msgr2=0x55ce42556a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/3775902471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb08c001ec0 tx=0x7fb08c00b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/3775902471 shutdown_connections 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/3775902471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce42556a20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/3775902471 >> 172.21.15.117:0/3775902471 conn(0x55ce42463e20 msgr2=0x55ce425526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/3775902471 shutdown_connections 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/3775902471 wait complete. 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce4255e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce42313a50 con 0x55ce423dd700 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce4255e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce4255e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52498/0 (socket says 172.21.15.117:52498) 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 -- 172.21.15.117:0/1954556171 learned_addr learned my addr 172.21.15.117:0/1954556171 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4255e620 con 0x55ce423dd700 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09ac06640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce4255e0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55ce42557a10 tx=0x7fb08c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf87606640 1 -- 172.21.15.117:0/1954556171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c00f8e0 con 0x55ce423dd700 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4255e8b0 con 0x55ce423dd700 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf87606640 1 -- 172.21.15.117:0/1954556171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c00fa80 con 0x55ce423dd700 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.037+0000 7faf87606640 1 -- 172.21.15.117:0/1954556171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c00fda0 con 0x55ce423dd700 2024-09-10T06:22:58.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4255f260 con 0x55ce423dd700 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7faf87606640 1 -- 172.21.15.117:0/1954556171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb08c017070 con 0x55ce423dd700 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7faf87606640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf80039a70 0x7faf8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7faf87606640 1 -- 172.21.15.117:0/1954556171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb08c015020 con 0x55ce423dd700 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09a405640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf80039a70 0x7faf8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce423ddae0 0x55ce42565230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce42565770 con 0x55ce423ddae0 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09b407640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce423ddae0 0x55ce42565230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09a405640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf80039a70 0x7faf8003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0900ae000 tx=0x7fb0900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09b407640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce423ddae0 0x55ce42565230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09b407640 1 -- 172.21.15.117:0/1954556171 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce423ddae0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce42565bc0 con 0x55ce423ddae0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09b407640 1 -- 172.21.15.117:0/1954556171 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce423ddae0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce425679d0 0x55ce42569dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4256a490 con 0x55ce425679d0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09ac06640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce425679d0 0x55ce42569dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09ac06640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce425679d0 0x55ce42569dc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09ac06640 1 -- 172.21.15.117:0/1954556171 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb08c02e070 con 0x55ce425679d0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce42566870 con 0x55ce423ddae0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09b407640 1 -- 172.21.15.117:0/1954556171 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce423ddae0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce4256b8d0 0x55ce4256dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4256e450 con 0x55ce4256b8d0 2024-09-10T06:22:58.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.041+0000 7fb09a405640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce4256b8d0 0x55ce4256dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09a405640 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce4256b8d0 0x55ce4256dcc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09a405640 1 -- 172.21.15.117:0/1954556171 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce4256b8d0 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce4237e450 con 0x55ce4257bf10 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52510/0 (socket says 172.21.15.117:52510) 2024-09-10T06:22:58.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09ac06640 1 -- 172.21.15.117:0/2249506750 learned_addr learned my addr 172.21.15.117:0/2249506750 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09ac06640 1 -- 172.21.15.117:0/2249506750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4257c970 con 0x55ce4257bf10 2024-09-10T06:22:58.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb08c017aa0 tx=0x7fb08c019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7faf84e01640 1 -- 172.21.15.117:0/2249506750 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c0193e0 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7faf84e01640 1 -- 172.21.15.117:0/2249506750 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c035070 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7faf84e01640 1 -- 172.21.15.117:0/2249506750 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c0196f0 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4257d1d0 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4257d1d0 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.045+0000 7faf84e01640 1 -- 172.21.15.117:0/2249506750 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb08c01a480 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7faf84e01640 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 0x7faf7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7faf84e01640 1 -- 172.21.15.117:0/2249506750 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb08c03bb10 con 0x55ce4257bf10 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09a405640 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 0x7faf7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09a405640 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 0x7faf7403bf80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb09001b380 tx=0x7fb090005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce42557250 con 0x55ce42589490 2024-09-10T06:22:58.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52522/0 (socket says 172.21.15.117:52522) 2024-09-10T06:22:58.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 -- 172.21.15.117:0/2796009792 learned_addr learned my addr 172.21.15.117:0/2796009792 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 -- 172.21.15.117:0/2796009792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42589e60 con 0x55ce42589490 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2796009792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb08c017cd0 tx=0x7fb08c0277f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72558b09d2e20c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2796009792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c060070 con 0x55ce42589490 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2796009792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c057040 con 0x55ce42589490 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2796009792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c056070 con 0x55ce42589490 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2796009792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 msgr2=0x55ce42589870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2796009792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb08c017cd0 tx=0x7fb08c0277f0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2796009792 shutdown_connections 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2796009792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce42589870 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2796009792 >> 172.21.15.117:0/2796009792 conn(0x55ce42584850 msgr2=0x55ce42582a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2796009792 shutdown_connections 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2796009792 wait complete. 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 Processor -- start 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- start start 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce4258f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09d1009c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce42588200 con 0x55ce42589490 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce4258f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce4258f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52530/0 (socket says 172.21.15.117:52530) 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 learned_addr learned my addr 172.21.15.117:0/2600593907 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.049+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4258fcc0 con 0x55ce42589490 2024-09-10T06:22:58.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce4258f760 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0174d0 tx=0x7fb08c023f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 -- 172.21.15.117:0/2600593907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c068070 con 0x55ce42589490 2024-09-10T06:22:58.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4258fcc0 con 0x55ce42589490 2024-09-10T06:22:58.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4258fcc0 con 0x55ce42589490 2024-09-10T06:22:58.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 -- 172.21.15.117:0/2600593907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c042350 con 0x55ce42589490 2024-09-10T06:22:58.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 -- 172.21.15.117:0/2600593907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c072060 con 0x55ce42589490 2024-09-10T06:22:58.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 -- 172.21.15.117:0/2600593907 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb08c06b070 con 0x55ce42589490 2024-09-10T06:22:58.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf640399d0 0x7faf6403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7faf7cff9640 1 -- 172.21.15.117:0/2600593907 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fb08c045110 con 0x55ce42589490 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09a405640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf640399d0 0x7faf6403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce4259a8c0 0x55ce4259cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259d4a0 con 0x55ce4259a8c0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce4259a8c0 0x55ce4259cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09a405640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf640399d0 0x7faf6403be90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55ce4256e850 tx=0x7fb0900c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce4259a8c0 0x55ce4259cd50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 realm 2024-09-10T06:22:58.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259d8b0 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e180 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce4259f280 0x55ce425a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a1c40 con 0x55ce4259f280 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.053+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce4259f280 0x55ce425a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce4259f280 0x55ce425a1670 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09d1009c0 20 searching for the correct realm 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce425a3b90 0x55ce425a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a6640 con 0x55ce425a3b90 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09a405640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce425a3b90 0x55ce425a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09a405640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce425a3b90 0x55ce425a5fc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a6640 con 0x55ce4259f280 2024-09-10T06:22:58.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09ac06640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb08c06d070 0x7fb08c003560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a6640 con 0x7fb08c06d070 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb08c06d070 0x7fb08c003560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb08c06d070 0x7fb08c003560 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.057+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259f280 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259f280 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.061+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259f280 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259f280 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce425a3b90 2024-09-10T06:22:58.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.065+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x7fb08c06d070 2024-09-10T06:22:58.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259a8c0 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ce4259e520 con 0x55ce4259f280 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a2500 con 0x55ce4259a8c0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a28f0 con 0x55ce4259a8c0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a28f0 con 0x55ce425a3b90 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 zone default found 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 4 Realm: () 2024-09-10T06:22:58.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 zonegroup default 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a6ac0 con 0x7fb08c06d070 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a85b0 con 0x55ce425a3b90 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a89d0 con 0x55ce425a3b90 2024-09-10T06:22:58.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 started sync module instance, tier type = 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.069+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a7950 con 0x55ce4259f280 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344364850496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a75b0 con 0x55ce4259f280 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a98e0 con 0x55ce4259a8c0 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344364850496] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344364856368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425a9d00 con 0x55ce4259a8c0 2024-09-10T06:22:58.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.073+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425aa5d0 con 0x55ce425a3b90 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344364858928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425aae70 con 0x55ce425a3b90 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ab890 con 0x55ce4259f280 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344364856368] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344364857424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ac130 con 0x55ce4259f280 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ac980 con 0x55ce4259a8c0 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344364857424] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344364858928] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344364866688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ac550 con 0x55ce4259a8c0 2024-09-10T06:22:58.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.077+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ad220 con 0x7fb08c06d070 2024-09-10T06:22:58.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344364870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ac550 con 0x7fb08c06d070 2024-09-10T06:22:58.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425adc30 con 0x7fb08c06d070 2024-09-10T06:22:58.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344364866688] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344364870672] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.081+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344364873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ac100 con 0x7fb08c06d070 2024-09-10T06:22:58.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ae2c0 con 0x7fb08c06d070 2024-09-10T06:22:58.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344364873472] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344364871728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ae2c0 con 0x7fb08c06d070 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=0 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=1 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=2 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=3 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=4 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=5 2024-09-10T06:22:58.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.085+0000 7fb09d1009c0 20 add_watcher() i=6 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344364871728] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 add_watcher() i=7 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425b13f0 con 0x55ce4259a8c0 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344364875280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425ae6e0 con 0x55ce4259a8c0 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344364875280] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7faf517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 5 note: GC not initialized 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7faecbfff640 20 reqs_thread_entry: start 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 Filter name: none 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7faec9ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T06:22:58.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d4c40 con 0x7fb08c06d070 2024-09-10T06:22:58.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.089+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d4590 con 0x55ce4259f280 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv25 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:58.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d83f0 con 0x55ce4259a8c0 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(64 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:58.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425dc970 con 0x55ce4259f280 2024-09-10T06:22:58.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.093+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 8.4 8:243f315a:root::.bucket.meta.testx%3amyfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425e0620 con 0x55ce4259f280 2024-09-10T06:22:58.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [create,call,writefull 0~420,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x7 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94344365082064 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425de260 con 0x55ce4259a8c0 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94344364866688 notify 128849018891 ret 0) ==== 897+0+0 (crc 0 0 0) 0x55ce425d87e0 con 0x55ce4259a8c0 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94344364866688 notifier 4540 bl.length()=855 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(67 notify.4 [notify cookie 94344365082064 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x7 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faf60003eb0 con 0x55ce4259a8c0 2024-09-10T06:22:58.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94344365082064 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce425d79f0 con 0x55ce4259a8c0 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 20 handle_bi_update(): bucket=testx:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 20 handle_bi_update(): bucket=testx:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 20 handle_bi_update(): bucket=testx:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 20 handle_bi_update(): bucket=testx:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:58.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425e0590 con 0x55ce4259a8c0 2024-09-10T06:22:58.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425de260 con 0x55ce4259a8c0 2024-09-10T06:22:58.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94344365074352 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425de260 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== watch-notify(notify (1) cookie 94344364866688 notify 128849018892 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55ce425e0820 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94344364866688 notifier 4540 bl.length()=348 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faf60003eb0 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(71 notify.4 [notify cookie 94344365074352 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.097+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== watch-notify(notify_complete (2) cookie 94344365074352 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce425e0590 con 0x55ce4259a8c0 2024-09-10T06:22:58.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425dcda0 con 0x55ce4259f280 2024-09-10T06:22:58.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(73 myfoo [call,delete] v30'27 uv27 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09d1009c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T06:22:58.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09d1009c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:58.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94344365074352 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425df440 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== watch-notify(notify (1) cookie 94344364873472 notify 128849018891 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ce425e0590 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7faf7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94344364873472 notifier 4540 bl.length()=149 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7faf7dffb640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faed00032d0 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(74 notify.6 [notify cookie 94344365074352 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== watch-notify(notify_complete (2) cookie 94344365074352 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce425d79f0 con 0x7fb08c06d070 2024-09-10T06:22:58.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.101+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425db420 con 0x55ce4259a8c0 2024-09-10T06:22:58.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(76 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call,delete] v30'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09d1009c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 from cache 2024-09-10T06:22:58.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09d1009c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:58.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94344365050480 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ce425db420 con 0x7fb08c06d070 2024-09-10T06:22:58.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== watch-notify(notify (1) cookie 94344364870672 notify 128849018892 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ce425d79f0 con 0x7fb08c06d070 2024-09-10T06:22:58.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7faf7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94344364870672 notifier 4540 bl.length()=206 2024-09-10T06:22:58.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7faf7e7fc640 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7faf60003eb0 con 0x7fb08c06d070 2024-09-10T06:22:58.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(77 notify.5 [notify cookie 94344365050480 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.105+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== watch-notify(notify_complete (2) cookie 94344365050480 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb094053020 con 0x7fb08c06d070 2024-09-10T06:22:58.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7faf517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344364875280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425b07d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94344364875280] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344364850496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x55ce4259f280 2024-09-10T06:22:58.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94344364850496] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09d1009c0 20 remove_watcher() i=0 2024-09-10T06:22:58.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09d1009c0 2 removed watcher, disabling cache 2024-09-10T06:22:58.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.109+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344364856368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x55ce4259a8c0 2024-09-10T06:22:58.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94344364856368] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 20 remove_watcher() i=1 2024-09-10T06:22:58.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344364858928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x55ce425a3b90 2024-09-10T06:22:58.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09a405640 1 -- 172.21.15.117:0/2600593907 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94344364858928] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0900aaa80 con 0x55ce425a3b90 2024-09-10T06:22:58.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 20 remove_watcher() i=2 2024-09-10T06:22:58.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344364857424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x55ce4259f280 2024-09-10T06:22:58.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09ac06640 1 -- 172.21.15.117:0/2600593907 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94344364857424] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb08c06a030 con 0x55ce4259f280 2024-09-10T06:22:58.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 20 remove_watcher() i=3 2024-09-10T06:22:58.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.113+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344364866688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x55ce4259a8c0 2024-09-10T06:22:58.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94344364866688] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x55ce4259a8c0 2024-09-10T06:22:58.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09d1009c0 20 remove_watcher() i=4 2024-09-10T06:22:58.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344364870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x7fb08c06d070 2024-09-10T06:22:58.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94344364870672] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09d1009c0 20 remove_watcher() i=5 2024-09-10T06:22:58.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.117+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344364873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x7fb08c06d070 2024-09-10T06:22:58.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94344364873472] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 20 remove_watcher() i=6 2024-09-10T06:22:58.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344364871728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ce425d7da0 con 0x7fb08c06d070 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94344364871728] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09400a4d0 con 0x7fb08c06d070 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 20 remove_watcher() i=7 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb08c06d070 msgr2=0x7fb08c003560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb08c06d070 0x7fb08c003560 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce4259a8c0 msgr2=0x55ce4259cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce4259a8c0 0x55ce4259cd50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce4259f280 msgr2=0x55ce425a1670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce4259f280 0x55ce425a1670 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce425a3b90 msgr2=0x55ce425a5fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.121+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce425a3b90 0x55ce425a5fc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf640399d0 msgr2=0x7faf6403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf640399d0 0x7faf6403be90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55ce4256e850 tx=0x7fb0900c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 msgr2=0x55ce4258f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2600593907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce42589490 0x55ce4258f760 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0174d0 tx=0x7fb08c023f40 comp rx=0 tx=0).stop 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09b407640 1 -- 172.21.15.117:0/2600593907 reap_dead start 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 shutdown_connections 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 >> 172.21.15.117:0/2600593907 conn(0x55ce42584850 msgr2=0x55ce42582a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 shutdown_connections 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2600593907 wait complete. 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 msgr2=0x7faf7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 0x7faf7403bf80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb09001b380 tx=0x7fb090005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 msgr2=0x55ce4257c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb08c017aa0 tx=0x7fb08c019e60 comp rx=0 tx=0).stop 2024-09-10T06:22:58.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 shutdown_connections 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf74039ac0 0x7faf7403bf80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/2249506750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce4257bf10 0x55ce4257c330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 >> 172.21.15.117:0/2249506750 conn(0x55ce425718c0 msgr2=0x55ce42571ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 shutdown_connections 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/2249506750 wait complete. 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce423ddae0 msgr2=0x55ce42565230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ce423ddae0 0x55ce42565230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce425679d0 msgr2=0x55ce42569dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ce425679d0 0x55ce42569dc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce4256b8d0 msgr2=0x55ce4256dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ce4256b8d0 0x55ce4256dcc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf80039a70 msgr2=0x7faf8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faf80039a70 0x7faf8003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0900ae000 tx=0x7fb0900a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 msgr2=0x55ce4255e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 --2- 172.21.15.117:0/1954556171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce423dd700 0x55ce4255e0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x55ce42557a10 tx=0x7fb08c000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09b407640 1 -- 172.21.15.117:0/1954556171 reap_dead start 2024-09-10T06:22:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 shutdown_connections 2024-09-10T06:22:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 >> 172.21.15.117:0/1954556171 conn(0x55ce42463e20 msgr2=0x55ce42551150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 shutdown_connections 2024-09-10T06:22:58.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.125+0000 7fb09d1009c0 1 -- 172.21.15.117:0/1954556171 wait complete. 2024-09-10T06:22:58.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T06:22:58.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T06:22:58.136 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-10T06:22:58.209 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:58.209 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:58.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1db0f189c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55bce45b4770 0x55bce46431a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1db0f189c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bce44f49c0 con 0x55bce46436e0 2024-09-10T06:22:58.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1db0f189c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55bce45446d0 con 0x55bce45b4770 2024-09-10T06:22:58.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1daea1e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55bce45b4770 0x55bce46431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1daea1e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55bce45b4770 0x55bce46431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52544/0 (socket says 172.21.15.117:52544) 2024-09-10T06:22:58.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1daea1e640 1 -- 172.21.15.117:0/2421150189 learned_addr learned my addr 172.21.15.117:0/2421150189 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1dae21d640 1 --1- 172.21.15.117:0/2421150189 >> v1:172.21.15.84:6789/0 conn(0x55bce46436e0 0x55bce4645ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52554/0 (socket says 172.21.15.117:52554) 2024-09-10T06:22:58.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1daea1e640 1 -- 172.21.15.117:0/2421150189 >> v1:172.21.15.84:6789/0 conn(0x55bce46436e0 legacy=0x55bce4645ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.209+0000 7f1daea1e640 1 -- 172.21.15.117:0/2421150189 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce44e8ca0 con 0x55bce45b4770 2024-09-10T06:22:58.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1daea1e640 1 --2- 172.21.15.117:0/2421150189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce46431a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1da000a4e0 tx=0x7f1da001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8800f9204fc5ba4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1dada1c640 1 -- 172.21.15.117:0/2421150189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00aa540 con 0x55bce45b4770 2024-09-10T06:22:58.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1dada1c640 1 -- 172.21.15.117:0/2421150189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00aa6e0 con 0x55bce45b4770 2024-09-10T06:22:58.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1dada1c640 1 -- 172.21.15.117:0/2421150189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00aaa40 con 0x55bce45b4770 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2421150189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 msgr2=0x55bce46431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2421150189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce46431a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1da000a4e0 tx=0x7f1da001b090 comp rx=0 tx=0).stop 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2421150189 shutdown_connections 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2421150189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce46431a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2421150189 >> 172.21.15.117:0/2421150189 conn(0x55bce463ae90 msgr2=0x55bce463d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2421150189 shutdown_connections 2024-09-10T06:22:58.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.213+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2421150189 wait complete. 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1db0f189c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1db0f189c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bce4548680 con 0x55bce45b4770 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52554/0 (socket says 172.21.15.117:52554) 2024-09-10T06:22:58.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.225+0000 7f1daea1e640 1 -- 172.21.15.117:0/232526662 learned_addr learned my addr 172.21.15.117:0/232526662 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 -- 172.21.15.117:0/232526662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce44c3da0 con 0x55bce45b4770 2024-09-10T06:22:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 --2- 172.21.15.117:0/232526662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1da0019740 tx=0x7f1da00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb875db65a193dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9ce09640 1 -- 172.21.15.117:0/232526662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00b9070 con 0x55bce45b4770 2024-09-10T06:22:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9ce09640 1 -- 172.21.15.117:0/232526662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00aaa90 con 0x55bce45b4770 2024-09-10T06:22:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9ce09640 1 -- 172.21.15.117:0/232526662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00aad70 con 0x55bce45b4770 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/232526662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 msgr2=0x55bce472b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/232526662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1da0019740 tx=0x7f1da00033b0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/232526662 shutdown_connections 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/232526662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce472b940 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/232526662 >> 172.21.15.117:0/232526662 conn(0x55bce463ae90 msgr2=0x55bce47275c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/232526662 shutdown_connections 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/232526662 wait complete. 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce4732e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bce44eaa50 con 0x55bce45b4770 2024-09-10T06:22:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce4732e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce4732e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52560/0 (socket says 172.21.15.117:52560) 2024-09-10T06:22:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 -- 172.21.15.117:0/1026440533 learned_addr learned my addr 172.21.15.117:0/1026440533 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce4733390 con 0x55bce45b4770 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1daea1e640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce4732e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1da0018cc0 tx=0x7f1da0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9b606640 1 -- 172.21.15.117:0/1026440533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00b9070 con 0x55bce45b4770 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce4733620 con 0x55bce45b4770 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce4733fd0 con 0x55bce45b4770 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9b606640 1 -- 172.21.15.117:0/1026440533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00b5ad0 con 0x55bce45b4770 2024-09-10T06:22:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.229+0000 7f1c9b606640 1 -- 172.21.15.117:0/1026440533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00b5db0 con 0x55bce45b4770 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1c9b606640 1 -- 172.21.15.117:0/1026440533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1da00b3040 con 0x55bce45b4770 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1c9b606640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c94039ac0 0x7f1c9403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1c9b606640 1 -- 172.21.15.117:0/1026440533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1da00c4070 con 0x55bce45b4770 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1dae21d640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c94039ac0 0x7f1c9403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce46436e0 0x55bce4739fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce473a4e0 con 0x55bce46436e0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daf21f640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce46436e0 0x55bce4739fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1dae21d640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c94039ac0 0x7f1c9403bf80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1d98001e40 tx=0x7f1d980013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daf21f640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce46436e0 0x55bce4739fa0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daf21f640 1 -- 172.21.15.117:0/1026440533 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce46436e0 2024-09-10T06:22:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce473a900 con 0x55bce46436e0 2024-09-10T06:22:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daf21f640 1 -- 172.21.15.117:0/1026440533 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce46436e0 2024-09-10T06:22:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce473c710 0x55bce473eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce473f1f0 con 0x55bce473c710 2024-09-10T06:22:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daea1e640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce473c710 0x55bce473eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daea1e640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce473c710 0x55bce473eb00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daea1e640 1 -- 172.21.15.117:0/1026440533 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1da00bdd50 con 0x55bce473c710 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce473b5b0 con 0x55bce46436e0 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1daf21f640 1 -- 172.21.15.117:0/1026440533 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce46436e0 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce4740650 0x55bce4742a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4743140 con 0x55bce4740650 2024-09-10T06:22:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1dae21d640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce4740650 0x55bce4742a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.233+0000 7f1dae21d640 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce4740650 0x55bce4742a40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1dae21d640 1 -- 172.21.15.117:0/1026440533 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d9800bd60 con 0x55bce4740650 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bce4555450 con 0x55bce4750c40 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52562/0 (socket says 172.21.15.117:52562) 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1daea1e640 1 -- 172.21.15.117:0/2352468302 learned_addr learned my addr 172.21.15.117:0/2352468302 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1daea1e640 1 -- 172.21.15.117:0/2352468302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce47516a0 con 0x55bce4750c40 2024-09-10T06:22:58.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1daea1e640 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1da00eb010 tx=0x7f1da00d0830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 -- 172.21.15.117:0/2352468302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00e2070 con 0x55bce4750c40 2024-09-10T06:22:58.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce4751f00 con 0x55bce4750c40 2024-09-10T06:22:58.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce4752470 con 0x55bce4750c40 2024-09-10T06:22:58.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 -- 172.21.15.117:0/2352468302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00c7860 con 0x55bce4750c40 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 -- 172.21.15.117:0/2352468302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00b4a60 con 0x55bce4750c40 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 -- 172.21.15.117:0/2352468302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1da00e5070 con 0x55bce4750c40 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 0x7f1c8803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1c98e01640 1 -- 172.21.15.117:0/2352468302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1da00d2020 con 0x55bce4750c40 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.237+0000 7f1dae21d640 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 0x7f1c8803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1dae21d640 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 0x7f1c8803bf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c010 tx=0x7f1d9800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bce472c0d0 con 0x55bce463f160 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52566/0 (socket says 172.21.15.117:52566) 2024-09-10T06:22:58.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 -- 172.21.15.117:0/1568220352 learned_addr learned my addr 172.21.15.117:0/1568220352 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 -- 172.21.15.117:0/1568220352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce463fb50 con 0x55bce463f160 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- 172.21.15.117:0/1568220352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1da00e7f30 tx=0x7f1da00de910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa1fb5d967982d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1c927fc640 1 -- 172.21.15.117:0/1568220352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00c8470 con 0x55bce463f160 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1c927fc640 1 -- 172.21.15.117:0/1568220352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00f9070 con 0x55bce463f160 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1c927fc640 1 -- 172.21.15.117:0/1568220352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00d3d10 con 0x55bce463f160 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1568220352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 msgr2=0x55bce463f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1568220352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1da00e7f30 tx=0x7f1da00de910 comp rx=0 tx=0).stop 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1568220352 shutdown_connections 2024-09-10T06:22:58.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1568220352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce463f560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1568220352 >> 172.21.15.117:0/1568220352 conn(0x55bce4759720 msgr2=0x55bce4757960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1568220352 shutdown_connections 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1568220352 wait complete. 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 Processor -- start 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- start start 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce4766810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1db0f189c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bce4640070 con 0x55bce463f160 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce4766810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce4766810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52582/0 (socket says 172.21.15.117:52582) 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 learned_addr learned my addr 172.21.15.117:0/4274089198 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce4766d70 con 0x55bce463f160 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.241+0000 7f1daea1e640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce4766810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1da00e7f30 tx=0x7f1da00cdf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 -- 172.21.15.117:0/4274089198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da010d070 con 0x55bce463f160 2024-09-10T06:22:58.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bce4766d70 con 0x55bce463f160 2024-09-10T06:22:58.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce4766d70 con 0x55bce463f160 2024-09-10T06:22:58.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 -- 172.21.15.117:0/4274089198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00f9040 con 0x55bce463f160 2024-09-10T06:22:58.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 -- 172.21.15.117:0/4274089198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da00de5f0 con 0x55bce463f160 2024-09-10T06:22:58.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 -- 172.21.15.117:0/4274089198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1da0110070 con 0x55bce463f160 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c78039a20 0x7f1c7803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1c90ff9640 1 -- 172.21.15.117:0/4274089198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1da0104030 con 0x55bce463f160 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1dae21d640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c78039a20 0x7f1c7803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce4771a20 0x55bce4773eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4774600 con 0x55bce4771a20 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce4771a20 0x55bce4773eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1dae21d640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c78039a20 0x7f1c7803bee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55bce473acc0 tx=0x7f1d98010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce4771a20 0x55bce4773eb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce4771a20 2024-09-10T06:22:58.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 realm 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4774a10 con 0x55bce4771a20 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce4771a20 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce47752e0 con 0x55bce4771a20 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce4771a20 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce4771a20 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce47763e0 0x55bce47787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4778d50 con 0x55bce47763e0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daea1e640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce47763e0 0x55bce47787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daea1e640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce47763e0 0x55bce47787d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.245+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1db0f189c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1db0f189c0 20 searching for the correct realm 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce477ac80 0x55bce477d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce477d7e0 con 0x55bce477ac80 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1dae21d640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce477ac80 0x55bce477d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1dae21d640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce477ac80 0x55bce477d110 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce477d7e0 con 0x55bce47763e0 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daea1e640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1da0112060 0x7f1da00b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce477d7e0 con 0x7f1da0112060 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1da0112060 0x7f1da00b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1da0112060 0x7f1da00b8170 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da80083f0 con 0x7f1da0112060 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da80083f0 con 0x55bce4771a20 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.249+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce47763e0 2024-09-10T06:22:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce47763e0 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.253+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce47763e0 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce47763e0 2024-09-10T06:22:58.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce477ac80 2024-09-10T06:22:58.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.257+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x7f1da0112060 2024-09-10T06:22:58.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce4771a20 2024-09-10T06:22:58.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bce4775680 con 0x55bce47763e0 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce47795a0 con 0x55bce4771a20 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4779990 con 0x55bce4771a20 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4779990 con 0x55bce477ac80 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 zone default found 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 4 Realm: () 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 zonegroup default 2024-09-10T06:22:58.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce477dc60 con 0x7f1da0112060 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce477f650 con 0x55bce477ac80 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce477f9f0 con 0x55bce477ac80 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 started sync module instance, tier type = 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:58.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce477eaf0 con 0x55bce47763e0 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.261+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94269775278096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce477eaf0 con 0x55bce47763e0 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4780530 con 0x55bce4771a20 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94269775278096] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94269775282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce477eaf0 con 0x55bce4771a20 2024-09-10T06:22:58.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.265+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4780f40 con 0x55bce477ac80 2024-09-10T06:22:58.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94269775284880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4781790 con 0x55bce477ac80 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47821b0 con 0x55bce47763e0 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94269775282176] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94269775289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47825a0 con 0x55bce47763e0 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4782f60 con 0x55bce4771a20 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94269775284880] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94269775289504] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94269775275584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4782ab0 con 0x55bce4771a20 2024-09-10T06:22:58.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.269+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4783300 con 0x7f1da0112060 2024-09-10T06:22:58.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94269775275584] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94269775293104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47836f0 con 0x7f1da0112060 2024-09-10T06:22:58.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4783f40 con 0x7f1da0112060 2024-09-10T06:22:58.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94269775293104] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94269775294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4783ba0 con 0x7f1da0112060 2024-09-10T06:22:58.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.273+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47845c0 con 0x7f1da0112060 2024-09-10T06:22:58.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94269775294160] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94269775298736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47847a0 con 0x7f1da0112060 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=0 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=1 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=2 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=3 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=4 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=5 2024-09-10T06:22:58.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=6 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94269775298736] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 20 add_watcher() i=7 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce4787b70 con 0x55bce4771a20 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.277+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94269775300240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4784f60 con 0x55bce4771a20 2024-09-10T06:22:58.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94269775300240] v30'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1c657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 5 note: GC not initialized 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1bdffff640 20 reqs_thread_entry: start 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 Filter name: none 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1bddffb640 20 reqs_thread_entry: start 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bce47aaad0 con 0x55bce4771a20 2024-09-10T06:22:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T06:22:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1c657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94269775300240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47a8920 con 0x55bce4771a20 2024-09-10T06:22:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94269775300240] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.281+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94269775278096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47a8920 con 0x55bce47763e0 2024-09-10T06:22:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94269775278096] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1db0f189c0 20 remove_watcher() i=0 2024-09-10T06:22:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1db0f189c0 2 removed watcher, disabling cache 2024-09-10T06:22:58.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94269775282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47a8920 con 0x55bce4771a20 2024-09-10T06:22:58.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94269775282176] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1db0f189c0 20 remove_watcher() i=1 2024-09-10T06:22:58.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.285+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94269775284880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce47a8920 con 0x55bce477ac80 2024-09-10T06:22:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1dae21d640 1 -- 172.21.15.117:0/4274089198 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94269775284880] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d98037040 con 0x55bce477ac80 2024-09-10T06:22:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 20 remove_watcher() i=2 2024-09-10T06:22:58.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94269775289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4780000 con 0x55bce47763e0 2024-09-10T06:22:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1daea1e640 1 -- 172.21.15.117:0/4274089198 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94269775289504] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da010f030 con 0x55bce47763e0 2024-09-10T06:22:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 20 remove_watcher() i=3 2024-09-10T06:22:58.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94269775275584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4780000 con 0x55bce4771a20 2024-09-10T06:22:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94269775275584] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x55bce4771a20 2024-09-10T06:22:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 20 remove_watcher() i=4 2024-09-10T06:22:58.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.289+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94269775293104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce477e640 con 0x7f1da0112060 2024-09-10T06:22:58.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.293+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94269775293104] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.293+0000 7f1db0f189c0 20 remove_watcher() i=5 2024-09-10T06:22:58.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.293+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94269775294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4782ab0 con 0x7f1da0112060 2024-09-10T06:22:58.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94269775294160] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 20 remove_watcher() i=6 2024-09-10T06:22:58.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94269775298736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bce4780000 con 0x7f1da0112060 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94269775298736] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8026040 con 0x7f1da0112060 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 20 remove_watcher() i=7 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1da0112060 msgr2=0x7f1da00b8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1da0112060 0x7f1da00b8170 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce4771a20 msgr2=0x55bce4773eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce4771a20 0x55bce4773eb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce47763e0 msgr2=0x55bce47787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce47763e0 0x55bce47787d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce477ac80 msgr2=0x55bce477d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce477ac80 0x55bce477d110 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c78039a20 msgr2=0x7f1c7803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c78039a20 0x7f1c7803bee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55bce473acc0 tx=0x7f1d98010000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 msgr2=0x55bce4766810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/4274089198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce463f160 0x55bce4766810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1da00e7f30 tx=0x7f1da00cdf70 comp rx=0 tx=0).stop 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 reap_dead start 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1daf21f640 1 -- 172.21.15.117:0/4274089198 reap_dead start 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 shutdown_connections 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 >> 172.21.15.117:0/4274089198 conn(0x55bce4759720 msgr2=0x55bce4757930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 shutdown_connections 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/4274089198 wait complete. 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 msgr2=0x7f1c8803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 0x7f1c8803bf80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c010 tx=0x7f1d9800f000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 msgr2=0x55bce4751060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1da00eb010 tx=0x7f1da00d0830 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 shutdown_connections 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c88039ac0 0x7f1c8803bf80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/2352468302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce4750c40 0x55bce4751060 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 >> 172.21.15.117:0/2352468302 conn(0x55bce47465f0 msgr2=0x55bce47469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 shutdown_connections 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/2352468302 wait complete. 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce46436e0 msgr2=0x55bce4739fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55bce46436e0 0x55bce4739fa0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce473c710 msgr2=0x55bce473eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55bce473c710 0x55bce473eb00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce4740650 msgr2=0x55bce4742a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.297+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55bce4740650 0x55bce4742a40 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c94039ac0 msgr2=0x7f1c9403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1c94039ac0 0x7f1c9403bf80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1d98001e40 tx=0x7f1d980013a0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 msgr2=0x55bce4732e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 --2- 172.21.15.117:0/1026440533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bce45b4770 0x55bce4732e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1da0018cc0 tx=0x7f1da0017e30 comp rx=0 tx=0).stop 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1daf21f640 1 -- 172.21.15.117:0/1026440533 reap_dead start 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 shutdown_connections 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 >> 172.21.15.117:0/1026440533 conn(0x55bce463ae90 msgr2=0x55bce4726050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 shutdown_connections 2024-09-10T06:22:58.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.301+0000 7f1db0f189c0 1 -- 172.21.15.117:0/1026440533 wait complete. 2024-09-10T06:22:58.311 INFO:teuthology.orchestra.run.smithi117.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"0RYXEPbGLqJY6Wo2kP2lq8CI","ver":2},"mtime":"2024-09-10T06:22:58.101656Z","data":{"bucket":{"name":"myfoo","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","bucket_id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-10T06:22:54.613572Z","linked":true,"has_bucket_info":false}} 2024-09-10T06:22:58.311 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '0RYXEPbGLqJY6Wo2kP2lq8CI', 'ver': 2}, 'mtime': '2024-09-10T06:22:58.101656Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'bucket_id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-10T06:22:54.613572Z', 'linked': True, 'has_bucket_info': False}} 2024-09-10T06:22:58.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T06:22:58.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T06:22:58.311 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-10T06:22:58.385 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:58.385 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:58.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29c23249c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56532c79c060 0x56532c79c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29c23249c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56532c6d99c0 con 0x56532c79aa60 2024-09-10T06:22:58.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29c23249c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56532c7296d0 con 0x56532c79c060 2024-09-10T06:22:58.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29bfe2a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56532c79c060 0x56532c79c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29bf629640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x56532c79aa60 0x56532c79ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52558/0 (socket says 172.21.15.117:52558) 2024-09-10T06:22:58.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29bf629640 1 -- 172.21.15.117:0/2419243674 learned_addr learned my addr 172.21.15.117:0/2419243674 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:58.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29bfe2a640 1 -- 172.21.15.117:0/2419243674 >> v1:172.21.15.84:6789/0 conn(0x56532c79aa60 legacy=0x56532c79ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.385+0000 7f29bfe2a640 1 -- 172.21.15.117:0/2419243674 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c6cdca0 con 0x56532c79c060 2024-09-10T06:22:58.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/2419243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79c060 0x56532c79c440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f29b000a480 tx=0x7f29b001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dee2512a3f865c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29bee28640 1 -- 172.21.15.117:0/2419243674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00b0070 con 0x56532c79c060 2024-09-10T06:22:58.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29bee28640 1 -- 172.21.15.117:0/2419243674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b00ab540 con 0x56532c79c060 2024-09-10T06:22:58.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29bee28640 1 -- 172.21.15.117:0/2419243674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00ab840 con 0x56532c79c060 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 -- 172.21.15.117:0/2419243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79c060 msgr2=0x56532c79c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 --2- 172.21.15.117:0/2419243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79c060 0x56532c79c440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f29b000a480 tx=0x7f29b001b280 comp rx=0 tx=0).stop 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 -- 172.21.15.117:0/2419243674 shutdown_connections 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 --2- 172.21.15.117:0/2419243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79c060 0x56532c79c440 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 -- 172.21.15.117:0/2419243674 >> 172.21.15.117:0/2419243674 conn(0x56532c821040 msgr2=0x56532c823460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 -- 172.21.15.117:0/2419243674 shutdown_connections 2024-09-10T06:22:58.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.389+0000 7f29c23249c0 1 -- 172.21.15.117:0/2419243674 wait complete. 2024-09-10T06:22:58.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29c23249c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29c23249c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532c72d680 con 0x56532c79aa60 2024-09-10T06:22:58.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52600/0 (socket says 172.21.15.117:52600) 2024-09-10T06:22:58.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3208877367 learned_addr learned my addr 172.21.15.117:0/3208877367 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3208877367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c6a8da0 con 0x56532c79aa60 2024-09-10T06:22:58.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/3208877367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f29b0018eb0 tx=0x7f29b0002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e40a35a52811e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f28ade0b640 1 -- 172.21.15.117:0/3208877367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00b0040 con 0x56532c79aa60 2024-09-10T06:22:58.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f28ade0b640 1 -- 172.21.15.117:0/3208877367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b00bb070 con 0x56532c79aa60 2024-09-10T06:22:58.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.401+0000 7f28ade0b640 1 -- 172.21.15.117:0/3208877367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00ab6f0 con 0x56532c79aa60 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/3208877367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 msgr2=0x56532c912ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3208877367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f29b0018eb0 tx=0x7f29b0002fc0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/3208877367 shutdown_connections 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3208877367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c912ce0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/3208877367 >> 172.21.15.117:0/3208877367 conn(0x56532c821040 msgr2=0x56532c90e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/3208877367 shutdown_connections 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/3208877367 wait complete. 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c91a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532c6cfa50 con 0x56532c79aa60 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c91a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c91a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52602/0 (socket says 172.21.15.117:52602) 2024-09-10T06:22:58.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29bfe2a640 1 -- 172.21.15.117:0/1608223804 learned_addr learned my addr 172.21.15.117:0/1608223804 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29bfe2a640 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c91a6c0 con 0x56532c79aa60 2024-09-10T06:22:58.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c91a160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b8040 tx=0x56532c79b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f28a7fff640 1 -- 172.21.15.117:0/1608223804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00b0030 con 0x56532c79aa60 2024-09-10T06:22:58.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f28a7fff640 1 -- 172.21.15.117:0/1608223804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b00bb070 con 0x56532c79aa60 2024-09-10T06:22:58.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56532c91a950 con 0x56532c79aa60 2024-09-10T06:22:58.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f28a7fff640 1 -- 172.21.15.117:0/1608223804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00b66d0 con 0x56532c79aa60 2024-09-10T06:22:58.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532c91b300 con 0x56532c79aa60 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.405+0000 7f28a7fff640 1 -- 172.21.15.117:0/1608223804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f29b00b6870 con 0x56532c79aa60 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f28a7fff640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f28a8039ac0 0x7f28a803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f28a7fff640 1 -- 172.21.15.117:0/1608223804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29b00a8070 con 0x56532c79aa60 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bf629640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f28a8039ac0 0x7f28a803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c79c060 0x56532c9212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c921810 con 0x56532c79c060 2024-09-10T06:22:58.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c062b640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c79c060 0x56532c9212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bf629640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f28a8039ac0 0x7f28a803bf80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29b4001d80 tx=0x7f29b40012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c062b640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c79c060 0x56532c9212d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c062b640 1 -- 172.21.15.117:0/1608223804 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c79c060 2024-09-10T06:22:58.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c921bd0 con 0x56532c79c060 2024-09-10T06:22:58.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c062b640 1 -- 172.21.15.117:0/1608223804 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c79c060 2024-09-10T06:22:58.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c9239e0 0x56532c925dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c9264c0 con 0x56532c9239e0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c9239e0 0x56532c925dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c9239e0 0x56532c925dd0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bfe2a640 1 -- 172.21.15.117:0/1608223804 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29b00b3040 con 0x56532c9239e0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c922880 con 0x56532c79c060 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c062b640 1 -- 172.21.15.117:0/1608223804 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c79c060 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c927920 0x56532c929d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c92a410 con 0x56532c927920 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bf629640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c927920 0x56532c929d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bf629640 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c927920 0x56532c929d10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29bf629640 1 -- 172.21.15.117:0/1608223804 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29b400e620 con 0x56532c927920 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.409+0000 7f29c23249c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532c73a450 con 0x56532c937ef0 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52610/0 (socket says 172.21.15.117:52610) 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bfe2a640 1 -- 172.21.15.117:0/1680822711 learned_addr learned my addr 172.21.15.117:0/1680822711 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bfe2a640 1 -- 172.21.15.117:0/1680822711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c938950 con 0x56532c937ef0 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b4530 tx=0x7f29b00aab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 -- 172.21.15.117:0/1680822711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00e22b0 con 0x56532c937ef0 2024-09-10T06:22:58.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 -- 172.21.15.117:0/1680822711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b00e2540 con 0x56532c937ef0 2024-09-10T06:22:58.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56532c9391b0 con 0x56532c937ef0 2024-09-10T06:22:58.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 -- 172.21.15.117:0/1680822711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00e2820 con 0x56532c937ef0 2024-09-10T06:22:58.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532c939720 con 0x56532c937ef0 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 -- 172.21.15.117:0/1680822711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f29b00b47d0 con 0x56532c937ef0 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 0x7f289803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f28a57fa640 1 -- 172.21.15.117:0/1680822711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29b00f1b10 con 0x56532c937ef0 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bf629640 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 0x7f289803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29bf629640 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 0x7f289803bf80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29b400bf50 tx=0x7f29b400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.413+0000 7f29c23249c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532c913450 con 0x56532c944670 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52626/0 (socket says 172.21.15.117:52626) 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 -- 172.21.15.117:0/544534047 learned_addr learned my addr 172.21.15.117:0/544534047 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 -- 172.21.15.117:0/544534047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c945040 con 0x56532c944670 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/544534047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f29b00e24d0 tx=0x7f29b00ac050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e919f01ca761befa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289effd640 1 -- 172.21.15.117:0/544534047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00ee540 con 0x56532c944670 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289effd640 1 -- 172.21.15.117:0/544534047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b0102070 con 0x56532c944670 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289effd640 1 -- 172.21.15.117:0/544534047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00efcd0 con 0x56532c944670 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/544534047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 msgr2=0x56532c944a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 --2- 172.21.15.117:0/544534047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f29b00e24d0 tx=0x7f29b00ac050 comp rx=0 tx=0).stop 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/544534047 shutdown_connections 2024-09-10T06:22:58.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 --2- 172.21.15.117:0/544534047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c944a50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/544534047 >> 172.21.15.117:0/544534047 conn(0x56532c940aa0 msgr2=0x56532c93ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/544534047 shutdown_connections 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/544534047 wait complete. 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 Processor -- start 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- start start 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532c945040 con 0x56532c944670 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52640/0 (socket says 172.21.15.117:52640) 2024-09-10T06:22:58.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 learned_addr learned my addr 172.21.15.117:0/3116269061 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c94bef0 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29b00d1fd0 tx=0x7f29b00d9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289d7fa640 1 -- 172.21.15.117:0/3116269061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b010c070 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56532c94bef0 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289d7fa640 1 -- 172.21.15.117:0/3116269061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b0102040 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532c94c360 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.417+0000 7f289d7fa640 1 -- 172.21.15.117:0/3116269061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b00b4ac0 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f289d7fa640 1 -- 172.21.15.117:0/3116269061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f29b0117060 con 0x56532c944670 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f289d7fa640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2888039a20 0x7f288803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f289d7fa640 1 -- 172.21.15.117:0/3116269061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f29b00a71d0 con 0x56532c944670 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bf629640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2888039a20 0x7f288803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c956a40 0x56532c958ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c959620 con 0x56532c956a40 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c956a40 0x56532c958ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bf629640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2888039a20 0x7f288803bee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56532c926890 tx=0x7f29b4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c956a40 0x56532c958ed0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 realm 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c959a30 con 0x56532c956a40 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a300 con 0x56532c956a40 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c95b400 0x56532c95d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95de00 con 0x56532c95b400 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c95b400 0x56532c95d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c95b400 0x56532c95d7f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 20 searching for the correct realm 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c95fce0 0x56532c962110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c962790 con 0x56532c95fce0 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bf629640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c95fce0 0x56532c962110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.421+0000 7f29bf629640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c95fce0 0x56532c962110 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c962790 con 0x56532c95b400 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29bfe2a640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f29b0110020 0x7f29b00b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c962790 con 0x7f29b0110020 2024-09-10T06:22:58.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f29b0110020 0x7f29b00b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f29b0110020 0x7f29b00b5600 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.425+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95b400 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95b400 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.429+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95b400 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95b400 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95fce0 2024-09-10T06:22:58.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x7f29b0110020 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.433+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c956a40 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56532c95a6a0 con 0x56532c95b400 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95e650 con 0x56532c956a40 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95ea40 con 0x56532c956a40 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c95ea40 con 0x56532c95fce0 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 zone default found 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 4 Realm: () 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:58.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 zonegroup default 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c962c10 con 0x7f29b0110020 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c964700 con 0x56532c95fce0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c964c40 con 0x56532c95fce0 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 started sync module instance, tier type = 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c963aa0 con 0x56532c95b400 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94915230318224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c963700 con 0x56532c95b400 2024-09-10T06:22:58.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.437+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c965b70 con 0x56532c956a40 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94915230318224] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94915230324416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c965f90 con 0x56532c956a40 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c966950 con 0x56532c95fce0 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94915230327968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c9671a0 con 0x56532c95fce0 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.441+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c967b60 con 0x56532c95b400 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94915230324416] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94915230332592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c967ad0 con 0x56532c95b400 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c9688f0 con 0x56532c956a40 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94915230327968] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94915230332592] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94915230330096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c968400 con 0x56532c956a40 2024-09-10T06:22:58.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.445+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c9691c0 con 0x7f29b0110020 2024-09-10T06:22:58.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94915230330096] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94915230334800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c968ea0 con 0x7f29b0110020 2024-09-10T06:22:58.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c9696f0 con 0x7f29b0110020 2024-09-10T06:22:58.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94915230334800] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94915230337792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c969530 con 0x7f29b0110020 2024-09-10T06:22:58.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.449+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c96a050 con 0x7f29b0110020 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94915230337792] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94915230341920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c96a010 con 0x7f29b0110020 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=0 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=1 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=2 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=3 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=4 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=5 2024-09-10T06:22:58.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=6 2024-09-10T06:22:58.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94915230341920] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 20 add_watcher() i=7 2024-09-10T06:22:58.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:58.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c96d470 con 0x56532c956a40 2024-09-10T06:22:58.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.453+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94915230338944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c96a990 con 0x56532c956a40 2024-09-10T06:22:58.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94915230338944] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f2875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 5 note: GC not initialized 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f2874fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 Filter name: none 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f27ee7fc640 20 reqs_thread_entry: start 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c990b00 con 0x56532c956a40 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:58.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c992bf0 con 0x56532c956a40 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.4 8:243f315a:root::.bucket.meta.testx%3amyfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c994450 con 0x56532c95b400 2024-09-10T06:22:58.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-10T06:22:58.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:58.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c998760 con 0x56532c956a40 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.457+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99c310 con 0x56532c956a40 2024-09-10T06:22:58.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [create,call,writefull 0~387,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x7 2024-09-10T06:22:58.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:58.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94915230546960 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b240 con 0x7f29b0110020 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== watch-notify(notify (1) cookie 94915230334800 notify 128849018893 ret 0) ==== 778+0+0 (crc 0 0 0) 0x56532c99c700 con 0x7f29b0110020 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f289effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94915230334800 notifier 4554 bl.length()=736 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f289effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x7 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f289effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f289effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f289effd640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2884003eb0 con 0x7f29b0110020 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 notify.5 [notify cookie 94915230546960 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== watch-notify(notify_complete (2) cookie 94915230546960 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56532c9988c0 con 0x7f29b0110020 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.461+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b120 con 0x56532c95b400 2024-09-10T06:22:58.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(69 foo.buckets [call] v30'28 uv28 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b120 con 0x56532c95b400 2024-09-10T06:22:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'29 uv29 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29c23249c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29c23249c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.465+0000 7f29c23249c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:22:58.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94915230542960 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x7f29b0110020 2024-09-10T06:22:58.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== watch-notify(notify (1) cookie 94915230337792 notify 128849018894 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f29b80264e0 con 0x7f29b0110020 2024-09-10T06:22:58.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(71 notify.6 [notify cookie 94915230542960 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94915230337792 notifier 4554 bl.length()=314 2024-09-10T06:22:58.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T06:22:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f27f4003410 con 0x7f29b0110020 2024-09-10T06:22:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== watch-notify(notify_complete (2) cookie 94915230542960 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f29b8026780 con 0x7f29b0110020 2024-09-10T06:22:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94915230504752 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify (1) cookie 94915230330096 notify 128849018893 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f29b8026780 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94915230330096 notifier 4554 bl.length()=155 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(74 notify.4 [notify cookie 94915230504752 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f289e7fc640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f27f40033d0 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== watch-notify(notify_complete (2) cookie 94915230504752 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f29b8026ae0 con 0x56532c956a40 2024-09-10T06:22:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.469+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:76 8.4 8:243f315a:root::.bucket.meta.testx%3amyfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c95b400 2024-09-10T06:22:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call,delete] v30'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c23249c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 from cache 2024-09-10T06:22:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c23249c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94915230516160 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== watch-notify(notify (1) cookie 94915230330096 notify 128849018894 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f29b8026ae0 con 0x56532c956a40 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f289effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94915230330096 notifier 4554 bl.length()=212 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f289effd640 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2884003eb0 con 0x56532c956a40 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(77 notify.4 [notify cookie 94915230516160 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== watch-notify(notify_complete (2) cookie 94915230516160 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f29b8034410 con 0x56532c956a40 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f2875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94915230338944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94915230338944] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.473+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94915230318224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c95b400 2024-09-10T06:22:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94915230318224] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c23249c0 20 remove_watcher() i=0 2024-09-10T06:22:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c23249c0 2 removed watcher, disabling cache 2024-09-10T06:22:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94915230324416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94915230324416] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c23249c0 20 remove_watcher() i=1 2024-09-10T06:22:58.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94915230327968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c95fce0 2024-09-10T06:22:58.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.477+0000 7f29bf629640 1 -- 172.21.15.117:0/3116269061 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94915230327968] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b400e620 con 0x56532c95fce0 2024-09-10T06:22:58.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 20 remove_watcher() i=2 2024-09-10T06:22:58.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94915230332592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c95b400 2024-09-10T06:22:58.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29bfe2a640 1 -- 172.21.15.117:0/3116269061 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94915230332592] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b00fb030 con 0x56532c95b400 2024-09-10T06:22:58.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 20 remove_watcher() i=3 2024-09-10T06:22:58.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94915230330096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x56532c956a40 2024-09-10T06:22:58.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94915230330096] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x56532c956a40 2024-09-10T06:22:58.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 20 remove_watcher() i=4 2024-09-10T06:22:58.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.481+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94915230334800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x7f29b0110020 2024-09-10T06:22:58.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94915230334800] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c23249c0 20 remove_watcher() i=5 2024-09-10T06:22:58.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94915230337792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x7f29b0110020 2024-09-10T06:22:58.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94915230337792] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c23249c0 20 remove_watcher() i=6 2024-09-10T06:22:58.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.485+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94915230341920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56532c99b800 con 0x7f29b0110020 2024-09-10T06:22:58.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94915230341920] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29b800a4d0 con 0x7f29b0110020 2024-09-10T06:22:58.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 20 remove_watcher() i=7 2024-09-10T06:22:58.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f29b0110020 msgr2=0x7f29b00b5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f29b0110020 0x7f29b00b5600 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c956a40 msgr2=0x56532c958ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c956a40 0x56532c958ed0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c95b400 msgr2=0x56532c95d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c95b400 0x56532c95d7f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c95fce0 msgr2=0x56532c962110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c95fce0 0x56532c962110 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2888039a20 msgr2=0x7f288803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2888039a20 0x7f288803bee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56532c926890 tx=0x7f29b4010000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c062b640 1 -- 172.21.15.117:0/3116269061 reap_dead start 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 msgr2=0x56532c94b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29b00d1fd0 tx=0x7f29b00d9f90 comp rx=0 tx=0).stop 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 shutdown_connections 2024-09-10T06:22:58.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/3116269061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c944670 0x56532c94b990 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 >> 172.21.15.117:0/3116269061 conn(0x56532c940aa0 msgr2=0x56532c93ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 shutdown_connections 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/3116269061 wait complete. 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 msgr2=0x7f289803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 0x7f289803bf80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29b400bf50 tx=0x7f29b400f000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 msgr2=0x56532c938310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b4530 tx=0x7f29b00aab00 comp rx=0 tx=0).stop 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 shutdown_connections 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2898039ac0 0x7f289803bf80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1680822711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c937ef0 0x56532c938310 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 >> 172.21.15.117:0/1680822711 conn(0x56532c92d8a0 msgr2=0x56532c92dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 shutdown_connections 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1680822711 wait complete. 2024-09-10T06:22:58.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c79c060 msgr2=0x56532c9212d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56532c79c060 0x56532c9212d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c9239e0 msgr2=0x56532c925dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56532c9239e0 0x56532c925dd0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c927920 msgr2=0x56532c929d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56532c927920 0x56532c929d10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f28a8039ac0 msgr2=0x7f28a803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f28a8039ac0 0x7f28a803bf80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29b4001d80 tx=0x7f29b40012e0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 msgr2=0x56532c91a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 --2- 172.21.15.117:0/1608223804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532c79aa60 0x56532c91a160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b8040 tx=0x56532c79b9a0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c062b640 1 -- 172.21.15.117:0/1608223804 reap_dead start 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 shutdown_connections 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 >> 172.21.15.117:0/1608223804 conn(0x56532c821040 msgr2=0x56532c90d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 shutdown_connections 2024-09-10T06:22:58.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.489+0000 7f29c23249c0 1 -- 172.21.15.117:0/1608223804 wait complete. 2024-09-10T06:22:58.501 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T06:22:58.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T06:22:58.501 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-10T06:22:58.576 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:58.577 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:58.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69dce9b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5632ef896790 0x5632ef898b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69dce9b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632ef7449c0 con 0x5632ef892c80 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69dce9b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5632ef7946d0 con 0x5632ef896790 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5632ef896790 0x5632ef898b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5632ef896790 0x5632ef898b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52654/0 (socket says 172.21.15.117:52654) 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 -- 172.21.15.117:0/3594324409 learned_addr learned my addr 172.21.15.117:0/3594324409 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 -- 172.21.15.117:0/3594324409 >> v1:172.21.15.84:6789/0 conn(0x5632ef892c80 legacy=0x5632ef895070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 -- 172.21.15.117:0/3594324409 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef738ca0 con 0x5632ef896790 2024-09-10T06:22:58.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69da1a0640 1 --2- 172.21.15.117:0/3594324409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef898b80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f69c400a5c0 tx=0x7f69c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b090558865805542 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69d999f640 1 -- 172.21.15.117:0/3594324409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c40a6070 con 0x5632ef896790 2024-09-10T06:22:58.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69d999f640 1 -- 172.21.15.117:0/3594324409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c40af070 con 0x5632ef896790 2024-09-10T06:22:58.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.577+0000 7f69d999f640 1 -- 172.21.15.117:0/3594324409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c40aa5c0 con 0x5632ef896790 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3594324409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 msgr2=0x5632ef898b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3594324409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef898b80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f69c400a5c0 tx=0x7f69c401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3594324409 shutdown_connections 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3594324409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef898b80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3594324409 >> 172.21.15.117:0/3594324409 conn(0x5632ef806010 msgr2=0x5632ef806420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3594324409 shutdown_connections 2024-09-10T06:22:58.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.581+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3594324409 wait complete. 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69dce9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69dce9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632ef798680 con 0x5632ef892c80 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52662/0 (socket says 172.21.15.117:52662) 2024-09-10T06:22:58.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69da9a1640 1 -- 172.21.15.117:0/3440881817 learned_addr learned my addr 172.21.15.117:0/3440881817 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69da9a1640 1 -- 172.21.15.117:0/3440881817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef713da0 con 0x5632ef892c80 2024-09-10T06:22:58.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f69da9a1640 1 --2- 172.21.15.117:0/3440881817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69d400b220 tx=0x7f69d400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea814451ef577862 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f68c8e09640 1 -- 172.21.15.117:0/3440881817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d400a040 con 0x5632ef892c80 2024-09-10T06:22:58.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f68c8e09640 1 -- 172.21.15.117:0/3440881817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d400f750 con 0x5632ef892c80 2024-09-10T06:22:58.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.593+0000 7f68c8e09640 1 -- 172.21.15.117:0/3440881817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d400fa70 con 0x5632ef892c80 2024-09-10T06:22:58.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3440881817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 msgr2=0x5632ef97d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3440881817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f69d400b220 tx=0x7f69d400b6e0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3440881817 shutdown_connections 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3440881817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef892c80 0x5632ef97d9e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3440881817 >> 172.21.15.117:0/3440881817 conn(0x5632ef806010 msgr2=0x5632ef979680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3440881817 shutdown_connections 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3440881817 wait complete. 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef985430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632ef73aa50 con 0x5632ef896790 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef985430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef985430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52666/0 (socket says 172.21.15.117:52666) 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69da9a1640 1 -- 172.21.15.117:0/3607942405 learned_addr learned my addr 172.21.15.117:0/3607942405 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69da9a1640 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef985990 con 0x5632ef896790 2024-09-10T06:22:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69da9a1640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef985430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f69d4002000 tx=0x7f69d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f68c7606640 1 -- 172.21.15.117:0/3607942405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d401a7c0 con 0x5632ef896790 2024-09-10T06:22:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f68c7606640 1 -- 172.21.15.117:0/3607942405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d401a980 con 0x5632ef896790 2024-09-10T06:22:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f68c7606640 1 -- 172.21.15.117:0/3607942405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d401aca0 con 0x5632ef896790 2024-09-10T06:22:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ef985c20 con 0x5632ef896790 2024-09-10T06:22:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.597+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ef986560 con 0x5632ef896790 2024-09-10T06:22:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f68c7606640 1 -- 172.21.15.117:0/3607942405 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d4017070 con 0x5632ef896790 2024-09-10T06:22:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f68c7606640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68c0039a70 0x7f68c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f68c7606640 1 -- 172.21.15.117:0/3607942405 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d4015020 con 0x5632ef896790 2024-09-10T06:22:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da1a0640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68c0039a70 0x7f68c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef98a4a0 0x5632ef98c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef98cdd0 con 0x5632ef98a4a0 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69db1a2640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef98a4a0 0x5632ef98c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da1a0640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68c0039a70 0x7f68c003bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69c40ae000 tx=0x7f69c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69db1a2640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef98a4a0 0x5632ef98c890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69db1a2640 1 -- 172.21.15.117:0/3607942405 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef98a4a0 2024-09-10T06:22:58.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9868a0 con 0x5632ef98a4a0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69db1a2640 1 -- 172.21.15.117:0/3607942405 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef98a4a0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef98f090 0x5632ef991480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef991b50 con 0x5632ef98f090 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da9a1640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef98f090 0x5632ef991480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da9a1640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef98f090 0x5632ef991480 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da9a1640 1 -- 172.21.15.117:0/3607942405 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69d4041d70 con 0x5632ef98f090 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef98df30 con 0x5632ef98a4a0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69db1a2640 1 -- 172.21.15.117:0/3607942405 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef98a4a0 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef992f90 0x5632ef995380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef995b10 con 0x5632ef992f90 2024-09-10T06:22:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.601+0000 7f69da1a0640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef992f90 0x5632ef995380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da1a0640 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef992f90 0x5632ef995380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da1a0640 1 -- 172.21.15.117:0/3607942405 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef992f90 2024-09-10T06:22:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632ef7a5450 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52680/0 (socket says 172.21.15.117:52680) 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da9a1640 1 -- 172.21.15.117:0/791834722 learned_addr learned my addr 172.21.15.117:0/791834722 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da9a1640 1 -- 172.21.15.117:0/791834722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef9a3f70 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69da9a1640 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f69d4019580 tx=0x7f69d40503e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f68c4e01640 1 -- 172.21.15.117:0/791834722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4017720 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ef9a47d0 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f68c4e01640 1 -- 172.21.15.117:0/791834722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40178c0 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f68c4e01640 1 -- 172.21.15.117:0/791834722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4040060 con 0x5632ef9a3510 2024-09-10T06:22:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ef9a4d40 con 0x5632ef9a3510 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.605+0000 7f68c4e01640 1 -- 172.21.15.117:0/791834722 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d404d440 con 0x5632ef9a3510 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f68c4e01640 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f68c4e01640 1 -- 172.21.15.117:0/791834722 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d4028880 con 0x5632ef9a3510 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da1a0640 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da1a0640 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 0x7f68b403bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69c401b380 tx=0x7f69c4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632ef97e210 con 0x5632ef9afbc0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52682/0 (socket says 172.21.15.117:52682) 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 -- 172.21.15.117:0/3290090729 learned_addr learned my addr 172.21.15.117:0/3290090729 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 -- 172.21.15.117:0/3290090729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef9b0570 con 0x5632ef9afbc0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 --2- 172.21.15.117:0/3290090729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69d4028520 tx=0x7f69d4026390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69aa9c3ad97cb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f68be7fc640 1 -- 172.21.15.117:0/3290090729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d400af10 con 0x5632ef9afbc0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f68be7fc640 1 -- 172.21.15.117:0/3290090729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d401c450 con 0x5632ef9afbc0 2024-09-10T06:22:58.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f68be7fc640 1 -- 172.21.15.117:0/3290090729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4047aa0 con 0x5632ef9afbc0 2024-09-10T06:22:58.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3290090729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 msgr2=0x5632ef9affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3290090729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f69d4028520 tx=0x7f69d4026390 comp rx=0 tx=0).stop 2024-09-10T06:22:58.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3290090729 shutdown_connections 2024-09-10T06:22:58.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3290090729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9affa0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3290090729 >> 172.21.15.117:0/3290090729 conn(0x5632ef9abff0 msgr2=0x5632ef9aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3290090729 shutdown_connections 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3290090729 wait complete. 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 Processor -- start 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- start start 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69dce9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632ef9b0a50 con 0x5632ef9afbc0 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52696/0 (socket says 172.21.15.117:52696) 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 learned_addr learned my addr 172.21.15.117:0/2678452420 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.609+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ef9b7430 con 0x5632ef9afbc0 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69da9a1640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9b6ed0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f69d401cfd0 tx=0x7f69d4028480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 -- 172.21.15.117:0/2678452420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4047bd0 con 0x5632ef9afbc0 2024-09-10T06:22:58.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ef9b7430 con 0x5632ef9afbc0 2024-09-10T06:22:58.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 -- 172.21.15.117:0/2678452420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d4028ba0 con 0x5632ef9afbc0 2024-09-10T06:22:58.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 -- 172.21.15.117:0/2678452420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4026570 con 0x5632ef9afbc0 2024-09-10T06:22:58.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ef9b78a0 con 0x5632ef9afbc0 2024-09-10T06:22:58.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 -- 172.21.15.117:0/2678452420 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69d4064070 con 0x5632ef9afbc0 2024-09-10T06:22:58.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68a4039a70 0x7f68a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f68bcff9640 1 -- 172.21.15.117:0/2678452420 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f69d4062020 con 0x5632ef9afbc0 2024-09-10T06:22:58.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69da1a0640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68a4039a70 0x7f68a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef9c1f50 0x5632ef9c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c4b30 con 0x5632ef9c1f50 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef9c1f50 0x5632ef9c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69da1a0640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68a4039a70 0x7f68a403bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5632ef995f10 tx=0x7f69c40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef9c1f50 0x5632ef9c43e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 realm 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c4f40 con 0x5632ef9c1f50 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5810 con 0x5632ef9c1f50 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef9c6910 0x5632ef9c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c92d0 con 0x5632ef9c6910 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.613+0000 7f69da9a1640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef9c6910 0x5632ef9c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da9a1640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef9c6910 0x5632ef9c8d00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69d407b070 con 0x5632ef9c6910 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69dce9b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69dce9b9c0 20 searching for the correct realm 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef9cb220 0x5632ef9cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cdcd0 con 0x5632ef9cb220 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da1a0640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef9cb220 0x5632ef9cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da1a0640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef9cb220 0x5632ef9cd650 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cdcd0 con 0x5632ef9c6910 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d407b070 con 0x5632ef9c6910 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da9a1640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x5632ef892c80 0x7f69d403b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cdcd0 con 0x5632ef892c80 2024-09-10T06:22:58.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x5632ef892c80 0x7f69d403b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x5632ef892c80 0x7f69d403b8a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.617+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c6910 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d407b070 con 0x5632ef9c6910 2024-09-10T06:22:58.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c6910 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.621+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c6910 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.625+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c6910 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9cb220 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef892c80 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c1f50 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c5bb0 con 0x5632ef9c6910 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:58.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c9b90 con 0x5632ef9c1f50 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c9f80 con 0x5632ef9c1f50 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9c9f80 con 0x5632ef9cb220 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 zone default found 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 4 Realm: () 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 zonegroup default 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9ce150 con 0x5632ef892c80 2024-09-10T06:22:58.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cfc40 con 0x5632ef9cb220 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.629+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d0070 con 0x5632ef9cb220 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 20 started sync module instance, tier type = 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:58.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cefe0 con 0x5632ef9c6910 2024-09-10T06:22:58.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94776768394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9cec40 con 0x5632ef9c6910 2024-09-10T06:22:58.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d0fa0 con 0x5632ef9c1f50 2024-09-10T06:22:58.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94776768394192] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94776768400112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d0f10 con 0x5632ef9c1f50 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.633+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d1d30 con 0x5632ef9cb220 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94776768403520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d2600 con 0x5632ef9cb220 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d3000 con 0x5632ef9c6910 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94776768400112] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94776768402320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d33f0 con 0x5632ef9c6910 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d3db0 con 0x5632ef9c1f50 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.637+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94776768403520] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94776768402320] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94776768408336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d3900 con 0x5632ef9c1f50 2024-09-10T06:22:58.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d4190 con 0x5632ef892c80 2024-09-10T06:22:58.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94776768411904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d3d20 con 0x5632ef892c80 2024-09-10T06:22:58.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5050 con 0x5632ef892c80 2024-09-10T06:22:58.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.641+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94776768408336] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94776768405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5050 con 0x5632ef892c80 2024-09-10T06:22:58.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5a10 con 0x5632ef892c80 2024-09-10T06:22:58.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94776768411904] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94776768405840] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94776768416672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d4fc0 con 0x5632ef892c80 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=0 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=1 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=2 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=3 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=4 2024-09-10T06:22:58.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=5 2024-09-10T06:22:58.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.645+0000 7f69dce9b9c0 20 add_watcher() i=6 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94776768416672] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 20 add_watcher() i=7 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d8a40 con 0x5632ef9c1f50 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94776768419168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5e30 con 0x5632ef9c1f50 2024-09-10T06:22:58.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94776768419168] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f6891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:58.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.649+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e1260 con 0x5632ef9c1f50 2024-09-10T06:22:58.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.653+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.653+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e1830 con 0x5632ef892c80 2024-09-10T06:22:58.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.653+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.653+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e1da0 con 0x5632ef9cb220 2024-09-10T06:22:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e2250 con 0x5632ef9c1f50 2024-09-10T06:22:58.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e07d0 con 0x5632ef9c6910 2024-09-10T06:22:58.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e07d0 con 0x5632ef9cb220 2024-09-10T06:22:58.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.657+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e07d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.661+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.661+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e2db0 con 0x5632ef892c80 2024-09-10T06:22:58.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e2db0 con 0x5632ef9c6910 2024-09-10T06:22:58.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e2e40 con 0x5632ef9cb220 2024-09-10T06:22:58.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.665+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef9c6910 2024-09-10T06:22:58.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef892c80 2024-09-10T06:22:58.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef9c6910 2024-09-10T06:22:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.669+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef892c80 2024-09-10T06:22:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.673+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.673+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef9c1f50 2024-09-10T06:22:58.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.673+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.673+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e33b0 con 0x5632ef9cb220 2024-09-10T06:22:58.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3a00 con 0x5632ef9c6910 2024-09-10T06:22:58.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e36b0 con 0x5632ef9cb220 2024-09-10T06:22:58.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.677+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3690 con 0x5632ef9c1f50 2024-09-10T06:22:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.681+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.681+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3600 con 0x5632ef9c1f50 2024-09-10T06:22:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.681+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.681+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3600 con 0x5632ef9cb220 2024-09-10T06:22:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e36b0 con 0x5632ef9c6910 2024-09-10T06:22:58.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e36b0 con 0x5632ef9cb220 2024-09-10T06:22:58.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.685+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e36f0 con 0x5632ef9cb220 2024-09-10T06:22:58.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.689+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.689+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3710 con 0x5632ef9cb220 2024-09-10T06:22:58.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.689+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.689+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3710 con 0x5632ef9cb220 2024-09-10T06:22:58.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.693+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.693+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3750 con 0x5632ef892c80 2024-09-10T06:22:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.693+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.693+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3790 con 0x5632ef9cb220 2024-09-10T06:22:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.697+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.697+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3790 con 0x5632ef892c80 2024-09-10T06:22:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.697+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.697+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3790 con 0x5632ef9cb220 2024-09-10T06:22:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.701+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.701+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e3790 con 0x5632ef892c80 2024-09-10T06:22:58.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.701+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.701+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9e37d0 con 0x5632ef9c6910 2024-09-10T06:22:58.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f6890fe1640 20 reqs_thread_entry: start 2024-09-10T06:22:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 20 Filter name: none 2024-09-10T06:22:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T06:22:58.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f6889ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:58.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9feea0 con 0x5632ef892c80 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.705+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632efa01370 con 0x5632ef9c1f50 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T06:22:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9ff350 con 0x5632ef892c80 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94776768593584 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632efa018b0 con 0x5632ef9cb220 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== watch-notify(notify (1) cookie 94776768403520 notify 128849018885 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5632ef9e04f0 con 0x5632ef9cb220 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f68be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94776768403520 notifier 4561 bl.length()=170 2024-09-10T06:22:58.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(97 notify.2 [notify cookie 94776768593584 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f68be7fc640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f68a0003d70 con 0x5632ef9cb220 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== watch-notify(notify_complete (2) cookie 94776768593584 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ef9e0150 con 0x5632ef9cb220 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 10 removing email index: 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 10 removing user buckets index 2024-09-10T06:22:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.709+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632efa01830 con 0x5632ef9c1f50 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94776768598784 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632efa01830 con 0x5632ef9c1f50 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== watch-notify(notify (1) cookie 94776768408336 notify 128849018895 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5632ef9e0f30 con 0x5632ef9c1f50 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f68bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94776768408336 notifier 4561 bl.length()=175 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(100 notify.4 [notify cookie 94776768598784 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f68bdffb640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f68040032d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== watch-notify(notify_complete (2) cookie 94776768598784 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ef9dae10 con 0x5632ef9c1f50 2024-09-10T06:22:58.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 10 removing user index: testx$tenanteduser 2024-09-10T06:22:58.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632efa00ec0 con 0x5632ef892c80 2024-09-10T06:22:58.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94776768598784 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5632efa00360 con 0x5632ef9c6910 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== watch-notify(notify (1) cookie 94776768402320 notify 128849018899 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5632ef9e2e90 con 0x5632ef9c6910 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f68bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94776768402320 notifier 4561 bl.length()=167 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(103 notify.3 [notify cookie 94776768598784 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f68bdffb640 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6804003300 con 0x5632ef9c6910 2024-09-10T06:22:58.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== watch-notify(notify_complete (2) cookie 94776768598784 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ef9a3f70 con 0x5632ef9c6910 2024-09-10T06:22:58.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.713+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f6891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94776768419168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632efa01300 con 0x5632ef9c1f50 2024-09-10T06:22:58.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94776768419168] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94776768394192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef9c6910 2024-09-10T06:22:58.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94776768394192] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69dce9b9c0 20 remove_watcher() i=0 2024-09-10T06:22:58.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69dce9b9c0 2 removed watcher, disabling cache 2024-09-10T06:22:58.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.717+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94776768400112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef9c1f50 2024-09-10T06:22:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94776768400112] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 20 remove_watcher() i=1 2024-09-10T06:22:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94776768403520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef9cb220 2024-09-10T06:22:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69da1a0640 1 -- 172.21.15.117:0/2678452420 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94776768403520] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69c40aaa80 con 0x5632ef9cb220 2024-09-10T06:22:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 20 remove_watcher() i=2 2024-09-10T06:22:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94776768402320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef9c6910 2024-09-10T06:22:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69da9a1640 1 -- 172.21.15.117:0/2678452420 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94776768402320] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69d408b060 con 0x5632ef9c6910 2024-09-10T06:22:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 20 remove_watcher() i=3 2024-09-10T06:22:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.721+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94776768408336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef9c1f50 2024-09-10T06:22:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94776768408336] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef9c1f50 2024-09-10T06:22:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69dce9b9c0 20 remove_watcher() i=4 2024-09-10T06:22:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94776768411904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d2b10 con 0x5632ef892c80 2024-09-10T06:22:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94776768411904] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69dce9b9c0 20 remove_watcher() i=5 2024-09-10T06:22:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.725+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94776768405840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d5560 con 0x5632ef892c80 2024-09-10T06:22:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.729+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94776768405840] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.729+0000 7f69dce9b9c0 20 remove_watcher() i=6 2024-09-10T06:22:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.729+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94776768416672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5632ef9d3900 con 0x5632ef892c80 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.729+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94776768416672] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69cc00a4d0 con 0x5632ef892c80 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.729+0000 7f69dce9b9c0 20 remove_watcher() i=7 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x5632ef892c80 msgr2=0x7f69d403b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x5632ef892c80 0x7f69d403b8a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef9c1f50 msgr2=0x5632ef9c43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef9c1f50 0x5632ef9c43e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef9c6910 msgr2=0x5632ef9c8d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef9c6910 0x5632ef9c8d00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef9cb220 msgr2=0x5632ef9cd650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef9cb220 0x5632ef9cd650 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68a4039a70 msgr2=0x7f68a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68a4039a70 0x7f68a403bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5632ef995f10 tx=0x7f69c40c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 msgr2=0x5632ef9b6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/2678452420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9afbc0 0x5632ef9b6ed0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f69d401cfd0 tx=0x7f69d4028480 comp rx=0 tx=0).stop 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 reap_dead start 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69db1a2640 1 -- 172.21.15.117:0/2678452420 reap_dead start 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 shutdown_connections 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 >> 172.21.15.117:0/2678452420 conn(0x5632ef9abff0 msgr2=0x5632ef9aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 shutdown_connections 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/2678452420 wait complete. 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 msgr2=0x7f68b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 0x7f68b403bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69c401b380 tx=0x7f69c4005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 msgr2=0x5632ef9a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f69d4019580 tx=0x7f69d40503e0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 shutdown_connections 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68b4039a70 0x7f68b403bf30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/791834722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef9a3510 0x5632ef9a3930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 >> 172.21.15.117:0/791834722 conn(0x5632ef998ec0 msgr2=0x5632ef9992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 shutdown_connections 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/791834722 wait complete. 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef98a4a0 msgr2=0x5632ef98c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5632ef98a4a0 0x5632ef98c890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef98f090 msgr2=0x5632ef991480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5632ef98f090 0x5632ef991480 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef992f90 msgr2=0x5632ef995380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5632ef992f90 0x5632ef995380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68c0039a70 msgr2=0x7f68c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f68c0039a70 0x7f68c003bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f69c40ae000 tx=0x7f69c40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 msgr2=0x5632ef985430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 --2- 172.21.15.117:0/3607942405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632ef896790 0x5632ef985430 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f69d4002000 tx=0x7f69d4000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69db1a2640 1 -- 172.21.15.117:0/3607942405 reap_dead start 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 shutdown_connections 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 >> 172.21.15.117:0/3607942405 conn(0x5632ef806010 msgr2=0x5632ef978110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 shutdown_connections 2024-09-10T06:22:58.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.733+0000 7f69dce9b9c0 1 -- 172.21.15.117:0/3607942405 wait complete. 2024-09-10T06:22:58.752 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T06:22:58.755 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-10T06:22:58.801 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:22:58.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T06:22:58.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T06:22:58.802 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-10T06:22:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:58.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9c6849c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55927f0588c0 0x55927f05acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9c6849c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55927ef089c0 con 0x55927efc8770 2024-09-10T06:22:58.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9c6849c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55927ef586d0 con 0x55927f0588c0 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f99989640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55927f0588c0 0x55927f05acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9a18a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55927efc8770 0x55927f0571a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52576/0 (socket says 172.21.15.117:52576) 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f99989640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55927f0588c0 0x55927f05acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52700/0 (socket says 172.21.15.117:52700) 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f9a18a640 1 -- 172.21.15.117:0/1201597067 learned_addr learned my addr 172.21.15.117:0/1201597067 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f99989640 1 -- 172.21.15.117:0/1201597067 >> v1:172.21.15.84:6789/0 conn(0x55927efc8770 legacy=0x55927f0571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.833+0000 7f1f99989640 1 -- 172.21.15.117:0/1201597067 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927eefcca0 con 0x55927f0588c0 2024-09-10T06:22:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f99989640 1 --2- 172.21.15.117:0/1201597067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f05acb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a480 tx=0x7f1f9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a244e6b62c82c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f99188640 1 -- 172.21.15.117:0/1201597067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f900af070 con 0x55927f0588c0 2024-09-10T06:22:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f99188640 1 -- 172.21.15.117:0/1201597067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f900aa530 con 0x55927f0588c0 2024-09-10T06:22:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f99188640 1 -- 172.21.15.117:0/1201597067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f900aa830 con 0x55927f0588c0 2024-09-10T06:22:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1201597067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 msgr2=0x55927f05acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/1201597067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f05acb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a480 tx=0x7f1f9001b280 comp rx=0 tx=0).stop 2024-09-10T06:22:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1201597067 shutdown_connections 2024-09-10T06:22:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/1201597067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f05acb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1201597067 >> 172.21.15.117:0/1201597067 conn(0x55927f04ee90 msgr2=0x55927f0512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1201597067 shutdown_connections 2024-09-10T06:22:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.837+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1201597067 wait complete. 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55927ef5c680 con 0x55927efc8770 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52704/0 (socket says 172.21.15.117:52704) 2024-09-10T06:22:58.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 -- 172.21.15.117:0/2584575194 learned_addr learned my addr 172.21.15.117:0/2584575194 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 -- 172.21.15.117:0/2584575194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927eed7da0 con 0x55927efc8770 2024-09-10T06:22:58.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/2584575194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1f940017b0 tx=0x7f1f94001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67926bf7dd948e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1e88608640 1 -- 172.21.15.117:0/2584575194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f940044f0 con 0x55927efc8770 2024-09-10T06:22:58.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1e88608640 1 -- 172.21.15.117:0/2584575194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f940046b0 con 0x55927efc8770 2024-09-10T06:22:58.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1e88608640 1 -- 172.21.15.117:0/2584575194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94004a10 con 0x55927efc8770 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/2584575194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 msgr2=0x55927f0546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/2584575194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1f940017b0 tx=0x7f1f94001c70 comp rx=0 tx=0).stop 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/2584575194 shutdown_connections 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/2584575194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927efc8770 0x55927f0546a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/2584575194 >> 172.21.15.117:0/2584575194 conn(0x55927f04ee90 msgr2=0x55927f13b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/2584575194 shutdown_connections 2024-09-10T06:22:58.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/2584575194 wait complete. 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9c6849c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55927eefea50 con 0x55927f0588c0 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52706/0 (socket says 172.21.15.117:52706) 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.853+0000 7f1f9a18a640 1 -- 172.21.15.117:0/4006304010 learned_addr learned my addr 172.21.15.117:0/4006304010 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a18a640 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927f149a90 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f149530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006a50 tx=0x7f1f94000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 -- 172.21.15.117:0/4006304010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94013760 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927f149d20 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 -- 172.21.15.117:0/4006304010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94013900 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927f14a540 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 -- 172.21.15.117:0/4006304010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94013be0 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 -- 172.21.15.117:0/4006304010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f94010070 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e80039a70 0x7f1e8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1e86e05640 1 -- 172.21.15.117:0/4006304010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1f94018070 con 0x55927f0588c0 2024-09-10T06:22:58.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f99989640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e80039a70 0x7f1e8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f14e500 0x55927f1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f150e30 con 0x55927f14e500 2024-09-10T06:22:58.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f14e500 0x55927f1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f99989640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e80039a70 0x7f1e8003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f900ac000 tx=0x7f1f900a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f14e500 0x55927f1508f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a98b640 1 -- 172.21.15.117:0/4006304010 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f14e500 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1511f0 con 0x55927f14e500 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a98b640 1 -- 172.21.15.117:0/4006304010 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f14e500 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f153000 0x55927f1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f155ac0 con 0x55927f153000 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f153000 0x55927f1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.857+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f153000 0x55927f1553f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 -- 172.21.15.117:0/4006304010 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f9401b030 con 0x55927f153000 2024-09-10T06:22:58.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f151ea0 con 0x55927f14e500 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a98b640 1 -- 172.21.15.117:0/4006304010 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f14e500 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f156f00 0x55927f1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f159a80 con 0x55927f156f00 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f99989640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f156f00 0x55927f1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f99989640 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f156f00 0x55927f1592f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f99989640 1 -- 172.21.15.117:0/4006304010 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f900a8070 con 0x55927f156f00 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55927ef69450 con 0x55927f167540 2024-09-10T06:22:58.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52716/0 (socket says 172.21.15.117:52716) 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 -- 172.21.15.117:0/424382428 learned_addr learned my addr 172.21.15.117:0/424382428 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 -- 172.21.15.117:0/424382428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927f167fa0 con 0x55927f167540 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010a90 tx=0x7f1f94047520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1e7ffff640 1 -- 172.21.15.117:0/424382428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f940123c0 con 0x55927f167540 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1e7ffff640 1 -- 172.21.15.117:0/424382428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94012560 con 0x55927f167540 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927f168800 con 0x55927f167540 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1e7ffff640 1 -- 172.21.15.117:0/424382428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94028bb0 con 0x55927f167540 2024-09-10T06:22:58.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.861+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927f168d70 con 0x55927f167540 2024-09-10T06:22:58.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7ffff640 1 -- 172.21.15.117:0/424382428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f94039060 con 0x55927f167540 2024-09-10T06:22:58.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7ffff640 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 0x7f1e7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7ffff640 1 -- 172.21.15.117:0/424382428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1f9403e7a0 con 0x55927f167540 2024-09-10T06:22:58.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f99989640 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 0x7f1e7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f99989640 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 0x7f1e7403bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f90017e90 tx=0x7f1f90005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55927f054ef0 con 0x55927f174c20 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52728/0 (socket says 172.21.15.117:52728) 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9a18a640 1 -- 172.21.15.117:0/1523035268 learned_addr learned my addr 172.21.15.117:0/1523035268 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9a18a640 1 -- 172.21.15.117:0/1523035268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927f1755f0 con 0x55927f174c20 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/1523035268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010670 tx=0x7f1f9403b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaed9894fdcabae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7dffb640 1 -- 172.21.15.117:0/1523035268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94041910 con 0x55927f174c20 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7dffb640 1 -- 172.21.15.117:0/1523035268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94055070 con 0x55927f174c20 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1e7dffb640 1 -- 172.21.15.117:0/1523035268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f940286b0 con 0x55927f174c20 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1523035268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 msgr2=0x55927f175000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/1523035268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010670 tx=0x7f1f9403b450 comp rx=0 tx=0).stop 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1523035268 shutdown_connections 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/1523035268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f175000 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1523035268 >> 172.21.15.117:0/1523035268 conn(0x55927f170040 msgr2=0x55927f16e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1523035268 shutdown_connections 2024-09-10T06:22:58.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/1523035268 wait complete. 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 Processor -- start 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- start start 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.869+0000 7f1f9c6849c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55927f1739f0 con 0x55927f174c20 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a18a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52730/0 (socket says 172.21.15.117:52730) 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 learned_addr learned my addr 172.21.15.117:0/3768665130 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:58.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927f17b4d0 con 0x55927f174c20 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010670 tx=0x7f1f9402cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 -- 172.21.15.117:0/3768665130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f9403b810 con 0x55927f174c20 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927f17b4d0 con 0x55927f174c20 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 -- 172.21.15.117:0/3768665130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94055040 con 0x55927f174c20 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 -- 172.21.15.117:0/3768665130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f94004020 con 0x55927f174c20 2024-09-10T06:22:58.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927f17b4d0 con 0x55927f174c20 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 -- 172.21.15.117:0/3768665130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f940041c0 con 0x55927f174c20 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e64039a70 0x7f1e6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1e6bfff640 1 -- 172.21.15.117:0/3768665130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f1f94061070 con 0x55927f174c20 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f99989640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e64039a70 0x7f1e6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f186110 0x55927f1885a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f188cf0 con 0x55927f186110 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f186110 0x55927f1885a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f99989640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e64039a70 0x7f1e6403bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f900aafd0 tx=0x7f1f900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f186110 0x55927f1885a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.873+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f186110 2024-09-10T06:22:58.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 realm 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f189100 con 0x55927f186110 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f186110 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1899d0 con 0x55927f186110 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f186110 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f186110 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f18aad0 0x55927f18cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f18d4d0 con 0x55927f18aad0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f18aad0 0x55927f18cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f18aad0 0x55927f18cec0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 20 searching for the correct realm 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f18f3b0 0x55927f1917e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f191e60 con 0x55927f18f3b0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f99989640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f18f3b0 0x55927f1917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f99989640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f18f3b0 0x55927f1917e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f191e60 con 0x55927f18aad0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f94051040 0x7f1f94021a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f191e60 con 0x7f1f94051040 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f94051040 0x7f1f94021a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.877+0000 7f1f9a98b640 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f94051040 0x7f1f94021a40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c0083f0 con 0x7f1f94051040 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c0083f0 con 0x55927f186110 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18aad0 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18aad0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.881+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18aad0 2024-09-10T06:22:58.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.885+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18aad0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18f3b0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x7f1f94051040 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f186110 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55927f189d70 con 0x55927f18aad0 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f18dd20 con 0x55927f186110 2024-09-10T06:22:58.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f18e110 con 0x55927f186110 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f18e110 con 0x55927f18f3b0 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 zone default found 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 4 Realm: () 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:58.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 zonegroup default 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1922e0 con 0x7f1f94051040 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f193e00 con 0x55927f18f3b0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.889+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f194260 con 0x55927f18f3b0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 20 started sync module instance, tier type = 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f193170 con 0x55927f18aad0 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94087685944944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f193170 con 0x55927f18aad0 2024-09-10T06:22:58.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f194df0 con 0x55927f186110 2024-09-10T06:22:58.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94087685944944] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94087685949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f193170 con 0x55927f186110 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.893+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f195800 con 0x55927f18f3b0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94087685952336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f196050 con 0x55927f18f3b0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f196a90 con 0x55927f18aad0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94087685949632] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94087685956960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f196e80 con 0x55927f18aad0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f197840 con 0x55927f186110 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.897+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94087685952336] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94087685956960] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94087685942464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f197390 con 0x55927f186110 2024-09-10T06:22:58.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f197c20 con 0x7f1f94051040 2024-09-10T06:22:58.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94087685942464] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94087685954464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f197840 con 0x7f1f94051040 2024-09-10T06:22:58.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.901+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f198520 con 0x7f1f94051040 2024-09-10T06:22:58.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94087685954464] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94087685963792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f198700 con 0x7f1f94051040 2024-09-10T06:22:58.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f198f50 con 0x7f1f94051040 2024-09-10T06:22:58.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94087685963792] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94087685965568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f198fd0 con 0x7f1f94051040 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=0 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=1 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=2 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=3 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=4 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=5 2024-09-10T06:22:58.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.905+0000 7f1f9c6849c0 20 add_watcher() i=6 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94087685965568] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 20 add_watcher() i=7 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f19c2f0 con 0x55927f186110 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94087685966992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f199560 con 0x55927f186110 2024-09-10T06:22:58.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94087685966992] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:58.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:58.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.909+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a4cb0 con 0x55927f186110 2024-09-10T06:22:58.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a52e0 con 0x7f1f94051040 2024-09-10T06:22:58.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a5760 con 0x55927f18f3b0 2024-09-10T06:22:58.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.913+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a6180 con 0x55927f186110 2024-09-10T06:22:58.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x55927f18aad0 2024-09-10T06:22:58.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x55927f18f3b0 2024-09-10T06:22:58.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.917+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x55927f186110 2024-09-10T06:22:58.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.921+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.921+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x7f1f94051040 2024-09-10T06:22:58.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.921+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.921+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x55927f18aad0 2024-09-10T06:22:58.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a2a00 con 0x55927f18f3b0 2024-09-10T06:22:58.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a71a0 con 0x55927f18aad0 2024-09-10T06:22:58.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.925+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7180 con 0x7f1f94051040 2024-09-10T06:22:58.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.929+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.929+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7150 con 0x55927f18aad0 2024-09-10T06:22:58.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.929+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.929+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x7f1f94051040 2024-09-10T06:22:58.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f186110 2024-09-10T06:22:58.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.933+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18aad0 2024-09-10T06:22:58.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.937+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.937+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.937+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.937+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f186110 2024-09-10T06:22:58.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.941+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.941+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f186110 2024-09-10T06:22:58.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.941+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.941+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18aad0 2024-09-10T06:22:58.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.945+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18f3b0 2024-09-10T06:22:58.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.949+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x7f1f94051040 2024-09-10T06:22:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.953+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.953+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a74c0 con 0x55927f18f3b0 2024-09-10T06:22:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.953+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.953+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a74c0 con 0x7f1f94051040 2024-09-10T06:22:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.957+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.957+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a74c0 con 0x55927f18f3b0 2024-09-10T06:22:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.957+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.957+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a74c0 con 0x7f1f94051040 2024-09-10T06:22:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.961+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.961+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a7430 con 0x55927f18aad0 2024-09-10T06:22:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1dcb7fe640 20 reqs_thread_entry: start 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 Filter name: none 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1dc97fa640 20 reqs_thread_entry: start 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1a1f10 con 0x55927f18aad0 2024-09-10T06:22:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1c4040 con 0x55927f186110 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(95 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 get_obj_state: octx=0x7f1f94009e50 obj=myfoo:four state=0x55927f1c5218 s->prefetch_data=0 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:96 3.3d 3:be7d7f83:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55927f1c6230 con 0x55927f18f3b0 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(96 be621638-e902-4133-b94d-0397be1b6a7c.4227.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 10 manifest: total_size = 4 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.8394216313649599423 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 get_obj_state: octx=0x7f1f94009e50 obj=myfoo:four state=0x55927f1c5218 s->prefetch_data=0 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 prepare_atomic_modification: state is not atomic. state=0x55927f1c5218 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.965+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1cac00 con 0x7f1f94051040 2024-09-10T06:22:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(97 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 3.3d 3:be7d7f83:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1cac00 con 0x55927f18f3b0 2024-09-10T06:22:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(98 be621638-e902-4133-b94d-0397be1b6a7c.4227.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1cb690 con 0x7f1f94051040 2024-09-10T06:22:58.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:58.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94087685966992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1cb690 con 0x55927f186110 2024-09-10T06:22:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.969+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94087685966992] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94087685944944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1cb690 con 0x55927f18aad0 2024-09-10T06:22:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(99 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [stat,call,call] v30'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1e7dffb640 20 handle_completion(): completion ok for obj=four 2024-09-10T06:22:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94087685944944] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 20 remove_watcher() i=0 2024-09-10T06:22:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 2 removed watcher, disabling cache 2024-09-10T06:22:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94087685949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f198c90 con 0x55927f186110 2024-09-10T06:22:58.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94087685949632] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 20 remove_watcher() i=1 2024-09-10T06:22:58.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.973+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94087685952336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1948c0 con 0x55927f18f3b0 2024-09-10T06:22:58.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f99989640 1 -- 172.21.15.117:0/3768665130 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94087685952336] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f900d9070 con 0x55927f18f3b0 2024-09-10T06:22:58.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f9c6849c0 20 remove_watcher() i=2 2024-09-10T06:22:58.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94087685956960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1948c0 con 0x55927f18aad0 2024-09-10T06:22:58.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f9a18a640 1 -- 172.21.15.117:0/3768665130 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94087685956960] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9406b020 con 0x55927f18aad0 2024-09-10T06:22:58.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f9c6849c0 20 remove_watcher() i=3 2024-09-10T06:22:58.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.977+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94087685942464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1948c0 con 0x55927f186110 2024-09-10T06:22:58.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94087685942464] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x55927f186110 2024-09-10T06:22:58.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9c6849c0 20 remove_watcher() i=4 2024-09-10T06:22:58.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94087685954464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1948c0 con 0x7f1f94051040 2024-09-10T06:22:58.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94087685954464] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9c6849c0 20 remove_watcher() i=5 2024-09-10T06:22:58.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.981+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94087685963792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f195ba0 con 0x7f1f94051040 2024-09-10T06:22:58.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94087685963792] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 20 remove_watcher() i=6 2024-09-10T06:22:58.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94087685965568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55927f1948c0 con 0x7f1f94051040 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94087685965568] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f94051040 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 20 remove_watcher() i=7 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f94051040 msgr2=0x7f1f94021a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f94051040 0x7f1f94021a40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f186110 msgr2=0x55927f1885a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f186110 0x55927f1885a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f18aad0 msgr2=0x55927f18cec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f18aad0 0x55927f18cec0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f18f3b0 msgr2=0x55927f1917e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f18f3b0 0x55927f1917e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e64039a70 msgr2=0x7f1e6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e64039a70 0x7f1e6403bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f900aafd0 tx=0x7f1f900a7000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9a98b640 1 -- 172.21.15.117:0/3768665130 reap_dead start 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 msgr2=0x55927f17af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010670 tx=0x7f1f9402cf30 comp rx=0 tx=0).stop 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 shutdown_connections 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/3768665130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f174c20 0x55927f17af70 secure :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010670 tx=0x7f1f9402cf30 comp rx=0 tx=0).stop 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 >> 172.21.15.117:0/3768665130 conn(0x55927f170040 msgr2=0x55927f16e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 shutdown_connections 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.985+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/3768665130 wait complete. 2024-09-10T06:22:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 msgr2=0x7f1e7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 0x7f1e7403bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f90017e90 tx=0x7f1f90005a10 comp rx=0 tx=0).stop 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 msgr2=0x55927f167960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1f94010a90 tx=0x7f1f94047520 comp rx=0 tx=0).stop 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 shutdown_connections 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e74039a70 0x7f1e7403bf30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/424382428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f167540 0x55927f167960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 >> 172.21.15.117:0/424382428 conn(0x55927f15cef0 msgr2=0x55927f15d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 shutdown_connections 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/424382428 wait complete. 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f14e500 msgr2=0x55927f1508f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55927f14e500 0x55927f1508f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f153000 msgr2=0x55927f1553f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55927f153000 0x55927f1553f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f156f00 msgr2=0x55927f1592f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55927f156f00 0x55927f1592f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e80039a70 msgr2=0x7f1e8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e80039a70 0x7f1e8003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f900ac000 tx=0x7f1f900a5000 comp rx=0 tx=0).stop 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 msgr2=0x55927f149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 --2- 172.21.15.117:0/4006304010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55927f0588c0 0x55927f149530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006a50 tx=0x7f1f94000f50 comp rx=0 tx=0).stop 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9a98b640 1 -- 172.21.15.117:0/4006304010 reap_dead start 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 shutdown_connections 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 >> 172.21.15.117:0/4006304010 conn(0x55927f04ee90 msgr2=0x55927f053440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 shutdown_connections 2024-09-10T06:22:58.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:58.989+0000 7f1f9c6849c0 1 -- 172.21.15.117:0/4006304010 wait complete. 2024-09-10T06:22:59.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:59.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T06:22:59.002 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T06:22:59.080 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:59.080 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.077+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.077+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.077+0000 7f5f284a59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562a059c8880 0x562a059cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.077+0000 7f5f284a59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a058789c0 con 0x562a059387b0 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.077+0000 7f5f284a59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x562a058c86d0 con 0x562a059c8880 2024-09-10T06:22:59.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562a059c8880 0x562a059cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562a059c8880 0x562a059cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52740/0 (socket says 172.21.15.117:52740) 2024-09-10T06:22:59.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f25fab640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x562a059387b0 0x562a059c7160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52582/0 (socket says 172.21.15.117:52582) 2024-09-10T06:22:59.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 -- 172.21.15.117:0/676467041 learned_addr learned my addr 172.21.15.117:0/676467041 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 -- 172.21.15.117:0/676467041 >> v1:172.21.15.84:6789/0 conn(0x562a059387b0 legacy=0x562a059c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 -- 172.21.15.117:0/676467041 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a0586cca0 con 0x562a059c8880 2024-09-10T06:22:59.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f257aa640 1 --2- 172.21.15.117:0/676467041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059c8880 0x562a059cac70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00a5c0 tx=0x7f5f1c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed4f90e4503c127 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f24fa9640 1 -- 172.21.15.117:0/676467041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c0b1070 con 0x562a059c8880 2024-09-10T06:22:59.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f24fa9640 1 -- 172.21.15.117:0/676467041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0a8070 con 0x562a059c8880 2024-09-10T06:22:59.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f24fa9640 1 -- 172.21.15.117:0/676467041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1c0ac5b0 con 0x562a059c8880 2024-09-10T06:22:59.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 -- 172.21.15.117:0/676467041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059c8880 msgr2=0x562a059cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/676467041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059c8880 0x562a059cac70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00a5c0 tx=0x7f5f1c01b340 comp rx=0 tx=0).stop 2024-09-10T06:22:59.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 -- 172.21.15.117:0/676467041 shutdown_connections 2024-09-10T06:22:59.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/676467041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059c8880 0x562a059cac70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 -- 172.21.15.117:0/676467041 >> 172.21.15.117:0/676467041 conn(0x562a059bee90 msgr2=0x562a059c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 -- 172.21.15.117:0/676467041 shutdown_connections 2024-09-10T06:22:59.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.081+0000 7f5f284a59c0 1 -- 172.21.15.117:0/676467041 wait complete. 2024-09-10T06:22:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a058cc680 con 0x562a059387b0 2024-09-10T06:22:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52742/0 (socket says 172.21.15.117:52742) 2024-09-10T06:22:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f25fab640 1 -- 172.21.15.117:0/2437492565 learned_addr learned my addr 172.21.15.117:0/2437492565 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f25fab640 1 -- 172.21.15.117:0/2437492565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a05847da0 con 0x562a059387b0 2024-09-10T06:22:59.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f25fab640 1 --2- 172.21.15.117:0/2437492565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f18001ec0 tx=0x7f5f1800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceaab29b16dc085 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5e13e07640 1 -- 172.21.15.117:0/2437492565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1800e5d0 con 0x562a059387b0 2024-09-10T06:22:59.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5e13e07640 1 -- 172.21.15.117:0/2437492565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1800e770 con 0x562a059387b0 2024-09-10T06:22:59.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5e13e07640 1 -- 172.21.15.117:0/2437492565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1800ea70 con 0x562a059387b0 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 -- 172.21.15.117:0/2437492565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 msgr2=0x562a05aaf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/2437492565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f18001ec0 tx=0x7f5f1800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 -- 172.21.15.117:0/2437492565 shutdown_connections 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/2437492565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05aaf8d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.097+0000 7f5f284a59c0 1 -- 172.21.15.117:0/2437492565 >> 172.21.15.117:0/2437492565 conn(0x562a059bee90 msgr2=0x562a05aab570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- 172.21.15.117:0/2437492565 shutdown_connections 2024-09-10T06:22:59.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- 172.21.15.117:0/2437492565 wait complete. 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05ab6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a0586ea50 con 0x562a059387b0 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05ab6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05ab6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52746/0 (socket says 172.21.15.117:52746) 2024-09-10T06:22:59.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f25fab640 1 -- 172.21.15.117:0/1268611244 learned_addr learned my addr 172.21.15.117:0/1268611244 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f25fab640 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a05ab74d0 con 0x562a059387b0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f25fab640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05ab6f70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x562a05ab08c0 tx=0x7f5f18000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 -- 172.21.15.117:0/1268611244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1800f8e0 con 0x562a059387b0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a05ab7760 con 0x562a059387b0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 -- 172.21.15.117:0/1268611244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1800fa80 con 0x562a059387b0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 -- 172.21.15.117:0/1268611244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1800fda0 con 0x562a059387b0 2024-09-10T06:22:59.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a05ab8110 con 0x562a059387b0 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 -- 172.21.15.117:0/1268611244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f18017070 con 0x562a059387b0 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e0c039a70 0x7f5e0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5e12604640 1 -- 172.21.15.117:0/1268611244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f18015020 con 0x562a059387b0 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f257aa640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e0c039a70 0x7f5e0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a059c8880 0x562a05abe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05abe620 con 0x562a059c8880 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.101+0000 7f5f267ac640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a059c8880 0x562a05abe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f257aa640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e0c039a70 0x7f5e0c03bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0ae000 tx=0x7f5f1c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f267ac640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a059c8880 0x562a05abe0e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f267ac640 1 -- 172.21.15.117:0/1268611244 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a059c8880 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05abea70 con 0x562a059c8880 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f267ac640 1 -- 172.21.15.117:0/1268611244 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a059c8880 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05ac0880 0x562a05ac2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05ac3340 con 0x562a05ac0880 2024-09-10T06:22:59.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05ac0880 0x562a05ac2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05ac0880 0x562a05ac2c70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 -- 172.21.15.117:0/1268611244 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05ac0880 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05abf720 con 0x562a059c8880 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f267ac640 1 -- 172.21.15.117:0/1268611244 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a059c8880 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05ac4780 0x562a05ac6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05ac7300 con 0x562a05ac4780 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f257aa640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05ac4780 0x562a05ac6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f257aa640 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05ac4780 0x562a05ac6b70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f257aa640 1 -- 172.21.15.117:0/1268611244 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f1c0b4040 con 0x562a05ac4780 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f284a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a058d9450 con 0x562a05ad4dc0 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52750/0 (socket says 172.21.15.117:52750) 2024-09-10T06:22:59.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.105+0000 7f5f25fab640 1 -- 172.21.15.117:0/3068286167 learned_addr learned my addr 172.21.15.117:0/3068286167 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 -- 172.21.15.117:0/3068286167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a05ad5820 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f18017aa0 tx=0x7f5f18017490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 -- 172.21.15.117:0/3068286167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1801b500 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 -- 172.21.15.117:0/3068286167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f18035070 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a05ad6080 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 -- 172.21.15.117:0/3068286167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f18019530 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a05ad6080 con 0x562a05ad4dc0 2024-09-10T06:22:59.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 -- 172.21.15.117:0/3068286167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f180196d0 con 0x562a05ad4dc0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 0x7f5e0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e0b7fe640 1 -- 172.21.15.117:0/3068286167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f1802c060 con 0x562a05ad4dc0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f257aa640 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 0x7f5e0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f284a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a05ab0120 con 0x562a05ae12d0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f257aa640 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 0x7f5e0003bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000c10 tx=0x7f5f1c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52760/0 (socket says 172.21.15.117:52760) 2024-09-10T06:22:59.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 -- 172.21.15.117:0/1006136247 learned_addr learned my addr 172.21.15.117:0/1006136247 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 -- 172.21.15.117:0/1006136247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a05ae1ca0 con 0x562a05ae12d0 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5f25fab640 1 --2- 172.21.15.117:0/1006136247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5f18049010 tx=0x7f5f18052f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29a4393f12ef8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e097fa640 1 -- 172.21.15.117:0/1006136247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1803f040 con 0x562a05ae12d0 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e097fa640 1 -- 172.21.15.117:0/1006136247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f18061070 con 0x562a05ae12d0 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.109+0000 7f5e097fa640 1 -- 172.21.15.117:0/1006136247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f18031e30 con 0x562a05ae12d0 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1006136247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 msgr2=0x562a05ae16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1006136247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5f18049010 tx=0x7f5f18052f40 comp rx=0 tx=0).stop 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1006136247 shutdown_connections 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1006136247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae16b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1006136247 >> 172.21.15.117:0/1006136247 conn(0x562a05add700 msgr2=0x562a05adb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1006136247 shutdown_connections 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1006136247 wait complete. 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 Processor -- start 2024-09-10T06:22:59.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- start start 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562a05ae2160 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f25fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52772/0 (socket says 172.21.15.117:52772) 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 learned_addr learned my addr 172.21.15.117:0/566221313 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a05ae8ba0 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f25fab640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f1804e1b0 tx=0x7f5f1801b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 -- 172.21.15.117:0/566221313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f1803f030 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a05ae8ba0 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 -- 172.21.15.117:0/566221313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1806b070 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 -- 172.21.15.117:0/566221313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f18031450 con 0x562a05ae12d0 2024-09-10T06:22:59.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a05ae8ba0 con 0x562a05ae12d0 2024-09-10T06:22:59.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 -- 172.21.15.117:0/566221313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f1801a480 con 0x562a05ae12d0 2024-09-10T06:22:59.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5df00399d0 0x7f5df003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5df77fe640 1 -- 172.21.15.117:0/566221313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f5f18004140 con 0x562a05ae12d0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f257aa640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5df00399d0 0x7f5df003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a05af37d0 0x562a05af5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.113+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05af6370 con 0x562a05af37d0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a05af37d0 0x562a05af5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f257aa640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5df00399d0 0x7f5df003be90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0af040 tx=0x7f5f1c0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a05af37d0 0x562a05af5c20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 realm 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05af6780 con 0x562a05af37d0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05af7050 con 0x562a05af37d0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05af7f20 0x562a05afa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05afaa50 con 0x562a05af7f20 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05af7f20 0x562a05afa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05af7f20 0x562a05afa310 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 20 searching for the correct realm 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05afc9f0 0x562a05afee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05aff530 con 0x562a05afc9f0 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f257aa640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05afc9f0 0x562a05afee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f257aa640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05afc9f0 0x562a05afee60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05aff530 con 0x562a05af7f20 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5f1805c070 0x7f5f18066890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05aff530 con 0x7f5f1805c070 2024-09-10T06:22:59.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.117+0000 7f5f267ac640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5f1805c070 0x7f5f18066890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5f1805c070 0x7f5f18066890 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af7f20 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.121+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af7f20 2024-09-10T06:22:59.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af7f20 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.125+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af7f20 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05afc9f0 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x7f5f1805c070 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af37d0 2024-09-10T06:22:59.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562a05af73f0 con 0x562a05af7f20 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05afb310 con 0x562a05af37d0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05afb700 con 0x562a05af37d0 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05afb700 con 0x562a05afc9f0 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 zone default found 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 4 Realm: () 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 zonegroup default 2024-09-10T06:22:59.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.129+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05aff9b0 con 0x7f5f1805c070 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b013a0 con 0x562a05afc9f0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b01740 con 0x562a05afc9f0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 started sync module instance, tier type = 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b00840 con 0x562a05af7f20 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738484038752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b02000 con 0x562a05af7f20 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b02850 con 0x562a05af37d0 2024-09-10T06:22:59.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.133+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738484038752] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738484042576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b02850 con 0x562a05af37d0 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b03370 con 0x562a05afc9f0 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738484042576] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738484044704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b027c0 con 0x562a05afc9f0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b040e0 con 0x562a05af7f20 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738484050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b04980 con 0x562a05af7f20 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.137+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b05340 con 0x562a05af37d0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738484050960] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738484044704] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738484055696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b04980 con 0x562a05af37d0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b052b0 con 0x7f5f1805c070 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.141+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738484055696] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738484053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b048f0 con 0x7f5f1805c070 2024-09-10T06:22:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06170 con 0x7f5f1805c070 2024-09-10T06:22:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738484053200] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738484057760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06170 con 0x7f5f1805c070 2024-09-10T06:22:59.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.145+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06b30 con 0x7f5f1805c070 2024-09-10T06:22:59.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738484061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06f50 con 0x7f5f1805c070 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=0 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=1 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=2 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=3 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=4 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=5 2024-09-10T06:22:59.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738484057760] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=6 2024-09-10T06:22:59.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738484061824] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 add_watcher() i=7 2024-09-10T06:22:59.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:59.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06f50 con 0x562a05af37d0 2024-09-10T06:22:59.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738484062880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b06ec0 con 0x562a05af37d0 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738484062880] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 5 note: GC not initialized 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5dd67fc640 20 reqs_thread_entry: start 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.149+0000 7f5f284a59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 Filter name: none 2024-09-10T06:22:59.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5d47fff640 20 reqs_thread_entry: start 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2d620 con 0x562a05af7f20 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2deb0 con 0x562a05af37d0 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(63 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2c8d0 con 0x562a05af7f20 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:59.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2f4c0 con 0x562a05af37d0 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 4.23 4:c456ee1c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2ee50 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 4.4 4:210bc693:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b33a70 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 4.37 4:ed00a776:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b365d0 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 4.2d 4:b41aa053:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b38ec0 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 4.2b 4:d64dd120:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b3b840 con 0x562a05af37d0 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 4.35 4:ac74c6ce:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b3e0b0 con 0x562a05af37d0 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 4.4 4:226b6a29:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b40920 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 4.37 4:ed2df8df:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b432d0 con 0x7f5f1805c070 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 4.34 4:2c42ad31:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b45dd0 con 0x562a05af7f20 2024-09-10T06:22:59.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 4.25 4:a75a5a58:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b48730 con 0x562a05afc9f0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 4.35 4:ac804643:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562a05b4b230 con 0x562a05af37d0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(70 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(71 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(75 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(74 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(66 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(68 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(69 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(73 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(72 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.1.6 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.153+0000 7f5dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738484062880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05af37d0 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94738484062880] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738484038752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05af7f20 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94738484038752] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f284a59c0 20 remove_watcher() i=0 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f284a59c0 2 removed watcher, disabling cache 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.157+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738484042576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05af37d0 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94738484042576] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 20 remove_watcher() i=1 2024-09-10T06:22:59.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738484044704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05afc9f0 2024-09-10T06:22:59.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f257aa640 1 -- 172.21.15.117:0/566221313 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94738484044704] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1c0d9070 con 0x562a05afc9f0 2024-09-10T06:22:59.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 20 remove_watcher() i=2 2024-09-10T06:22:59.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738484050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05af7f20 2024-09-10T06:22:59.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f25fab640 1 -- 172.21.15.117:0/566221313 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94738484050960] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f1802e070 con 0x562a05af7f20 2024-09-10T06:22:59.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 20 remove_watcher() i=3 2024-09-10T06:22:59.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.161+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738484055696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x562a05af37d0 2024-09-10T06:22:59.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94738484055696] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x562a05af37d0 2024-09-10T06:22:59.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f284a59c0 20 remove_watcher() i=4 2024-09-10T06:22:59.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738484053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x7f5f1805c070 2024-09-10T06:22:59.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94738484053200] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f284a59c0 20 remove_watcher() i=5 2024-09-10T06:22:59.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.165+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738484057760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x7f5f1805c070 2024-09-10T06:22:59.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94738484057760] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 20 remove_watcher() i=6 2024-09-10T06:22:59.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738484061824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562a05b2eab0 con 0x7f5f1805c070 2024-09-10T06:22:59.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94738484061824] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f2000a4d0 con 0x7f5f1805c070 2024-09-10T06:22:59.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 20 remove_watcher() i=7 2024-09-10T06:22:59.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5f1805c070 msgr2=0x7f5f18066890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5f1805c070 0x7f5f18066890 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a05af37d0 msgr2=0x562a05af5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a05af37d0 0x562a05af5c20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05af7f20 msgr2=0x562a05afa310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05af7f20 0x562a05afa310 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05afc9f0 msgr2=0x562a05afee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05afc9f0 0x562a05afee60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5df00399d0 msgr2=0x7f5df003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5df00399d0 0x7f5df003be90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0af040 tx=0x7f5f1c0a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 msgr2=0x562a05ae8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f267ac640 1 -- 172.21.15.117:0/566221313 reap_dead start 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f1804e1b0 tx=0x7f5f1801b6a0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 shutdown_connections 2024-09-10T06:22:59.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/566221313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ae12d0 0x562a05ae8640 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 >> 172.21.15.117:0/566221313 conn(0x562a05add700 msgr2=0x562a05adb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 shutdown_connections 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/566221313 wait complete. 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 msgr2=0x7f5e0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 0x7f5e0003bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000c10 tx=0x7f5f1c005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 msgr2=0x562a05ad51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f18017aa0 tx=0x7f5f18017490 comp rx=0 tx=0).stop 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 shutdown_connections 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e00039a70 0x7f5e0003bf30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/3068286167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a05ad4dc0 0x562a05ad51e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 >> 172.21.15.117:0/3068286167 conn(0x562a05aca770 msgr2=0x562a05acab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 shutdown_connections 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.169+0000 7f5f284a59c0 1 -- 172.21.15.117:0/3068286167 wait complete. 2024-09-10T06:22:59.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a059c8880 msgr2=0x562a05abe0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562a059c8880 0x562a05abe0e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05ac0880 msgr2=0x562a05ac2c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562a05ac0880 0x562a05ac2c70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05ac4780 msgr2=0x562a05ac6b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562a05ac4780 0x562a05ac6b70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e0c039a70 msgr2=0x7f5e0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5e0c039a70 0x7f5e0c03bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0ae000 tx=0x7f5f1c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 msgr2=0x562a05ab6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 --2- 172.21.15.117:0/1268611244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562a059387b0 0x562a05ab6f70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x562a05ab08c0 tx=0x7f5f18000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f267ac640 1 -- 172.21.15.117:0/1268611244 reap_dead start 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 shutdown_connections 2024-09-10T06:22:59.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 >> 172.21.15.117:0/1268611244 conn(0x562a059bee90 msgr2=0x562a05aaa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 shutdown_connections 2024-09-10T06:22:59.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.173+0000 7f5f284a59c0 1 -- 172.21.15.117:0/1268611244 wait complete. 2024-09-10T06:22:59.183 INFO:teuthology.orchestra.run.smithi117.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"1f11ec0c-dab3-4c88-849a-c22a32f07424","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","marker":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T06:22:58.463063Z","creation_time":"2024-09-10T06:22:54.613572Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-10T06:22:59.183 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:22:58.463063Z', 'creation_time': '2024-09-10T06:22:54.613572Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-10T06:22:59.183 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-10T06:22:59.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-10T06:22:59.183 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-10T06:22:59.255 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:59.256 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:59.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff2946419c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x555db1fa88a0 0x555db1faac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff2946419c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555db1e569c0 con 0x555db1fa4750 2024-09-10T06:22:59.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff2946419c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x555db1ea66d0 con 0x555db1fa88a0 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff291946640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x555db1fa88a0 0x555db1faac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff291946640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x555db1fa88a0 0x555db1faac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52786/0 (socket says 172.21.15.117:52786) 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff292147640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x555db1fa4750 0x555db1fa4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52596/0 (socket says 172.21.15.117:52596) 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.253+0000 7ff291946640 1 -- 172.21.15.117:0/2561275965 learned_addr learned my addr 172.21.15.117:0/2561275965 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291946640 1 -- 172.21.15.117:0/2561275965 >> v1:172.21.15.84:6789/0 conn(0x555db1fa4750 legacy=0x555db1fa4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291946640 1 -- 172.21.15.117:0/2561275965 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db1e4aca0 con 0x555db1fa88a0 2024-09-10T06:22:59.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291946640 1 --2- 172.21.15.117:0/2561275965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa88a0 0x555db1faac90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a5c0 tx=0x7ff28801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e7b4b77a77917f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291145640 1 -- 172.21.15.117:0/2561275965 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2880a9590 con 0x555db1fa88a0 2024-09-10T06:22:59.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291145640 1 -- 172.21.15.117:0/2561275965 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2880ae070 con 0x555db1fa88a0 2024-09-10T06:22:59.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff291145640 1 -- 172.21.15.117:0/2561275965 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2880a9880 con 0x555db1fa88a0 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 -- 172.21.15.117:0/2561275965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa88a0 msgr2=0x555db1faac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2561275965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa88a0 0x555db1faac90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a5c0 tx=0x7ff28801b3d0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 -- 172.21.15.117:0/2561275965 shutdown_connections 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2561275965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa88a0 0x555db1faac90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 -- 172.21.15.117:0/2561275965 >> 172.21.15.117:0/2561275965 conn(0x555db1f18060 msgr2=0x555db1f18470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 -- 172.21.15.117:0/2561275965 shutdown_connections 2024-09-10T06:22:59.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.257+0000 7ff2946419c0 1 -- 172.21.15.117:0/2561275965 wait complete. 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.269+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555db1eaa680 con 0x555db1fa4750 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52798/0 (socket says 172.21.15.117:52798) 2024-09-10T06:22:59.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 -- 172.21.15.117:0/3215649931 learned_addr learned my addr 172.21.15.117:0/3215649931 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 -- 172.21.15.117:0/3215649931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db1e25da0 con 0x555db1fa4750 2024-09-10T06:22:59.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 --2- 172.21.15.117:0/3215649931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff284001ec0 tx=0x7ff28400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3364df3ff9670084 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff180608640 1 -- 172.21.15.117:0/3215649931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28400e5d0 con 0x555db1fa4750 2024-09-10T06:22:59.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff180608640 1 -- 172.21.15.117:0/3215649931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28400e770 con 0x555db1fa4750 2024-09-10T06:22:59.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff180608640 1 -- 172.21.15.117:0/3215649931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28400ea70 con 0x555db1fa4750 2024-09-10T06:22:59.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- 172.21.15.117:0/3215649931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 msgr2=0x555db208f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 --2- 172.21.15.117:0/3215649931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff284001ec0 tx=0x7ff28400b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- 172.21.15.117:0/3215649931 shutdown_connections 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 --2- 172.21.15.117:0/3215649931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db208f960 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- 172.21.15.117:0/3215649931 >> 172.21.15.117:0/3215649931 conn(0x555db1f18060 msgr2=0x555db208b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- 172.21.15.117:0/3215649931 shutdown_connections 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- 172.21.15.117:0/3215649931 wait complete. 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db2097000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff2946419c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555db1e4ca50 con 0x555db1fa4750 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db2097000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db2097000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52808/0 (socket says 172.21.15.117:52808) 2024-09-10T06:22:59.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 -- 172.21.15.117:0/1291103379 learned_addr learned my addr 172.21.15.117:0/1291103379 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.273+0000 7ff292147640 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db2097560 con 0x555db1fa4750 2024-09-10T06:22:59.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292147640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db2097000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x555db2090950 tx=0x7ff284000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 -- 172.21.15.117:0/1291103379 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28400f8e0 con 0x555db1fa4750 2024-09-10T06:22:59.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db20977f0 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 -- 172.21.15.117:0/1291103379 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28400fa80 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db20981a0 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 -- 172.21.15.117:0/1291103379 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28402c060 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 -- 172.21.15.117:0/1291103379 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff284017070 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff178039a70 0x7ff17803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff17ee05640 1 -- 172.21.15.117:0/1291103379 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff284015020 con 0x555db1fa4750 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff291946640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff178039a70 0x7ff17803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db1fa88a0 0x555db209e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db209e6b0 con 0x555db1fa88a0 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292948640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db1fa88a0 0x555db209e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff291946640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff178039a70 0x7ff17803bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ad000 tx=0x7ff2880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292948640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db1fa88a0 0x555db209e170 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292948640 1 -- 172.21.15.117:0/1291103379 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db1fa88a0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db209ead0 con 0x555db1fa88a0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292948640 1 -- 172.21.15.117:0/1291103379 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db1fa88a0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20a08e0 0x555db20a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20a3370 con 0x555db20a08e0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292147640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20a08e0 0x555db20a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292147640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20a08e0 0x555db20a2cd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff292147640 1 -- 172.21.15.117:0/1291103379 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff28402e070 con 0x555db20a08e0 2024-09-10T06:22:59.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.277+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db209f750 con 0x555db1fa88a0 2024-09-10T06:22:59.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292948640 1 -- 172.21.15.117:0/1291103379 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db1fa88a0 2024-09-10T06:22:59.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20a47b0 0x555db20a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20a7350 con 0x555db20a47b0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff291946640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20a47b0 0x555db20a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff291946640 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20a47b0 0x555db20a6bc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff291946640 1 -- 172.21.15.117:0/1291103379 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20a47b0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555db1eb7450 con 0x555db20b4e10 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52822/0 (socket says 172.21.15.117:52822) 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292147640 1 -- 172.21.15.117:0/2882591502 learned_addr learned my addr 172.21.15.117:0/2882591502 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292147640 1 -- 172.21.15.117:0/2882591502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db20b5870 con 0x555db20b4e10 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff292147640 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff28401cfd0 tx=0x7ff284017910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff177fff640 1 -- 172.21.15.117:0/2882591502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28401da80 con 0x555db20b4e10 2024-09-10T06:22:59.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff177fff640 1 -- 172.21.15.117:0/2882591502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff284035070 con 0x555db20b4e10 2024-09-10T06:22:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db20b60d0 con 0x555db20b4e10 2024-09-10T06:22:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff177fff640 1 -- 172.21.15.117:0/2882591502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28401dd50 con 0x555db20b4e10 2024-09-10T06:22:59.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.281+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db20b60d0 con 0x555db20b4e10 2024-09-10T06:22:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff177fff640 1 -- 172.21.15.117:0/2882591502 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff28401a480 con 0x555db20b4e10 2024-09-10T06:22:59.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff177fff640 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 0x7ff16c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff177fff640 1 -- 172.21.15.117:0/2882591502 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff28404b070 con 0x555db20b4e10 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff291946640 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 0x7ff16c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff291946640 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 0x7ff16c03bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c10 tx=0x7ff288005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555db20901b0 con 0x555db20c23b0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52824/0 (socket says 172.21.15.117:52824) 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 -- 172.21.15.117:0/100717536 learned_addr learned my addr 172.21.15.117:0/100717536 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 -- 172.21.15.117:0/100717536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db20c2d60 con 0x555db20c23b0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 --2- 172.21.15.117:0/100717536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff28402ffd0 tx=0x7ff284038fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac39d0435e6c909 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff175ffb640 1 -- 172.21.15.117:0/100717536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28405d020 con 0x555db20c23b0 2024-09-10T06:22:59.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff175ffb640 1 -- 172.21.15.117:0/100717536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28401b3d0 con 0x555db20c23b0 2024-09-10T06:22:59.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff175ffb640 1 -- 172.21.15.117:0/100717536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28403e040 con 0x555db20c23b0 2024-09-10T06:22:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- 172.21.15.117:0/100717536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 msgr2=0x555db20c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 --2- 172.21.15.117:0/100717536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff28402ffd0 tx=0x7ff284038fe0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- 172.21.15.117:0/100717536 shutdown_connections 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 --2- 172.21.15.117:0/100717536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c2790 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- 172.21.15.117:0/100717536 >> 172.21.15.117:0/100717536 conn(0x555db20bd770 msgr2=0x555db20bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- 172.21.15.117:0/100717536 shutdown_connections 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- 172.21.15.117:0/100717536 wait complete. 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 Processor -- start 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- start start 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff2946419c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555db20c1120 con 0x555db20c23b0 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52826/0 (socket says 172.21.15.117:52826) 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.285+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 learned_addr learned my addr 172.21.15.117:0/747638331 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db20c8c20 con 0x555db20c23b0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292147640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff28402ffd0 tx=0x7ff284010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 -- 172.21.15.117:0/747638331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff28403e040 con 0x555db20c23b0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db20c8c20 con 0x555db20c23b0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 -- 172.21.15.117:0/747638331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28401b3d0 con 0x555db20c23b0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db20c8c20 con 0x555db20c23b0 2024-09-10T06:22:59.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 -- 172.21.15.117:0/747638331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff284045c70 con 0x555db20c23b0 2024-09-10T06:22:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 -- 172.21.15.117:0/747638331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff284060020 con 0x555db20c23b0 2024-09-10T06:22:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c039a70 0x7ff15c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff163fff640 1 -- 172.21.15.117:0/747638331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7ff284078aa0 con 0x555db20c23b0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff291946640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c039a70 0x7ff15c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db20d3880 0x555db20d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20d6460 con 0x555db20d3880 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db20d3880 0x555db20d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff291946640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c039a70 0x7ff15c03bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x555db20a7750 tx=0x7ff2880c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db20d3880 0x555db20d5d10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 realm 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20d6870 con 0x555db20d3880 2024-09-10T06:22:59.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20d7140 con 0x555db20d3880 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20d8010 0x555db20da400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20dab40 con 0x555db20d8010 2024-09-10T06:22:59.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.289+0000 7ff292147640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20d8010 0x555db20da400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292147640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20d8010 0x555db20da400 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff2946419c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff2946419c0 20 searching for the correct realm 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20dcae0 0x555db20def50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20df620 con 0x555db20dcae0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff291946640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20dcae0 0x555db20def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff291946640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20dcae0 0x555db20def50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20df620 con 0x555db20d8010 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292147640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff284062030 0x7ff284064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20df620 con 0x7ff284062030 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff284062030 0x7ff284064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff284062030 0x7ff284064a90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.293+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d8010 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d8010 2024-09-10T06:22:59.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.297+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d8010 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.301+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d8010 2024-09-10T06:22:59.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20dcae0 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x7ff284062030 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d3880 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20d74e0 con 0x555db20d8010 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:59.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20db400 con 0x555db20d3880 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20db7f0 con 0x555db20d3880 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20db7f0 con 0x555db20dcae0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 zone default found 2024-09-10T06:22:59.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 4 Realm: () 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 zonegroup default 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20dfaa0 con 0x7ff284062030 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20e1490 con 0x555db20dcae0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20e1830 con 0x555db20dcae0 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 started sync module instance, tier type = 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.305+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e0930 con 0x555db20d8010 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93860907584848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e20d0 con 0x555db20d8010 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e2920 con 0x555db20d3880 2024-09-10T06:22:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93860907584848] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93860907588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e2920 con 0x555db20d3880 2024-09-10T06:22:59.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.309+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e33a0 con 0x555db20dcae0 2024-09-10T06:22:59.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93860907593360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e3c70 con 0x555db20dcae0 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93860907588640] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93860907590768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4f40 con 0x555db20d8010 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e5790 con 0x555db20d3880 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93860907593360] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93860907590768] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93860907600528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e5360 con 0x555db20d3880 2024-09-10T06:22:59.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.313+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e5bb0 con 0x7ff284062030 2024-09-10T06:22:59.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.317+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93860907600528] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.317+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.317+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93860907601856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e5910 con 0x7ff284062030 2024-09-10T06:22:59.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.317+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e6490 con 0x7ff284062030 2024-09-10T06:22:59.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.317+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93860907601856] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93860907602912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e63d0 con 0x7ff284062030 2024-09-10T06:22:59.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e6ea0 con 0x7ff284062030 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93860907608560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e72c0 con 0x7ff284062030 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=0 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=1 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=2 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=3 2024-09-10T06:22:59.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=4 2024-09-10T06:22:59.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=5 2024-09-10T06:22:59.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93860907602912] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.321+0000 7ff2946419c0 20 add_watcher() i=6 2024-09-10T06:22:59.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93860907608560] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 20 add_watcher() i=7 2024-09-10T06:22:59.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:59.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555db20e5f20 con 0x555db20d3880 2024-09-10T06:22:59.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93860907605792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e7840 con 0x555db20d3880 2024-09-10T06:22:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93860907605792] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:59.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 5 note: GC not initialized 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff0c37fe640 20 reqs_thread_entry: start 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 20 Filter name: none 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff0c17fa640 20 reqs_thread_entry: start 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db210cf10 con 0x7ff284062030 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.325+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20db400 con 0x7ff284062030 2024-09-10T06:22:59.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20db400 con 0x555db20dcae0 2024-09-10T06:22:59.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e3c70 con 0x7ff284062030 2024-09-10T06:22:59.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e3c70 con 0x555db20d3880 2024-09-10T06:22:59.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e3c70 con 0x555db20d8010 2024-09-10T06:22:59.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'11 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.329+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d3880 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d3880 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d3880 2024-09-10T06:22:59.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d3880 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x7ff284062030 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.333+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x7ff284062030 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20dcae0 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d3880 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x555db20d8010 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4670 con 0x7ff284062030 2024-09-10T06:22:59.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.337+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.345 INFO:teuthology.orchestra.run.smithi117.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93860907605792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db210b210 con 0x555db20d3880 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93860907605792] v30'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93860907584848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db210b210 con 0x555db20d8010 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93860907584848] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff2946419c0 20 remove_watcher() i=0 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff2946419c0 2 removed watcher, disabling cache 2024-09-10T06:22:59.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.341+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93860907588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e0d50 con 0x555db20d3880 2024-09-10T06:22:59.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93860907588640] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff2946419c0 20 remove_watcher() i=1 2024-09-10T06:22:59.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93860907593360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e0d50 con 0x555db20dcae0 2024-09-10T06:22:59.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff291946640 1 -- 172.21.15.117:0/747638331 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93860907593360] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2880a9a70 con 0x555db20dcae0 2024-09-10T06:22:59.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff2946419c0 20 remove_watcher() i=2 2024-09-10T06:22:59.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.345+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93860907590768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e1c20 con 0x555db20d8010 2024-09-10T06:22:59.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff292147640 1 -- 172.21.15.117:0/747638331 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93860907590768] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284080040 con 0x555db20d8010 2024-09-10T06:22:59.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 20 remove_watcher() i=3 2024-09-10T06:22:59.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93860907600528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e1c20 con 0x555db20d3880 2024-09-10T06:22:59.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93860907600528] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x555db20d3880 2024-09-10T06:22:59.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 20 remove_watcher() i=4 2024-09-10T06:22:59.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93860907601856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4a90 con 0x7ff284062030 2024-09-10T06:22:59.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93860907601856] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 20 remove_watcher() i=5 2024-09-10T06:22:59.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.349+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93860907602912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4a90 con 0x7ff284062030 2024-09-10T06:22:59.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93860907602912] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 20 remove_watcher() i=6 2024-09-10T06:22:59.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93860907608560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555db20e4a90 con 0x7ff284062030 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93860907608560] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff28c00a4d0 con 0x7ff284062030 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 20 remove_watcher() i=7 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff284062030 msgr2=0x7ff284064a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff284062030 0x7ff284064a90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db20d3880 msgr2=0x555db20d5d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db20d3880 0x555db20d5d10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20d8010 msgr2=0x555db20da400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20d8010 0x555db20da400 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20dcae0 msgr2=0x555db20def50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20dcae0 0x555db20def50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c039a70 msgr2=0x7ff15c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff15c039a70 0x7ff15c03bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x555db20a7750 tx=0x7ff2880c1040 comp rx=0 tx=0).stop 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 msgr2=0x555db20c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff292948640 1 -- 172.21.15.117:0/747638331 reap_dead start 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.353+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff28402ffd0 tx=0x7ff284010f30 comp rx=0 tx=0).stop 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 shutdown_connections 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/747638331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20c23b0 0x555db20c86c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 >> 172.21.15.117:0/747638331 conn(0x555db20bd770 msgr2=0x555db20bb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 shutdown_connections 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/747638331 wait complete. 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 msgr2=0x7ff16c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 0x7ff16c03bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c10 tx=0x7ff288005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 msgr2=0x555db20b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff28401cfd0 tx=0x7ff284017910 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 shutdown_connections 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff16c039a70 0x7ff16c03bf30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/2882591502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db20b4e10 0x555db20b5230 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 >> 172.21.15.117:0/2882591502 conn(0x555db20aa7c0 msgr2=0x555db20aaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 shutdown_connections 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/2882591502 wait complete. 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db1fa88a0 msgr2=0x555db209e170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555db1fa88a0 0x555db209e170 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20a08e0 msgr2=0x555db20a2cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x555db20a08e0 0x555db20a2cd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20a47b0 msgr2=0x555db20a6bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555db20a47b0 0x555db20a6bc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff178039a70 msgr2=0x7ff17803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff178039a70 0x7ff17803bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ad000 tx=0x7ff2880a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 msgr2=0x555db2097000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 --2- 172.21.15.117:0/1291103379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555db1fa4750 0x555db2097000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x555db2090950 tx=0x7ff284000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff292948640 1 -- 172.21.15.117:0/1291103379 reap_dead start 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 shutdown_connections 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 >> 172.21.15.117:0/1291103379 conn(0x555db1f18060 msgr2=0x555db208a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 shutdown_connections 2024-09-10T06:22:59.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.357+0000 7ff2946419c0 1 -- 172.21.15.117:0/1291103379 wait complete. 2024-09-10T06:22:59.367 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-10T06:22:59.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T06:22:59.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T06:22:59.368 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T06:22:59.438 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:59.466 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:59.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fd3629c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564028882880 0x564028884c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fd3629c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640287329c0 con 0x5640287f27b0 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fd3629c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5640287826d0 con 0x564028882880 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fa667640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564028882880 0x564028884c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fa667640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564028882880 0x564028884c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52836/0 (socket says 172.21.15.117:52836) 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fae68640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5640287f27b0 0x564028881160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52608/0 (socket says 172.21.15.117:52608) 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fa667640 1 -- 172.21.15.117:0/3193120096 learned_addr learned my addr 172.21.15.117:0/3193120096 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fa667640 1 -- 172.21.15.117:0/3193120096 >> v1:172.21.15.84:6789/0 conn(0x5640287f27b0 legacy=0x564028881160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.437+0000 7fa7fa667640 1 -- 172.21.15.117:0/3193120096 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564028726ca0 con 0x564028882880 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fa667640 1 --2- 172.21.15.117:0/3193120096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028882880 0x564028884c70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400a5c0 tx=0x7fa7e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a29661abf38b7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7f9e66640 1 -- 172.21.15.117:0/3193120096 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e40b1070 con 0x564028882880 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7f9e66640 1 -- 172.21.15.117:0/3193120096 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40a8070 con 0x564028882880 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7f9e66640 1 -- 172.21.15.117:0/3193120096 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e40ac5b0 con 0x564028882880 2024-09-10T06:22:59.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3193120096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028882880 msgr2=0x564028884c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3193120096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028882880 0x564028884c70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400a5c0 tx=0x7fa7e401b340 comp rx=0 tx=0).stop 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3193120096 shutdown_connections 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3193120096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028882880 0x564028884c70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3193120096 >> 172.21.15.117:0/3193120096 conn(0x564028878e90 msgr2=0x56402887b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3193120096 shutdown_connections 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.441+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3193120096 wait complete. 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.453+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.453+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564028786680 con 0x5640287f27b0 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52852/0 (socket says 172.21.15.117:52852) 2024-09-10T06:22:59.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 -- 172.21.15.117:0/1361197310 learned_addr learned my addr 172.21.15.117:0/1361197310 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 -- 172.21.15.117:0/1361197310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564028701da0 con 0x5640287f27b0 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- 172.21.15.117:0/1361197310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001ec0 tx=0x7fa7ec00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a40f09ab220252 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa6e8e09640 1 -- 172.21.15.117:0/1361197310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec00e5d0 con 0x5640287f27b0 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa6e8e09640 1 -- 172.21.15.117:0/1361197310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00e770 con 0x5640287f27b0 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa6e8e09640 1 -- 172.21.15.117:0/1361197310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec00ea70 con 0x5640287f27b0 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1361197310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 msgr2=0x56402887e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1361197310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001ec0 tx=0x7fa7ec00b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1361197310 shutdown_connections 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1361197310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x56402887e660 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1361197310 >> 172.21.15.117:0/1361197310 conn(0x564028878e90 msgr2=0x564028965570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1361197310 shutdown_connections 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1361197310 wait complete. 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x564028973180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fd3629c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564028728a50 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x564028973180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x564028973180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52858/0 (socket says 172.21.15.117:52858) 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 -- 172.21.15.117:0/3563711953 learned_addr learned my addr 172.21.15.117:0/3563711953 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640289736e0 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.457+0000 7fa7fae68640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x564028973180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x56402887e220 tx=0x7fa7ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 -- 172.21.15.117:0/3563711953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec00f8e0 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564028973970 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 -- 172.21.15.117:0/3563711953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00fa80 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 -- 172.21.15.117:0/3563711953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec00fda0 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564028974320 con 0x5640287f27b0 2024-09-10T06:22:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 -- 172.21.15.117:0/3563711953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7ec017070 con 0x5640287f27b0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6e0039ac0 0x7fa6e003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa6e7606640 1 -- 172.21.15.117:0/3563711953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa7ec015020 con 0x5640287f27b0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fa667640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6e0039ac0 0x7fa6e003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564028882880 0x56402897a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56402897a830 con 0x564028882880 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fb669640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564028882880 0x56402897a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fa667640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6e0039ac0 0x7fa6e003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40ae000 tx=0x7fa7e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fb669640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564028882880 0x56402897a2f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fb669640 1 -- 172.21.15.117:0/3563711953 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x564028882880 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564028974680 con 0x564028882880 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fb669640 1 -- 172.21.15.117:0/3563711953 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7f400a4d0 con 0x564028882880 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56402897cb20 0x56402897ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56402897f650 con 0x56402897cb20 2024-09-10T06:22:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fae68640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56402897cb20 0x56402897ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fae68640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56402897cb20 0x56402897ef10 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fae68640 1 -- 172.21.15.117:0/3563711953 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7ec02e070 con 0x56402897cb20 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.461+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56402897b9c0 con 0x564028882880 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fb669640 1 -- 172.21.15.117:0/3563711953 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7f400a4d0 con 0x564028882880 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564028980a90 0x564028982e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564028983510 con 0x564028980a90 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fa667640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564028980a90 0x564028982e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fa667640 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564028980a90 0x564028982e80 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fa667640 1 -- 172.21.15.117:0/3563711953 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7e40b4040 con 0x564028980a90 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564028793450 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52866/0 (socket says 172.21.15.117:52866) 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fae68640 1 -- 172.21.15.117:0/2459293058 learned_addr learned my addr 172.21.15.117:0/2459293058 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fae68640 1 -- 172.21.15.117:0/2459293058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564028991a00 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fae68640 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec017aa0 tx=0x7fa7ec019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa6e4e01640 1 -- 172.21.15.117:0/2459293058 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec0193e0 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564028992260 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa6e4e01640 1 -- 172.21.15.117:0/2459293058 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec035070 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa6e4e01640 1 -- 172.21.15.117:0/2459293058 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec0196f0 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.465+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564028992260 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6e4e01640 1 -- 172.21.15.117:0/2459293058 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7ec01a480 con 0x564028990fa0 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6e4e01640 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 0x7fa6d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6e4e01640 1 -- 172.21.15.117:0/2459293058 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa7ec03bb10 con 0x564028990fa0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fa667640 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 0x7fa6d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fa667640 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 0x7fa6d403bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x564028974a20 tx=0x7fa7e4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56402887eeb0 con 0x56402899d4b0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52872/0 (socket says 172.21.15.117:52872) 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 -- 172.21.15.117:0/274918081 learned_addr learned my addr 172.21.15.117:0/274918081 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 -- 172.21.15.117:0/274918081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402899de80 con 0x56402899d4b0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 --2- 172.21.15.117:0/274918081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec011ff0 tx=0x7fa7ec019980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6568df6bfaddabf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6de7fc640 1 -- 172.21.15.117:0/274918081 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec061070 con 0x56402899d4b0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6de7fc640 1 -- 172.21.15.117:0/274918081 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec042350 con 0x56402899d4b0 2024-09-10T06:22:59.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa6de7fc640 1 -- 172.21.15.117:0/274918081 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec03f040 con 0x56402899d4b0 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/274918081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 msgr2=0x56402899d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/274918081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec011ff0 tx=0x7fa7ec019980 comp rx=0 tx=0).stop 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/274918081 shutdown_connections 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/274918081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x56402899d890 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/274918081 >> 172.21.15.117:0/274918081 conn(0x5640289998e0 msgr2=0x564028997b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/274918081 shutdown_connections 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/274918081 wait complete. 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 Processor -- start 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- start start 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fd3629c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56402899e340 con 0x56402899d4b0 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52876/0 (socket says 172.21.15.117:52876) 2024-09-10T06:22:59.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.469+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 learned_addr learned my addr 172.21.15.117:0/1369264170 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640289a4da0 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fae68640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec017c50 tx=0x7fa7ec051400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 -- 172.21.15.117:0/1369264170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec061030 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 -- 172.21.15.117:0/1369264170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec06d070 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640289a4da0 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 -- 172.21.15.117:0/1369264170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec03f050 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640289a4da0 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 -- 172.21.15.117:0/1369264170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7ec042920 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6c4039a70 0x7fa6c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa6dcff9640 1 -- 172.21.15.117:0/1369264170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7fa7ec062070 con 0x56402899d4b0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fa667640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6c4039a70 0x7fa6c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5640289af990 0x5640289b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b2570 con 0x5640289af990 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fb669640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5640289af990 0x5640289b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fa667640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6c4039a70 0x7fa6c403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000c10 tx=0x7fa7e40a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fb669640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5640289af990 0x5640289b1e20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 realm 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b2980 con 0x5640289af990 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.473+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b3250 con 0x5640289af990 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5640289b4350 0x5640289b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b6d50 con 0x5640289b4350 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5640289b4350 0x5640289b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5640289b4350 0x5640289b6740 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:59.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 20 searching for the correct realm 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5640289b8c30 0x5640289bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289bb6e0 con 0x5640289b8c30 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fa667640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5640289b8c30 0x5640289bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fa667640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5640289b8c30 0x5640289bb060 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289bb6e0 con 0x5640289b4350 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa7ec051020 0x7fa7ec051860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289bb6e0 con 0x7fa7ec051020 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa7ec051020 0x7fa7ec051860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa7ec051020 0x7fa7ec051860 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.477+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b4350 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b4350 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.481+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b4350 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.485+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b4350 2024-09-10T06:22:59.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b8c30 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x7fa7ec051020 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289af990 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5640289b35f0 con 0x5640289b4350 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:59.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b75a0 con 0x5640289af990 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b7990 con 0x5640289af990 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289b7990 con 0x5640289b8c30 2024-09-10T06:22:59.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 zone default found 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 4 Realm: () 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 zonegroup default 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289bbb60 con 0x7fa7ec051020 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.489+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289bd650 con 0x5640289b8c30 2024-09-10T06:22:59.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289bdaa0 con 0x5640289b8c30 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 20 started sync module instance, tier type = 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289b7ea0 con 0x5640289b4350 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833559194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bdf00 con 0x5640289b4350 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289be950 con 0x5640289af990 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833559194304] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833559200832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289be910 con 0x5640289af990 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.493+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bf360 con 0x5640289b8c30 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833559203504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bfc00 con 0x5640289b8c30 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c0600 con 0x5640289b4350 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833559200832] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833559195392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c0a20 con 0x5640289b4350 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c13e0 con 0x5640289af990 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833559203504] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.497+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833559195392] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833559208208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c0f30 con 0x5640289af990 2024-09-10T06:22:59.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c17c0 con 0x7fa7ec051020 2024-09-10T06:22:59.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833559208208] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833559205712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c13e0 con 0x7fa7ec051020 2024-09-10T06:22:59.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.501+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c21d0 con 0x7fa7ec051020 2024-09-10T06:22:59.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833559215392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c25f0 con 0x7fa7ec051020 2024-09-10T06:22:59.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c3030 con 0x7fa7ec051020 2024-09-10T06:22:59.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833559205712] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833559215392] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833559218944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c2140 con 0x7fa7ec051020 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=0 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=1 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=2 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=3 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=4 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=5 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.505+0000 7fa7fd3629c0 20 add_watcher() i=6 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833559218944] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 add_watcher() i=7 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289c6130 con 0x5640289af990 2024-09-10T06:22:59.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833559211824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c35b0 con 0x5640289af990 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833559211824] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa6b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 5 note: GC not initialized 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa62bfff640 20 reqs_thread_entry: start 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 Filter name: none 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa629ffb640 20 reqs_thread_entry: start 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289e9530 con 0x5640289af990 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.509+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289e8f50 con 0x5640289b4350 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 20 disabling bucket name=myfoo 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289e9fa0 con 0x5640289b4350 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:59.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289eb880 con 0x5640289af990 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289f4700 con 0x5640289af990 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.513+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94833559388256 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289f3350 con 0x7fa7ec051020 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== watch-notify(notify (1) cookie 94833559205712 notify 128849018895 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5640289ebc70 con 0x7fa7ec051020 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94833559205712 notifier 4589 bl.length()=760 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6de7fc640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa6c0003eb0 con 0x7fa7ec051020 2024-09-10T06:22:59.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 notify.5 [notify cookie 94833559388256 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify_complete (2) cookie 94833559388256 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640289e9c90 con 0x7fa7ec051020 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289ed070 con 0x5640289af990 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94833559370640 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5640289e8460 con 0x5640289af990 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify (1) cookie 94833559208208 notify 128849018896 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5640289e9c90 con 0x5640289af990 2024-09-10T06:22:59.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94833559208208 notifier 4589 bl.length()=567 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6ddffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(70 notify.4 [notify cookie 94833559370640 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6ddffb640 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa630003440 con 0x5640289af990 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== watch-notify(notify_complete (2) cookie 94833559370640 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa7f40345b0 con 0x5640289af990 2024-09-10T06:22:59.525 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:59.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa6b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.517+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833559211824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289e7290 con 0x5640289af990 2024-09-10T06:22:59.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94833559211824] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833559194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289e7290 con 0x5640289b4350 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94833559194304] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fd3629c0 20 remove_watcher() i=0 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fd3629c0 2 removed watcher, disabling cache 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.521+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833559200832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289e7290 con 0x5640289af990 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94833559200832] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 20 remove_watcher() i=1 2024-09-10T06:22:59.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833559203504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289e7290 con 0x5640289b8c30 2024-09-10T06:22:59.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fa667640 1 -- 172.21.15.117:0/1369264170 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94833559203504] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e40d9070 con 0x5640289b8c30 2024-09-10T06:22:59.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 20 remove_watcher() i=2 2024-09-10T06:22:59.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833559195392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bcac0 con 0x5640289b4350 2024-09-10T06:22:59.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fae68640 1 -- 172.21.15.117:0/1369264170 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94833559195392] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec02e070 con 0x5640289b4350 2024-09-10T06:22:59.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 20 remove_watcher() i=3 2024-09-10T06:22:59.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.525+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833559208208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bcac0 con 0x5640289af990 2024-09-10T06:22:59.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94833559208208] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x5640289af990 2024-09-10T06:22:59.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fd3629c0 20 remove_watcher() i=4 2024-09-10T06:22:59.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833559205712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c0110 con 0x7fa7ec051020 2024-09-10T06:22:59.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94833559205712] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fd3629c0 20 remove_watcher() i=5 2024-09-10T06:22:59.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.529+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833559215392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289bf750 con 0x7fa7ec051020 2024-09-10T06:22:59.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94833559215392] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 20 remove_watcher() i=6 2024-09-10T06:22:59.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833559218944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5640289c1d20 con 0x7fa7ec051020 2024-09-10T06:22:59.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94833559218944] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f400a4d0 con 0x7fa7ec051020 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 20 remove_watcher() i=7 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa7ec051020 msgr2=0x7fa7ec051860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa7ec051020 0x7fa7ec051860 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5640289af990 msgr2=0x5640289b1e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5640289af990 0x5640289b1e20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5640289b4350 msgr2=0x5640289b6740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5640289b4350 0x5640289b6740 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5640289b8c30 msgr2=0x5640289bb060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5640289b8c30 0x5640289bb060 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6c4039a70 msgr2=0x7fa6c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6c4039a70 0x7fa6c403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000c10 tx=0x7fa7e40a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 msgr2=0x5640289a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fb669640 1 -- 172.21.15.117:0/1369264170 reap_dead start 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec017c50 tx=0x7fa7ec051400 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 shutdown_connections 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/1369264170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56402899d4b0 0x5640289a4840 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 >> 172.21.15.117:0/1369264170 conn(0x5640289998e0 msgr2=0x564028997af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 shutdown_connections 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/1369264170 wait complete. 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 msgr2=0x7fa6d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 0x7fa6d403bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x564028974a20 tx=0x7fa7e4005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 msgr2=0x5640289913c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec017aa0 tx=0x7fa7ec019e60 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 shutdown_connections 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6d4039a70 0x7fa6d403bf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/2459293058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564028990fa0 0x5640289913c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 >> 172.21.15.117:0/2459293058 conn(0x564028986950 msgr2=0x564028986d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 shutdown_connections 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/2459293058 wait complete. 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564028882880 msgr2=0x56402897a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564028882880 0x56402897a2f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56402897cb20 msgr2=0x56402897ef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56402897cb20 0x56402897ef10 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564028980a90 msgr2=0x564028982e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.533+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564028980a90 0x564028982e80 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6e0039ac0 msgr2=0x7fa6e003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa6e0039ac0 0x7fa6e003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40ae000 tx=0x7fa7e40a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 msgr2=0x564028973180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 --2- 172.21.15.117:0/3563711953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640287f27b0 0x564028973180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x56402887e220 tx=0x7fa7ec000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fb669640 1 -- 172.21.15.117:0/3563711953 reap_dead start 2024-09-10T06:22:59.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 shutdown_connections 2024-09-10T06:22:59.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 >> 172.21.15.117:0/3563711953 conn(0x564028878e90 msgr2=0x56402887d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 shutdown_connections 2024-09-10T06:22:59.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.537+0000 7fa7fd3629c0 1 -- 172.21.15.117:0/3563711953 wait complete. 2024-09-10T06:22:59.549 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:59.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T06:22:59.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T06:22:59.551 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T06:22:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:22:59.628 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:22:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.625+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.625+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.625+0000 7f729b5af9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ef96821880 0x55ef96823c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.625+0000 7f729b5af9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef966d19c0 con 0x55ef967917b0 2024-09-10T06:22:59.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.625+0000 7f729b5af9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55ef967216d0 con 0x55ef96821880 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ef96821880 0x55ef96823c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55ef96821880 0x55ef96823c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52890/0 (socket says 172.21.15.117:52890) 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 -- 172.21.15.117:0/1651460100 learned_addr learned my addr 172.21.15.117:0/1651460100 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72990b5640 1 --1- 172.21.15.117:0/1651460100 >> v1:172.21.15.84:6789/0 conn(0x55ef967917b0 0x55ef96820160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:52610/0 (socket says 172.21.15.117:52610) 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 -- 172.21.15.117:0/1651460100 >> v1:172.21.15.84:6789/0 conn(0x55ef967917b0 legacy=0x55ef96820160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 -- 172.21.15.117:0/1651460100 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef966c5ca0 con 0x55ef96821880 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f72988b4640 1 --2- 172.21.15.117:0/1651460100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef96821880 0x55ef96823c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f729000a5c0 tx=0x7f729001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1cf49bdb8d47db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f728bfff640 1 -- 172.21.15.117:0/1651460100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72900b1070 con 0x55ef96821880 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f728bfff640 1 -- 172.21.15.117:0/1651460100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72900a8070 con 0x55ef96821880 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f728bfff640 1 -- 172.21.15.117:0/1651460100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72900ac5b0 con 0x55ef96821880 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1651460100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef96821880 msgr2=0x55ef96823c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1651460100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef96821880 0x55ef96823c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f729000a5c0 tx=0x7f729001b340 comp rx=0 tx=0).stop 2024-09-10T06:22:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1651460100 shutdown_connections 2024-09-10T06:22:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1651460100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef96821880 0x55ef96823c70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1651460100 >> 172.21.15.117:0/1651460100 conn(0x55ef96817e90 msgr2=0x55ef9681a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1651460100 shutdown_connections 2024-09-10T06:22:59.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.629+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1651460100 wait complete. 2024-09-10T06:22:59.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ef96725680 con 0x55ef967917b0 2024-09-10T06:22:59.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52906/0 (socket says 172.21.15.117:52906) 2024-09-10T06:22:59.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f72990b5640 1 -- 172.21.15.117:0/423347357 learned_addr learned my addr 172.21.15.117:0/423347357 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f72990b5640 1 -- 172.21.15.117:0/423347357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef966a0da0 con 0x55ef967917b0 2024-09-10T06:22:59.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f72990b5640 1 --2- 172.21.15.117:0/423347357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f728c001ec0 tx=0x7f728c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355486cdab6b1b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f7187606640 1 -- 172.21.15.117:0/423347357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c00e5d0 con 0x55ef967917b0 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f7187606640 1 -- 172.21.15.117:0/423347357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c00e770 con 0x55ef967917b0 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f7187606640 1 -- 172.21.15.117:0/423347357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c00ea70 con 0x55ef967917b0 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- 172.21.15.117:0/423347357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 msgr2=0x55ef969088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/423347357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f728c001ec0 tx=0x7f728c00b6d0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- 172.21.15.117:0/423347357 shutdown_connections 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/423347357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef969088d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- 172.21.15.117:0/423347357 >> 172.21.15.117:0/423347357 conn(0x55ef96817e90 msgr2=0x55ef96904570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- 172.21.15.117:0/423347357 shutdown_connections 2024-09-10T06:22:59.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.645+0000 7f729b5af9c0 1 -- 172.21.15.117:0/423347357 wait complete. 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef9690ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ef966c7a50 con 0x55ef967917b0 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef9690ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef9690ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52914/0 (socket says 172.21.15.117:52914) 2024-09-10T06:22:59.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72990b5640 1 -- 172.21.15.117:0/3286396309 learned_addr learned my addr 172.21.15.117:0/3286396309 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72990b5640 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef969104d0 con 0x55ef967917b0 2024-09-10T06:22:59.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72990b5640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef9690ff70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55ef969098c0 tx=0x7f728c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 -- 172.21.15.117:0/3286396309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c00f8e0 con 0x55ef967917b0 2024-09-10T06:22:59.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef96910760 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 -- 172.21.15.117:0/3286396309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c00fa80 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 -- 172.21.15.117:0/3286396309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c00fda0 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef96911110 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 -- 172.21.15.117:0/3286396309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f728c017070 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7180039a70 0x7f718003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f7185e03640 1 -- 172.21.15.117:0/3286396309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f728c015020 con 0x55ef967917b0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72988b4640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7180039a70 0x7f718003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef96821880 0x55ef969170e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96917620 con 0x55ef96821880 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72998b6640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef96821880 0x55ef969170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72988b4640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7180039a70 0x7f718003bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72900ae000 tx=0x7f72900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.649+0000 7f72998b6640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef96821880 0x55ef969170e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72998b6640 1 -- 172.21.15.117:0/3286396309 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef96821880 2024-09-10T06:22:59.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96911470 con 0x55ef96821880 2024-09-10T06:22:59.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72998b6640 1 -- 172.21.15.117:0/3286396309 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef96821880 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef96919910 0x55ef9691bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9691c440 con 0x55ef96919910 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef96919910 0x55ef9691bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef96919910 0x55ef9691bd00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 -- 172.21.15.117:0/3286396309 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f728c02e070 con 0x55ef96919910 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969187b0 con 0x55ef96821880 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72998b6640 1 -- 172.21.15.117:0/3286396309 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef96821880 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef9691d880 0x55ef9691fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96920300 con 0x55ef9691d880 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72988b4640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef9691d880 0x55ef9691fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72988b4640 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef9691d880 0x55ef9691fc70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72988b4640 1 -- 172.21.15.117:0/3286396309 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72900b4040 con 0x55ef9691d880 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f729b5af9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ef96732450 con 0x55ef9692dd90 2024-09-10T06:22:59.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52924/0 (socket says 172.21.15.117:52924) 2024-09-10T06:22:59.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 -- 172.21.15.117:0/1359949265 learned_addr learned my addr 172.21.15.117:0/1359949265 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.653+0000 7f72990b5640 1 -- 172.21.15.117:0/1359949265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef9692e7f0 con 0x55ef9692dd90 2024-09-10T06:22:59.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f728c017aa0 tx=0x7f728c019e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 -- 172.21.15.117:0/1359949265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c0193e0 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 -- 172.21.15.117:0/1359949265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c035070 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 -- 172.21.15.117:0/1359949265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c0196f0 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef9692f050 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef9692f050 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 -- 172.21.15.117:0/1359949265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f728c01a480 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 0x7f717003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717effd640 1 -- 172.21.15.117:0/1359949265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f728c03bb10 con 0x55ef9692dd90 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72988b4640 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 0x7f717003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72988b4640 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 0x7f717003bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ef96911810 tx=0x7f7290005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f729b5af9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ef96909120 con 0x55ef9693a2a0 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52932/0 (socket says 172.21.15.117:52932) 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 -- 172.21.15.117:0/510167135 learned_addr learned my addr 172.21.15.117:0/510167135 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 -- 172.21.15.117:0/510167135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef9693ac70 con 0x55ef9693a2a0 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f72990b5640 1 --2- 172.21.15.117:0/510167135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f728c027d90 tx=0x7f728c03be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa09f3f43ed9ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717cff9640 1 -- 172.21.15.117:0/510167135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c03f040 con 0x55ef9693a2a0 2024-09-10T06:22:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717cff9640 1 -- 172.21.15.117:0/510167135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c057070 con 0x55ef9693a2a0 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.657+0000 7f717cff9640 1 -- 172.21.15.117:0/510167135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c0482a0 con 0x55ef9693a2a0 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/510167135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 msgr2=0x55ef9693a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/510167135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f728c027d90 tx=0x7f728c03be70 comp rx=0 tx=0).stop 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/510167135 shutdown_connections 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/510167135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef9693a680 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/510167135 >> 172.21.15.117:0/510167135 conn(0x55ef969366d0 msgr2=0x55ef96934910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/510167135 shutdown_connections 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/510167135 wait complete. 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 Processor -- start 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- start start 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ef9693b130 con 0x55ef9693a2a0 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72990b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52936/0 (socket says 172.21.15.117:52936) 2024-09-10T06:22:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 learned_addr learned my addr 172.21.15.117:0/584097462 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:22:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef96941be0 con 0x55ef9693a2a0 2024-09-10T06:22:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72990b5640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f728c048fb0 tx=0x7f728c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 -- 172.21.15.117:0/584097462 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c03f040 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef96941be0 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 -- 172.21.15.117:0/584097462 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c01a770 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 -- 172.21.15.117:0/584097462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c04d0e0 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef969421b0 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 -- 172.21.15.117:0/584097462 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f728c02ca10 con 0x55ef9693a2a0 2024-09-10T06:22:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7164039a70 0x7f716403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f716effd640 1 -- 172.21.15.117:0/584097462 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5706+0+0 (secure 0 0 0) 0x7f728c056180 con 0x55ef9693a2a0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72988b4640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7164039a70 0x7f716403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef9694c7e0 0x55ef9694ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9694f3c0 con 0x55ef9694c7e0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.661+0000 7f72998b6640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef9694c7e0 0x55ef9694ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72988b4640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7164039a70 0x7f716403bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7290000c10 tx=0x7f72900a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef9694c7e0 0x55ef9694ec70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 realm 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9694f7d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969500a0 con 0x55ef9694c7e0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef969511a0 0x55ef96953590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96953ba0 con 0x55ef969511a0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef969511a0 0x55ef96953590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef969511a0 0x55ef96953590 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 20 searching for the correct realm 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef96955a80 0x55ef96957eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96958530 con 0x55ef96955a80 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72988b4640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef96955a80 0x55ef96957eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72988b4640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef96955a80 0x55ef96957eb0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96958530 con 0x55ef969511a0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f728c05c030 0x7f728c068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:22:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96958530 con 0x7f728c05c030 2024-09-10T06:22:59.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.665+0000 7f72998b6640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f728c05c030 0x7f728c068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:22:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f728c05c030 0x7f728c068a80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:22:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef969511a0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.669+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef969511a0 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef969511a0 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.673+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef969511a0 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef96955a80 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x7f728c05c030 2024-09-10T06:22:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef9694c7e0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ef96950440 con 0x55ef969511a0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969543f0 con 0x55ef9694c7e0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969547e0 con 0x55ef9694c7e0 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.677+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969547e0 con 0x55ef96955a80 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 zone default found 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 4 Realm: () 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 zonegroup default 2024-09-10T06:22:59.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969589b0 con 0x7f728c05c030 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695a4a0 con 0x55ef96955a80 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695a8d0 con 0x55ef96955a80 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 started sync module instance, tier type = 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96959840 con 0x55ef969511a0 2024-09-10T06:22:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94487511931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef969594a0 con 0x55ef969511a0 2024-09-10T06:22:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.681+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695b830 con 0x55ef9694c7e0 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94487511931952] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94487511937920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695b7a0 con 0x55ef9694c7e0 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695c5e0 con 0x55ef96955a80 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94487511941328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695ceb0 con 0x55ef96955a80 2024-09-10T06:22:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695d8b0 con 0x55ef969511a0 2024-09-10T06:22:59.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.685+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94487511937920] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94487511940128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695dcd0 con 0x55ef969511a0 2024-09-10T06:22:59.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695e690 con 0x55ef9694c7e0 2024-09-10T06:22:59.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94487511941328] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94487511940128] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94487511946176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695e1e0 con 0x55ef9694c7e0 2024-09-10T06:22:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695ea30 con 0x7f728c05c030 2024-09-10T06:22:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.689+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94487511946176] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94487511949792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695cb10 con 0x7f728c05c030 2024-09-10T06:22:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695f330 con 0x7f728c05c030 2024-09-10T06:22:59.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94487511952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695f7a0 con 0x7f728c05c030 2024-09-10T06:22:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96960260 con 0x7f728c05c030 2024-09-10T06:22:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94487511949792] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.693+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94487511956880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96960260 con 0x7f728c05c030 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=0 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=1 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=2 2024-09-10T06:22:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=3 2024-09-10T06:22:59.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=4 2024-09-10T06:22:59.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=5 2024-09-10T06:22:59.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94487511952848] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=6 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94487511956880] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 add_watcher() i=7 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695f2f0 con 0x55ef9694c7e0 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94487511954160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef969606a0 con 0x55ef9694c7e0 2024-09-10T06:22:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94487511954160] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f714f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f729b5af9c0 5 note: GC not initialized 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.697+0000 7f714e7e4640 20 reqs_thread_entry: start 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 Filter name: none 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f70bffff640 20 reqs_thread_entry: start 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef969867c0 con 0x55ef9694c7e0 2024-09-10T06:22:59.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:22:59.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96989250 con 0x55ef969511a0 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 enabling bucket name=myfoo 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96987230 con 0x55ef969511a0 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 : miss 2024-09-10T06:22:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados->read ofs=0 len=0 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef96989b40 con 0x55ef9694c7e0 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 2024-09-10T06:22:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.701+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.3 8:c663bdb9:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96991980 con 0x55ef9694c7e0 2024-09-10T06:22:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(66 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v30'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1, ofs0, ns] 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94487512130048 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9698f260 con 0x7f728c05c030 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== watch-notify(notify (1) cookie 94487511949792 notify 128849018896 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55ef96989f30 con 0x7f728c05c030 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f717cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94487511949792 notifier 4596 bl.length()=760 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f717cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 info.flags=0x17 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f717cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.1 to cache LRU end 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f717cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f717cff9640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f715c003eb0 con 0x7f728c05c030 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(67 notify.5 [notify cookie 94487512130048 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== watch-notify(notify_complete (2) cookie 94487512130048 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef96989070 con 0x7f728c05c030 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_sources= new_sources= 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential sources added=[] removed=[] 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): orig_dests= new_dests= 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 20 handle_bi_update(): bucket=:myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.1]): potential dests added=[] removed=[] 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96991180 con 0x55ef9694c7e0 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:22:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.705+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94487512130016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ef9698ab70 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify (1) cookie 94487511946176 notify 128849018897 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ef96989070 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f716ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94487511946176 notifier 4596 bl.length()=567 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f716ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f716ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f716ffff640 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f70cc003440 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(70 notify.4 [notify cookie 94487512130016 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== watch-notify(notify_complete (2) cookie 94487512130016 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7294034410 con 0x55ef9694c7e0 2024-09-10T06:22:59.711 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:22:59.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f714f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:22:59.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94487511954160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96984520 con 0x55ef9694c7e0 2024-09-10T06:22:59.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94487511954160] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.709+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94487511931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96984520 con 0x55ef969511a0 2024-09-10T06:22:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94487511931952] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f729b5af9c0 20 remove_watcher() i=0 2024-09-10T06:22:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f729b5af9c0 2 removed watcher, disabling cache 2024-09-10T06:22:59.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94487511937920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96984520 con 0x55ef9694c7e0 2024-09-10T06:22:59.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94487511937920] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f729b5af9c0 20 remove_watcher() i=1 2024-09-10T06:22:59.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.713+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94487511941328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef96984520 con 0x55ef96955a80 2024-09-10T06:22:59.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f72988b4640 1 -- 172.21.15.117:0/584097462 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94487511941328] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72900d9070 con 0x55ef96955a80 2024-09-10T06:22:59.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 20 remove_watcher() i=2 2024-09-10T06:22:59.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94487511940128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695b380 con 0x55ef969511a0 2024-09-10T06:22:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f72990b5640 1 -- 172.21.15.117:0/584097462 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94487511940128] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c02e070 con 0x55ef969511a0 2024-09-10T06:22:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 20 remove_watcher() i=3 2024-09-10T06:22:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94487511946176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695bc20 con 0x55ef9694c7e0 2024-09-10T06:22:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94487511946176] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x55ef9694c7e0 2024-09-10T06:22:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 20 remove_watcher() i=4 2024-09-10T06:22:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.717+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94487511949792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695b380 con 0x7f728c05c030 2024-09-10T06:22:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94487511949792] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f729b5af9c0 20 remove_watcher() i=5 2024-09-10T06:22:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94487511952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695d3c0 con 0x7f728c05c030 2024-09-10T06:22:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94487511952848] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f729b5af9c0 20 remove_watcher() i=6 2024-09-10T06:22:59.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.721+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94487511956880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ef9695e1e0 con 0x7f728c05c030 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94487511956880] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729400a4d0 con 0x7f728c05c030 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 20 remove_watcher() i=7 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f728c05c030 msgr2=0x7f728c068a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f728c05c030 0x7f728c068a80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef9694c7e0 msgr2=0x55ef9694ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef9694c7e0 0x55ef9694ec70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef969511a0 msgr2=0x55ef96953590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef969511a0 0x55ef96953590 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef96955a80 msgr2=0x55ef96957eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef96955a80 0x55ef96957eb0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7164039a70 msgr2=0x7f716403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7164039a70 0x7f716403bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7290000c10 tx=0x7f72900a8000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 msgr2=0x55ef96941680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f72998b6640 1 -- 172.21.15.117:0/584097462 reap_dead start 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f728c048fb0 tx=0x7f728c010e90 comp rx=0 tx=0).stop 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 shutdown_connections 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/584097462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9693a2a0 0x55ef96941680 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 >> 172.21.15.117:0/584097462 conn(0x55ef969366d0 msgr2=0x55ef969348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 shutdown_connections 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/584097462 wait complete. 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 msgr2=0x7f717003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 0x7f717003bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ef96911810 tx=0x7f7290005ad0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 msgr2=0x55ef9692e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f728c017aa0 tx=0x7f728c019e60 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 shutdown_connections 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7170039a70 0x7f717003bf30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/1359949265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef9692dd90 0x55ef9692e1b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 >> 172.21.15.117:0/1359949265 conn(0x55ef96923740 msgr2=0x55ef96923b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 shutdown_connections 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/1359949265 wait complete. 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef96821880 msgr2=0x55ef969170e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55ef96821880 0x55ef969170e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef96919910 msgr2=0x55ef9691bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55ef96919910 0x55ef9691bd00 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef9691d880 msgr2=0x55ef9691fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55ef9691d880 0x55ef9691fc70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7180039a70 msgr2=0x7f718003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7180039a70 0x7f718003bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72900ae000 tx=0x7f72900a6000 comp rx=0 tx=0).stop 2024-09-10T06:22:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 msgr2=0x55ef9690ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 --2- 172.21.15.117:0/3286396309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ef967917b0 0x55ef9690ff70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55ef969098c0 tx=0x7f728c000bd0 comp rx=0 tx=0).stop 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f72998b6640 1 -- 172.21.15.117:0/3286396309 reap_dead start 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 shutdown_connections 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 >> 172.21.15.117:0/3286396309 conn(0x55ef96817e90 msgr2=0x55ef96903000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 shutdown_connections 2024-09-10T06:22:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:22:59.725+0000 7f729b5af9c0 1 -- 172.21.15.117:0/3286396309 wait complete. 2024-09-10T06:22:59.738 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:22:59.746 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T06:23:00.059 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-10T06:23:00.072 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:15.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T06:23:15.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T06:23:15.075 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T06:23:15.115 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:15.115 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:15.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77bcc9b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fe2fcbe8c0 0x55fe2fcc0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77bcc9b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe2fb6c9c0 con 0x55fe2fcba770 2024-09-10T06:23:15.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77bcc9b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55fe2fbbc6d0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77b9fa0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fe2fcbe8c0 0x55fe2fcc0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77ba7a1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55fe2fcba770 0x55fe2fcbab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55852/0 (socket says 172.21.15.117:55852) 2024-09-10T06:23:15.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1327705802 learned_addr learned my addr 172.21.15.117:0/1327705802 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:15.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77b9fa0640 1 -- 172.21.15.117:0/1327705802 >> v1:172.21.15.84:6789/0 conn(0x55fe2fcba770 legacy=0x55fe2fcbab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.113+0000 7f77b9fa0640 1 -- 172.21.15.117:0/1327705802 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fb60ca0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1327705802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcbe8c0 0x55fe2fcc0cb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a480 tx=0x7f77b001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c2b1464901c0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77b979f640 1 -- 172.21.15.117:0/1327705802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b00aa570 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77b979f640 1 -- 172.21.15.117:0/1327705802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b00af070 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77b979f640 1 -- 172.21.15.117:0/1327705802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b00aa860 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1327705802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcbe8c0 msgr2=0x55fe2fcc0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1327705802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcbe8c0 0x55fe2fcc0cb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a480 tx=0x7f77b001b310 comp rx=0 tx=0).stop 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1327705802 shutdown_connections 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1327705802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcbe8c0 0x55fe2fcc0cb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1327705802 >> 172.21.15.117:0/1327705802 conn(0x55fe2fc2e080 msgr2=0x55fe2fc2e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1327705802 shutdown_connections 2024-09-10T06:23:15.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.117+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1327705802 wait complete. 2024-09-10T06:23:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.133+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.133+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.133+0000 7f77bcc9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.133+0000 7f77bcc9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fe2fbc0680 con 0x55fe2fcba770 2024-09-10T06:23:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43316/0 (socket says 172.21.15.117:43316) 2024-09-10T06:23:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1598526216 learned_addr learned my addr 172.21.15.117:0/1598526216 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1598526216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fb3bda0 con 0x55fe2fcba770 2024-09-10T06:23:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/1598526216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f77b4001810 tx=0x7f77b4001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139959dba34fa1b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f76a8608640 1 -- 172.21.15.117:0/1598526216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4004530 con 0x55fe2fcba770 2024-09-10T06:23:15.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f76a8608640 1 -- 172.21.15.117:0/1598526216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40046d0 con 0x55fe2fcba770 2024-09-10T06:23:15.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f76a8608640 1 -- 172.21.15.117:0/1598526216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b40049f0 con 0x55fe2fcba770 2024-09-10T06:23:15.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1598526216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 msgr2=0x55fe2fda59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1598526216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f77b4001810 tx=0x7f77b4001cd0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1598526216 shutdown_connections 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1598526216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fda59b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1598526216 >> 172.21.15.117:0/1598526216 conn(0x55fe2fc2e080 msgr2=0x55fe2fda1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1598526216 shutdown_connections 2024-09-10T06:23:15.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1598526216 wait complete. 2024-09-10T06:23:15.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fdad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77bcc9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fe2fb62a50 con 0x55fe2fcba770 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fdad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fdad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43330/0 (socket says 172.21.15.117:43330) 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1931474212 learned_addr learned my addr 172.21.15.117:0/1931474212 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fdad5b0 con 0x55fe2fcba770 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.137+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fdad050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f90 tx=0x7f77b4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 -- 172.21.15.117:0/1931474212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4013820 con 0x55fe2fcba770 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe2fdad840 con 0x55fe2fcba770 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 -- 172.21.15.117:0/1931474212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40139c0 con 0x55fe2fcba770 2024-09-10T06:23:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 -- 172.21.15.117:0/1931474212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4013ce0 con 0x55fe2fcba770 2024-09-10T06:23:15.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2fdae1f0 con 0x55fe2fcba770 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 -- 172.21.15.117:0/1931474212 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77b4010070 con 0x55fe2fcba770 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76a0039a70 0x7f76a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f76a6e05640 1 -- 172.21.15.117:0/1931474212 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f77b4018070 con 0x55fe2fcba770 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76a0039a70 0x7f76a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fcbe8c0 0x55fe2fdb41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdb4700 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bafa2640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fcbe8c0 0x55fe2fdb41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76a0039a70 0x7f76a003bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ae000 tx=0x7f77b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bafa2640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fcbe8c0 0x55fe2fdb41c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bafa2640 1 -- 172.21.15.117:0/1931474212 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdb4b30 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bafa2640 1 -- 172.21.15.117:0/1931474212 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdb6940 0x55fe2fdb8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdb9400 con 0x55fe2fdb6940 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdb6940 0x55fe2fdb8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.141+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdb6940 0x55fe2fdb8d30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1931474212 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77b401b030 con 0x55fe2fdb6940 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdb57e0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bafa2640 1 -- 172.21.15.117:0/1931474212 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fcbe8c0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdba840 0x55fe2fdbcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdbd3c0 con 0x55fe2fdba840 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdba840 0x55fe2fdbcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdba840 0x55fe2fdbcc30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77b9fa0640 1 -- 172.21.15.117:0/1931474212 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdba840 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fe2fbcd450 con 0x55fe2fdcae80 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43344/0 (socket says 172.21.15.117:43344) 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1103919537 learned_addr learned my addr 172.21.15.117:0/1103919537 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 -- 172.21.15.117:0/1103919537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fdcb8e0 con 0x55fe2fdcae80 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f77b404e970 tx=0x7f77b4012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f769ffff640 1 -- 172.21.15.117:0/1103919537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4047070 con 0x55fe2fdcae80 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe2fdcc140 con 0x55fe2fdcae80 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f769ffff640 1 -- 172.21.15.117:0/1103919537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b4050290 con 0x55fe2fdcae80 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f769ffff640 1 -- 172.21.15.117:0/1103919537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4011c80 con 0x55fe2fdcae80 2024-09-10T06:23:15.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.145+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2fdcc6b0 con 0x55fe2fdcae80 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769ffff640 1 -- 172.21.15.117:0/1103919537 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77b404a070 con 0x55fe2fdcae80 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769ffff640 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 0x7f769403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769ffff640 1 -- 172.21.15.117:0/1103919537 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f77b4051df0 con 0x55fe2fdcae80 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 0x7f769403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77bcc9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77bcc9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fe2fda6200 con 0x55fe2fdd7560 2024-09-10T06:23:15.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 0x7f769403bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a480 tx=0x7f77b0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43358/0 (socket says 172.21.15.117:43358) 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77ba7a1640 1 -- 172.21.15.117:0/835316888 learned_addr learned my addr 172.21.15.117:0/835316888 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77ba7a1640 1 -- 172.21.15.117:0/835316888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fdd7f10 con 0x55fe2fdd7560 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/835316888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f77b4029cf0 tx=0x7f77b4035e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb87e29abe5bd4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769dffb640 1 -- 172.21.15.117:0/835316888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4019c10 con 0x55fe2fdd7560 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769dffb640 1 -- 172.21.15.117:0/835316888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40123c0 con 0x55fe2fdd7560 2024-09-10T06:23:15.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.149+0000 7f769dffb640 1 -- 172.21.15.117:0/835316888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b401d660 con 0x55fe2fdd7560 2024-09-10T06:23:15.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/835316888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 msgr2=0x55fe2fdd7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/835316888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f77b4029cf0 tx=0x7f77b4035e60 comp rx=0 tx=0).stop 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/835316888 shutdown_connections 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/835316888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdd7940 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/835316888 >> 172.21.15.117:0/835316888 conn(0x55fe2fdd3990 msgr2=0x55fe2fdd1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/835316888 shutdown_connections 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/835316888 wait complete. 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 Processor -- start 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- start start 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdde8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fe2fdd83f0 con 0x55fe2fdd7560 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdde8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77ba7a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdde8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43362/0 (socket says 172.21.15.117:43362) 2024-09-10T06:23:15.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 learned_addr learned my addr 172.21.15.117:0/3299795807 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2fddee00 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdde8a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f77b4029cf0 tx=0x7f77b4039e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f768bfff640 1 -- 172.21.15.117:0/3299795807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b401d530 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe2fddee00 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f768bfff640 1 -- 172.21.15.117:0/3299795807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b4012740 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f768bfff640 1 -- 172.21.15.117:0/3299795807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b401d6d0 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2fddee00 con 0x55fe2fdd7560 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f768bfff640 1 -- 172.21.15.117:0/3299795807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77b4033830 con 0x55fe2fdd7560 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.153+0000 7f768bfff640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7684039a20 0x7f768403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f768bfff640 1 -- 172.21.15.117:0/3299795807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f77b4062020 con 0x55fe2fdd7560 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7684039a20 0x7f768403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fde9a40 0x55fe2fdebed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdec620 con 0x55fe2fde9a40 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fde9a40 0x55fe2fdebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7684039a20 0x7f768403bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77b0018f40 tx=0x7f77b00a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fde9a40 0x55fe2fdebed0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 realm 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdeca30 con 0x55fe2fde9a40 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded300 con 0x55fe2fde9a40 2024-09-10T06:23:15.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdee1d0 0x55fe2fdf05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf0d00 con 0x55fe2fdee1d0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdee1d0 0x55fe2fdf05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdee1d0 0x55fe2fdf05c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 20 searching for the correct realm 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdf2cc0 0x55fe2fdf5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf5850 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdf2cc0 0x55fe2fdf5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdf2cc0 0x55fe2fdf5180 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf5850 con 0x55fe2fdee1d0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77b404c060 0x7f77b406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.157+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf5850 con 0x7f77b404c060 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77b404c060 0x7f77b406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77b404c060 0x7f77b406a9f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac0083f0 con 0x7f77b404c060 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac0083f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.161+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.165+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.169+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x7f77b404c060 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fde9a40 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fded6a0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf15c0 con 0x55fe2fde9a40 2024-09-10T06:23:15.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf19b0 con 0x55fe2fde9a40 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf19b0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 zone default found 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 4 Realm: () 2024-09-10T06:23:15.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 zonegroup default 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf5cd0 con 0x7f77b404c060 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf76c0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf7a60 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 started sync module instance, tier type = 2024-09-10T06:23:15.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:15.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.173+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf6b60 con 0x55fe2fdee1d0 2024-09-10T06:23:15.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94550213226368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf67c0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf8920 con 0x55fe2fde9a40 2024-09-10T06:23:15.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94550213226368] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94550213230160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf8920 con 0x55fe2fde9a40 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.177+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf92e0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94550213230160] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94550213231728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf8890 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfa090 con 0x55fe2fdee1d0 2024-09-10T06:23:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94550213237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfa930 con 0x55fe2fdee1d0 2024-09-10T06:23:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfb330 con 0x55fe2fde9a40 2024-09-10T06:23:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.181+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94550213231728] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94550213237632] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94550213236432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfa480 con 0x55fe2fde9a40 2024-09-10T06:23:15.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfbbd0 con 0x7f77b404c060 2024-09-10T06:23:15.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94550213236432] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94550213242432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfa480 con 0x7f77b404c060 2024-09-10T06:23:15.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.185+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfc0b0 con 0x7f77b404c060 2024-09-10T06:23:15.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.189+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.189+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94550213242432] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.189+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94550213245856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfc070 con 0x7f77b404c060 2024-09-10T06:23:15.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.189+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfcaf0 con 0x7f77b404c060 2024-09-10T06:23:15.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94550213245856] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94550213244288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfcaf0 con 0x7f77b404c060 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=0 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=1 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=2 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=3 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=4 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=5 2024-09-10T06:23:15.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=6 2024-09-10T06:23:15.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94550213244288] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 20 add_watcher() i=7 2024-09-10T06:23:15.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:15.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdffe50 con 0x55fe2fde9a40 2024-09-10T06:23:15.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94550213261392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdfcc60 con 0x55fe2fde9a40 2024-09-10T06:23:15.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94550213261392] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.193+0000 7f7670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:15.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bcc9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:15.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bcc9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:15.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe084b0 con 0x55fe2fde9a40 2024-09-10T06:23:15.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe08a80 con 0x7f77b404c060 2024-09-10T06:23:15.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.197+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe08ec0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe09340 con 0x55fe2fde9a40 2024-09-10T06:23:15.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe098b0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.201+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe098b0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.205+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.205+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe09e20 con 0x55fe2fde9a40 2024-09-10T06:23:15.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.205+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.205+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe09e20 con 0x7f77b404c060 2024-09-10T06:23:15.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.209+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.209+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe09e20 con 0x55fe2fdee1d0 2024-09-10T06:23:15.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.209+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.209+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe09e70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x7f77b404c060 2024-09-10T06:23:15.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.213+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.217+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.217+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x7f77b404c060 2024-09-10T06:23:15.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.217+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'36 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.217+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x55fe2fde9a40 2024-09-10T06:23:15.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0a5c0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdee1d0 2024-09-10T06:23:15.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'46 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.221+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.225+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.225+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fde9a40 2024-09-10T06:23:15.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.225+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.225+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fde9a40 2024-09-10T06:23:15.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdee1d0 2024-09-10T06:23:15.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.229+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.233+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.233+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.233+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.233+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x7f77b404c060 2024-09-10T06:23:15.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.237+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.241+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.241+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x7f77b404c060 2024-09-10T06:23:15.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.241+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.241+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.245+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.245+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x7f77b404c060 2024-09-10T06:23:15.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.245+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.245+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe0aa70 con 0x55fe2fdee1d0 2024-09-10T06:23:15.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f75eb7fe640 20 reqs_thread_entry: start 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bcc9b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bcc9b9c0 20 Filter name: none 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f75e97fa640 20 reqs_thread_entry: start 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.249+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x7f77b404c060 2024-09-10T06:23:15.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.253+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fde9a40 2024-09-10T06:23:15.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.257+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fde9a40 2024-09-10T06:23:15.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x7f77b404c060 2024-09-10T06:23:15.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.261+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x7f77b404c060 2024-09-10T06:23:15.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.265+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x55fe2fdee1d0 2024-09-10T06:23:15.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x55fe2fdee1d0 2024-09-10T06:23:15.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe255f0 con 0x7f77b404c060 2024-09-10T06:23:15.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe26600 con 0x7f77b404c060 2024-09-10T06:23:15.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(135 gc.13 [call out=1701b] v0'0 uv35 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.269+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.273+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fde9a40 2024-09-10T06:23:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.277+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.281+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.285+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.289+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x7f77b404c060 2024-09-10T06:23:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe06040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.293+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.297+0000 7f7670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.297+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94550213261392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fe061b0 con 0x55fe2fde9a40 2024-09-10T06:23:15.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.297+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94550213261392] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.297+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94550213226368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdff850 con 0x55fe2fdee1d0 2024-09-10T06:23:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94550213226368] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b407b070 con 0x55fe2fdee1d0 2024-09-10T06:23:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bcc9b9c0 20 remove_watcher() i=0 2024-09-10T06:23:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bcc9b9c0 2 removed watcher, disabling cache 2024-09-10T06:23:15.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94550213230160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdff850 con 0x55fe2fde9a40 2024-09-10T06:23:15.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94550213230160] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bcc9b9c0 20 remove_watcher() i=1 2024-09-10T06:23:15.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.301+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94550213231728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf7e50 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77b9fa0640 1 -- 172.21.15.117:0/3299795807 <== osd.3 v2:172.21.15.117:6808/266380039 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94550213231728] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b00a8070 con 0x55fe2fdf2cc0 2024-09-10T06:23:15.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77bcc9b9c0 20 remove_watcher() i=2 2024-09-10T06:23:15.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94550213237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdff850 con 0x55fe2fdee1d0 2024-09-10T06:23:15.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77ba7a1640 1 -- 172.21.15.117:0/3299795807 <== osd.2 v2:172.21.15.117:6816/4244172515 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94550213237632] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77b409a040 con 0x55fe2fdee1d0 2024-09-10T06:23:15.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77bcc9b9c0 20 remove_watcher() i=3 2024-09-10T06:23:15.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.305+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94550213236432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf8470 con 0x55fe2fde9a40 2024-09-10T06:23:15.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94550213236432] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x55fe2fde9a40 2024-09-10T06:23:15.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bcc9b9c0 20 remove_watcher() i=4 2024-09-10T06:23:15.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94550213242432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf9b80 con 0x7f77b404c060 2024-09-10T06:23:15.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94550213242432] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bcc9b9c0 20 remove_watcher() i=5 2024-09-10T06:23:15.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.309+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94550213245856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdff850 con 0x7f77b404c060 2024-09-10T06:23:15.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94550213245856] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 20 remove_watcher() i=6 2024-09-10T06:23:15.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94550213244288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe2fdf8470 con 0x7f77b404c060 2024-09-10T06:23:15.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94550213244288] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77ac026040 con 0x7f77b404c060 2024-09-10T06:23:15.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 20 remove_watcher() i=7 2024-09-10T06:23:15.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77b404c060 msgr2=0x7f77b406a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f77b404c060 0x7f77b406a9f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fde9a40 msgr2=0x55fe2fdebed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fde9a40 0x55fe2fdebed0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdee1d0 msgr2=0x55fe2fdf05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdee1d0 0x55fe2fdf05c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdf2cc0 msgr2=0x55fe2fdf5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdf2cc0 0x55fe2fdf5180 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7684039a20 msgr2=0x7f768403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7684039a20 0x7f768403bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77b0018f40 tx=0x7f77b00a8000 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 msgr2=0x55fe2fdde8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/3299795807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdd7560 0x55fe2fdde8a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f77b4029cf0 tx=0x7f77b4039e80 comp rx=0 tx=0).stop 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 reap_dead start 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bafa2640 1 -- 172.21.15.117:0/3299795807 reap_dead start 2024-09-10T06:23:15.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 shutdown_connections 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 >> 172.21.15.117:0/3299795807 conn(0x55fe2fdd3990 msgr2=0x55fe2fdd1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 shutdown_connections 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/3299795807 wait complete. 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 msgr2=0x7f769403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 0x7f769403bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a480 tx=0x7f77b0005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 msgr2=0x55fe2fdcb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f77b404e970 tx=0x7f77b4012ea0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 shutdown_connections 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7694039a70 0x7f769403bf30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1103919537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fdcae80 0x55fe2fdcb2a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 >> 172.21.15.117:0/1103919537 conn(0x55fe2fdc0830 msgr2=0x55fe2fdc0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 shutdown_connections 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.313+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1103919537 wait complete. 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fcbe8c0 msgr2=0x55fe2fdb41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fe2fcbe8c0 0x55fe2fdb41c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdb6940 msgr2=0x55fe2fdb8d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fe2fdb6940 0x55fe2fdb8d30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdba840 msgr2=0x55fe2fdbcc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fe2fdba840 0x55fe2fdbcc30 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76a0039a70 msgr2=0x7f76a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f76a0039a70 0x7f76a003bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ae000 tx=0x7f77b00a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 msgr2=0x55fe2fdad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 --2- 172.21.15.117:0/1931474212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fe2fcba770 0x55fe2fdad050 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f90 tx=0x7f77b4001260 comp rx=0 tx=0).stop 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bafa2640 1 -- 172.21.15.117:0/1931474212 reap_dead start 2024-09-10T06:23:15.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 shutdown_connections 2024-09-10T06:23:15.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 >> 172.21.15.117:0/1931474212 conn(0x55fe2fc2e080 msgr2=0x55fe2fda00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 shutdown_connections 2024-09-10T06:23:15.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.317+0000 7f77bcc9b9c0 1 -- 172.21.15.117:0/1931474212 wait complete. 2024-09-10T06:23:15.332 INFO:teuthology.orchestra.run.smithi117.stdout:[{"tag":"be621638-e902-4133-b94d-0397be1b6a7c.4227.5665829937373712149\u0000","time":"2024-09-10T06:23:15.071877+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_7","key":"","instance":""}]}] 2024-09-10T06:23:15.332 DEBUG:tasks.util.rgw: json result: [{'tag': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.5665829937373712149\x00', 'time': '2024-09-10T06:23:15.071877+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_7', 'key': '', 'instance': ''}]}] 2024-09-10T06:23:15.332 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-10T06:23:15.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-10T06:23:15.333 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-10T06:23:15.408 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:15.408 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:15.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.405+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.405+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb71b9bb9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60747f3a0 0x55e60747f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb71b9bb9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6073349c0 con 0x55e607482580 2024-09-10T06:23:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb71b9bb9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55e6073846d0 con 0x55e60747f3a0 2024-09-10T06:23:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60747f3a0 0x55e60747f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60747f3a0 0x55e60747f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43370/0 (socket says 172.21.15.117:43370) 2024-09-10T06:23:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 -- 172.21.15.117:0/457882774 learned_addr learned my addr 172.21.15.117:0/457882774 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 -- 172.21.15.117:0/457882774 >> v1:172.21.15.84:6789/0 conn(0x55e607482580 legacy=0x55e607484970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 -- 172.21.15.117:0/457882774 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e607328ca0 con 0x55e60747f3a0 2024-09-10T06:23:15.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb7194c1640 1 --2- 172.21.15.117:0/457882774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60747f780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a4e0 tx=0x7fb71401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f62883f1e39742 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb70bfff640 1 -- 172.21.15.117:0/457882774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140aa540 con 0x55e60747f3a0 2024-09-10T06:23:15.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb70bfff640 1 -- 172.21.15.117:0/457882774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140aa6e0 con 0x55e60747f3a0 2024-09-10T06:23:15.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.409+0000 7fb70bfff640 1 -- 172.21.15.117:0/457882774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140aaa40 con 0x55e60747f3a0 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/457882774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 msgr2=0x55e60747f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/457882774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60747f780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb71400a4e0 tx=0x7fb71401b090 comp rx=0 tx=0).stop 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/457882774 shutdown_connections 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/457882774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60747f780 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/457882774 >> 172.21.15.117:0/457882774 conn(0x55e60747aec0 msgr2=0x55e60747d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/457882774 shutdown_connections 2024-09-10T06:23:15.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.413+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/457882774 wait complete. 2024-09-10T06:23:15.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.425+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e607388680 con 0x55e60747f3a0 2024-09-10T06:23:15.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43374/0 (socket says 172.21.15.117:43374) 2024-09-10T06:23:15.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 -- 172.21.15.117:0/2572253711 learned_addr learned my addr 172.21.15.117:0/2572253711 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 -- 172.21.15.117:0/2572253711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e607303da0 con 0x55e60747f3a0 2024-09-10T06:23:15.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 --2- 172.21.15.117:0/2572253711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb714019740 tx=0x7fb7140033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64125950d103b1a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb607606640 1 -- 172.21.15.117:0/2572253711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140b9070 con 0x55e60747f3a0 2024-09-10T06:23:15.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb607606640 1 -- 172.21.15.117:0/2572253711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140aaa90 con 0x55e60747f3a0 2024-09-10T06:23:15.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb607606640 1 -- 172.21.15.117:0/2572253711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140aad70 con 0x55e60747f3a0 2024-09-10T06:23:15.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/2572253711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 msgr2=0x55e60756a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/2572253711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb714019740 tx=0x7fb7140033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/2572253711 shutdown_connections 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/2572253711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60747f3a0 0x55e60756a6d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/2572253711 >> 172.21.15.117:0/2572253711 conn(0x55e60747aec0 msgr2=0x55e607566370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/2572253711 shutdown_connections 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/2572253711 wait complete. 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 0x55e607572e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb71b9bb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60732aa50 con 0x55e607482580 2024-09-10T06:23:15.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 0x55e607572e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 0x55e607572e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43390/0 (socket says 172.21.15.117:43390) 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.429+0000 7fb7194c1640 1 -- 172.21.15.117:0/1146526385 learned_addr learned my addr 172.21.15.117:0/1146526385 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb7194c1640 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6075733f0 con 0x55e607482580 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb7194c1640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 0x55e607572e90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb714018cc0 tx=0x7fb714017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 -- 172.21.15.117:0/1146526385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140b9070 con 0x55e607482580 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 -- 172.21.15.117:0/1146526385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140b6a90 con 0x55e607482580 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 -- 172.21.15.117:0/1146526385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140b6d90 con 0x55e607482580 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e607573680 con 0x55e607482580 2024-09-10T06:23:15.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e607574030 con 0x55e607482580 2024-09-10T06:23:15.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 -- 172.21.15.117:0/1146526385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb7140b3040 con 0x55e607482580 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb600039a70 0x7fb60003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb605e03640 1 -- 172.21.15.117:0/1146526385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb7140c3070 con 0x55e607482580 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb718cc0640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb600039a70 0x7fb60003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e607577ff0 0x55e60757a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60757a920 con 0x55e607577ff0 2024-09-10T06:23:15.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb719cc2640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e607577ff0 0x55e60757a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.433+0000 7fb718cc0640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb600039a70 0x7fb60003bf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb710001e60 tx=0x7fb7100013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb719cc2640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e607577ff0 0x55e60757a3e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb719cc2640 1 -- 172.21.15.117:0/1146526385 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e607577ff0 2024-09-10T06:23:15.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60757ad90 con 0x55e607577ff0 2024-09-10T06:23:15.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb719cc2640 1 -- 172.21.15.117:0/1146526385 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e607577ff0 2024-09-10T06:23:15.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60757cba0 0x55e60757ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60757f660 con 0x55e60757cba0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb7194c1640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60757cba0 0x55e60757ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb7194c1640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60757cba0 0x55e60757ef90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb7194c1640 1 -- 172.21.15.117:0/1146526385 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7140c5d80 con 0x55e60757cba0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60757ba40 con 0x55e607577ff0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb719cc2640 1 -- 172.21.15.117:0/1146526385 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e607577ff0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e607580aa0 0x55e607582e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e607583600 con 0x55e607580aa0 2024-09-10T06:23:15.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb718cc0640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e607580aa0 0x55e607582e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb718cc0640 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e607580aa0 0x55e607582e90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb718cc0640 1 -- 172.21.15.117:0/1146526385 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb71000d040 con 0x55e607580aa0 2024-09-10T06:23:15.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb71b9bb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e607395450 con 0x55e607591060 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.437+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43404/0 (socket says 172.21.15.117:43404) 2024-09-10T06:23:15.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 -- 172.21.15.117:0/593168796 learned_addr learned my addr 172.21.15.117:0/593168796 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 -- 172.21.15.117:0/593168796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e607591ac0 con 0x55e607591060 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb71401b0d0 tx=0x7fb7140c6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 -- 172.21.15.117:0/593168796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140c6970 con 0x55e607591060 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 -- 172.21.15.117:0/593168796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140b3330 con 0x55e607591060 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e607592320 con 0x55e607591060 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 -- 172.21.15.117:0/593168796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140c6b10 con 0x55e607591060 2024-09-10T06:23:15.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e607592890 con 0x55e607591060 2024-09-10T06:23:15.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 -- 172.21.15.117:0/593168796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb7140ed070 con 0x55e607591060 2024-09-10T06:23:15.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 0x7fb5f403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb5feffd640 1 -- 172.21.15.117:0/593168796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb7140dac10 con 0x55e607591060 2024-09-10T06:23:15.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb718cc0640 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 0x7fb5f403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb718cc0640 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 0x7fb5f403bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55e607583a00 tx=0x7fb710006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb71b9bb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60756ae40 con 0x55e60759e790 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43412/0 (socket says 172.21.15.117:43412) 2024-09-10T06:23:15.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.441+0000 7fb7194c1640 1 -- 172.21.15.117:0/1517002413 learned_addr learned my addr 172.21.15.117:0/1517002413 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 -- 172.21.15.117:0/1517002413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60759f180 con 0x55e60759e790 2024-09-10T06:23:15.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 --2- 172.21.15.117:0/1517002413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb7140e4f90 tx=0x7fb7140d83c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9168a6da95d6ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5fcff9640 1 -- 172.21.15.117:0/1517002413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140b4730 con 0x55e60759e790 2024-09-10T06:23:15.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5fcff9640 1 -- 172.21.15.117:0/1517002413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140b43a0 con 0x55e60759e790 2024-09-10T06:23:15.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5fcff9640 1 -- 172.21.15.117:0/1517002413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140b3c30 con 0x55e60759e790 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1517002413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 msgr2=0x55e60759eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1517002413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb7140e4f90 tx=0x7fb7140d83c0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1517002413 shutdown_connections 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1517002413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60759eb90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1517002413 >> 172.21.15.117:0/1517002413 conn(0x55e607599bb0 msgr2=0x55e607597df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1517002413 shutdown_connections 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1517002413 wait complete. 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 Processor -- start 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- start start 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60759d560 con 0x55e60759e790 2024-09-10T06:23:15.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43426/0 (socket says 172.21.15.117:43426) 2024-09-10T06:23:15.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 learned_addr learned my addr 172.21.15.117:0/3198579498 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60756f720 con 0x55e60759e790 2024-09-10T06:23:15.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb7194c1640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb7140b66a0 tx=0x7fb7140cce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5eaffd640 1 -- 172.21.15.117:0/3198579498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140fd040 con 0x55e60759e790 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5eaffd640 1 -- 172.21.15.117:0/3198579498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140b3c30 con 0x55e60759e790 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e60756f720 con 0x55e60759e790 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.445+0000 7fb5eaffd640 1 -- 172.21.15.117:0/3198579498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140d8780 con 0x55e60759e790 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e60756dce0 con 0x55e60759e790 2024-09-10T06:23:15.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb5eaffd640 1 -- 172.21.15.117:0/3198579498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb71410a020 con 0x55e60759e790 2024-09-10T06:23:15.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb5eaffd640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5e4039ac0 0x7fb5e403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb5eaffd640 1 -- 172.21.15.117:0/3198579498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb714108020 con 0x55e60759e790 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb718cc0640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5e4039ac0 0x7fb5e403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e6075b1e90 0x55e6075b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b4a70 con 0x55e6075b1e90 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e6075b1e90 0x55e6075b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb718cc0640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5e4039ac0 0x7fb5e403bf80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7100207d0 tx=0x7fb710011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e6075b1e90 0x55e6075b4320 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e6075b1e90 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 realm 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b4e80 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5750 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e6075b1e90 2024-09-10T06:23:15.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.449+0000 7fb71b9bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e6075b6850 0x55e6075b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b9290 con 0x55e6075b6850 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e6075b6850 0x55e6075b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e6075b6850 0x55e6075b8c40 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 20 searching for the correct realm 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e6075bb170 0x55e6075bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bdc20 con 0x55e6075bb170 2024-09-10T06:23:15.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb718cc0640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e6075bb170 0x55e6075bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb718cc0640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e6075bb170 0x55e6075bd5a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bdc20 con 0x55e6075b6850 2024-09-10T06:23:15.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb7140f8030 0x7fb7141038a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bdc20 con 0x7fb7140f8030 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb719cc2640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb7140f8030 0x7fb7141038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb719cc2640 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb7140f8030 0x7fb7141038a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c0083f0 con 0x7fb7140f8030 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.453+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c0083f0 con 0x55e6075b1e90 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b6850 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b6850 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.457+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b6850 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.461+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b6850 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075bb170 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x7fb7140f8030 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b1e90 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b5af0 con 0x55e6075b6850 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:15.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b9ae0 con 0x55e6075b1e90 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b9ed0 con 0x55e6075b1e90 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075b9ed0 con 0x55e6075bb170 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 zone default found 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 4 Realm: () 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 zonegroup default 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.465+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075be0a0 con 0x7fb7140f8030 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bfb90 con 0x55e6075bb170 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c00a0 con 0x55e6075bb170 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 started sync module instance, tier type = 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:15.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075ba420 con 0x55e6075b6850 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446454304768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c0500 con 0x55e6075b6850 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c1020 con 0x55e6075b1e90 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.469+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446454304768] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446454311664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c1410 con 0x55e6075b1e90 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c1dd0 con 0x55e6075bb170 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446454311664] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446454315296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c21c0 con 0x55e6075bb170 2024-09-10T06:23:15.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.473+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c2b80 con 0x55e6075b6850 2024-09-10T06:23:15.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446454318800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c2af0 con 0x55e6075b6850 2024-09-10T06:23:15.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c3a40 con 0x55e6075b1e90 2024-09-10T06:23:15.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446454315296] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446454318800] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446454321008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c3590 con 0x55e6075b1e90 2024-09-10T06:23:15.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.477+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c42e0 con 0x7fb7140f8030 2024-09-10T06:23:15.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446454321008] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446454306016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c3fd0 con 0x7fb7140f8030 2024-09-10T06:23:15.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c4820 con 0x7fb7140f8030 2024-09-10T06:23:15.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446454306016] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446454324480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c4630 con 0x7fb7140f8030 2024-09-10T06:23:15.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.481+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c50f0 con 0x7fb7140f8030 2024-09-10T06:23:15.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446454324480] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446454328256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c50b0 con 0x7fb7140f8030 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=0 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=1 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=2 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=3 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=4 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=5 2024-09-10T06:23:15.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=6 2024-09-10T06:23:15.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446454328256] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 20 add_watcher() i=7 2024-09-10T06:23:15.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.485+0000 7fb71b9bb9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:15.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c8510 con 0x55e6075b1e90 2024-09-10T06:23:15.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446454325536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c5a60 con 0x55e6075b1e90 2024-09-10T06:23:15.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446454325536] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb5cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:15.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:15.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:15.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d0e90 con 0x55e6075b1e90 2024-09-10T06:23:15.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.489+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d14a0 con 0x7fb7140f8030 2024-09-10T06:23:15.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.493+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.493+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d1a10 con 0x55e6075bb170 2024-09-10T06:23:15.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.493+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.493+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d1ec0 con 0x55e6075b1e90 2024-09-10T06:23:15.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c7860 con 0x55e6075b6850 2024-09-10T06:23:15.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c7800 con 0x55e6075bb170 2024-09-10T06:23:15.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.497+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d2a20 con 0x55e6075b1e90 2024-09-10T06:23:15.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.501+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.501+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d2a20 con 0x7fb7140f8030 2024-09-10T06:23:15.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.501+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.501+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c7800 con 0x55e6075b6850 2024-09-10T06:23:15.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.505+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.505+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c7800 con 0x55e6075bb170 2024-09-10T06:23:15.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.505+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.505+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d2f50 con 0x55e6075b6850 2024-09-10T06:23:15.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.509+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.509+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d2f50 con 0x7fb7140f8030 2024-09-10T06:23:15.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.509+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.509+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d2f50 con 0x55e6075b6850 2024-09-10T06:23:15.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3120 con 0x7fb7140f8030 2024-09-10T06:23:15.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3120 con 0x55e6075b1e90 2024-09-10T06:23:15.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.513+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3120 con 0x55e6075bb170 2024-09-10T06:23:15.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.517+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.517+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3120 con 0x55e6075b6850 2024-09-10T06:23:15.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.517+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'49 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.517+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3120 con 0x55e6075bb170 2024-09-10T06:23:15.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.521+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.521+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3400 con 0x55e6075b1e90 2024-09-10T06:23:15.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.521+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.521+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3400 con 0x55e6075b1e90 2024-09-10T06:23:15.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.525+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.525+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3400 con 0x55e6075bb170 2024-09-10T06:23:15.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.525+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.525+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3400 con 0x55e6075b6850 2024-09-10T06:23:15.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3230 con 0x55e6075bb170 2024-09-10T06:23:15.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3230 con 0x55e6075bb170 2024-09-10T06:23:15.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.529+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3230 con 0x55e6075bb170 2024-09-10T06:23:15.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.533+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.533+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3230 con 0x55e6075bb170 2024-09-10T06:23:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.533+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.533+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x7fb7140f8030 2024-09-10T06:23:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.537+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.537+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x55e6075bb170 2024-09-10T06:23:15.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.537+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.537+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x7fb7140f8030 2024-09-10T06:23:15.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.541+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.541+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x55e6075bb170 2024-09-10T06:23:15.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.541+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.541+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x7fb7140f8030 2024-09-10T06:23:15.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.545+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.545+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075d3250 con 0x55e6075b6850 2024-09-10T06:23:15.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.545+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb5cefe5640 20 reqs_thread_entry: start 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb71b9bb9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb71b9bb9c0 20 Filter name: none 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb5ccfe1640 20 reqs_thread_entry: start 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-10T06:23:15.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075cf0a0 con 0x7fb7140f8030 2024-09-10T06:23:15.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(94 gc.13 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.549+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075cf060 con 0x7fb7140f8030 2024-09-10T06:23:15.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(95 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:96 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075ce030 con 0x7fb7140f8030 2024-09-10T06:23:15.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(96 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075ce030 con 0x7fb7140f8030 2024-09-10T06:23:15.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(97 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075ce030 con 0x7fb7140f8030 2024-09-10T06:23:15.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(98 gc.13 [call out=1701b] v0'0 uv40 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T06:23:15.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process iterating over entry tag='be621638-e902-4133-b94d-0397be1b6a7c.4227.5665829937373712149', time=2024-09-10T06:23:15.071877+0000, chain.objs.size()=7 2024-09-10T06:23:15.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_1 2024-09-10T06:23:15.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 3.23 3:c67456d4:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075efe40 con 0x7fb7140f8030 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_2 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 3.d 3:b2e44c52:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f2ab0 con 0x55e6075bb170 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_3 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:101 3.28 3:15642bf2:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f53e0 con 0x55e6075bb170 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_4 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:102 3.12 3:492dcb26:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f7c50 con 0x55e6075b6850 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_5 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:103 3.15 3:aa5f0750:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075fa4c0 con 0x55e6075b6850 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_6 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:104 3.32 3:4f9aae92:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075fcdd0 con 0x55e6075bb170 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_7 2024-09-10T06:23:15.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.553+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:105 3.29 3:95bbca7a:::be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075fa4c0 con 0x7fb7140f8030 2024-09-10T06:23:15.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.557+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(104 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.557+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(105 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(99 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(103 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(102 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_4 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(100 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(101 be621638-e902-4133-b94d-0397be1b6a7c.4227.1__shadow_.sSIo60LRu0pM-x4t-2lCph9xRKfkPtA_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb71b9bb9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T06:23:15.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:106 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075fcdd0 con 0x7fb7140f8030 2024-09-10T06:23:15.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(106 gc.13 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.561+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(107 gc.13 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-10T06:23:15.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(108 gc.14 [call] v32'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:109 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(109 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:110 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075eede0 con 0x55e6075b1e90 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(110 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:111 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(111 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.565+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:112 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(112 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:113 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(113 gc.14 [call] v32'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-10T06:23:15.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:114 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(114 gc.15 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:115 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.569+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(115 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:116 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075eede0 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(116 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:117 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(117 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:118 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(118 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:119 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(119 gc.15 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-10T06:23:15.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.573+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:120 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(120 gc.16 [call] v32'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:121 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(121 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:122 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075eede0 con 0x55e6075b6850 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(122 gc.16 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:123 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(123 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:124 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(124 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:125 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.577+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(125 gc.16 [call] v32'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-10T06:23:15.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:126 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(126 gc.17 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:127 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(127 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:128 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075eede0 con 0x55e6075bb170 2024-09-10T06:23:15.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(128 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:129 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(129 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:130 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(130 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.581+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:131 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(131 gc.17 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-10T06:23:15.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:132 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(132 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:133 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(133 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:134 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075eede0 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(134 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:135 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(135 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:136 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(136 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.585+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:137 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(137 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-10T06:23:15.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:138 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(138 gc.19 [call] v32'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:139 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(139 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:140 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(140 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:141 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(141 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.589+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:142 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(142 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:143 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(143 gc.19 [call] v32'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-10T06:23:15.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:144 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(144 gc.20 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:145 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.593+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(145 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:146 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 44 ==== osd_op_reply(146 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:147 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 45 ==== osd_op_reply(147 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:148 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 46 ==== osd_op_reply(148 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:149 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 47 ==== osd_op_reply(149 gc.20 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-10T06:23:15.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.597+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:150 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(150 gc.21 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:151 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(151 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:152 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(152 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:153 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(153 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:154 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(154 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:155 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(155 gc.21 [call] v32'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-10T06:23:15.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.601+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:156 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 48 ==== osd_op_reply(156 gc.22 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:157 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 49 ==== osd_op_reply(157 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:158 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 50 ==== osd_op_reply(158 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:159 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 51 ==== osd_op_reply(159 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 52 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.605+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 53 ==== osd_op_reply(161 gc.22 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-10T06:23:15.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:162 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 54 ==== osd_op_reply(162 gc.23 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 55 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 56 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 57 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:166 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 58 ==== osd_op_reply(166 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.609+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:167 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 59 ==== osd_op_reply(167 gc.23 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-10T06:23:15.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 60 ==== osd_op_reply(168 gc.24 [call] v32'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:169 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 61 ==== osd_op_reply(169 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:170 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 62 ==== osd_op_reply(170 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:171 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 63 ==== osd_op_reply(171 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:172 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 64 ==== osd_op_reply(172 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.613+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:173 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 65 ==== osd_op_reply(173 gc.24 [call] v32'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-10T06:23:15.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:174 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 66 ==== osd_op_reply(174 gc.25 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:175 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 67 ==== osd_op_reply(175 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:176 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 68 ==== osd_op_reply(176 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:177 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 69 ==== osd_op_reply(177 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:178 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 70 ==== osd_op_reply(178 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.617+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:179 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 71 ==== osd_op_reply(179 gc.25 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-10T06:23:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:180 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(180 gc.26 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:181 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(181 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.621+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:182 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(182 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:183 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(183 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:184 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(184 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.625+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:185 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(185 gc.26 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-10T06:23:15.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:186 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 72 ==== osd_op_reply(186 gc.27 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:187 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 73 ==== osd_op_reply(187 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:188 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 74 ==== osd_op_reply(188 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:189 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 75 ==== osd_op_reply(189 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:190 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 76 ==== osd_op_reply(190 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.629+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:191 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.633+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 77 ==== osd_op_reply(191 gc.27 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.633+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-10T06:23:15.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.633+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:192 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.633+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(192 gc.28 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.633+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:193 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(193 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:194 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(194 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:195 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(195 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:196 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(196 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.637+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:197 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.641+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(197 gc.28 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.641+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-10T06:23:15.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.641+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:198 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.641+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 78 ==== osd_op_reply(198 gc.29 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.641+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:199 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 79 ==== osd_op_reply(199 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:200 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 80 ==== osd_op_reply(200 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:201 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 81 ==== osd_op_reply(201 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:202 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 82 ==== osd_op_reply(202 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:203 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 83 ==== osd_op_reply(203 gc.29 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-10T06:23:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.645+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:204 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(204 gc.30 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:205 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(205 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:206 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(206 gc.30 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:207 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.649+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 47 ==== osd_op_reply(207 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:208 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 48 ==== osd_op_reply(208 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:209 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 49 ==== osd_op_reply(209 gc.30 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-10T06:23:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.653+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(210 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(212 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(213 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:214 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(214 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.657+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:215 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(215 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-10T06:23:15.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(216 gc.0 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(218 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 49 ==== osd_op_reply(219 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.661+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:220 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 50 ==== osd_op_reply(220 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:221 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 51 ==== osd_op_reply(221 gc.0 [call] v32'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-10T06:23:15.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.665+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 50 ==== osd_op_reply(222 gc.1 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 51 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 52 ==== osd_op_reply(224 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 53 ==== osd_op_reply(225 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:226 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 54 ==== osd_op_reply(226 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.669+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:227 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 55 ==== osd_op_reply(227 gc.1 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-10T06:23:15.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 84 ==== osd_op_reply(228 gc.2 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 85 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 86 ==== osd_op_reply(230 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 87 ==== osd_op_reply(231 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:232 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 88 ==== osd_op_reply(232 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.673+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:233 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 89 ==== osd_op_reply(233 gc.2 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-10T06:23:15.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 52 ==== osd_op_reply(234 gc.3 [call] v32'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 53 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 54 ==== osd_op_reply(236 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 55 ==== osd_op_reply(237 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:238 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 56 ==== osd_op_reply(238 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.677+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:239 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 57 ==== osd_op_reply(239 gc.3 [call] v32'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-10T06:23:15.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(240 gc.4 [call] v32'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 41 ==== osd_op_reply(242 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 42 ==== osd_op_reply(243 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:244 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 43 ==== osd_op_reply(244 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.681+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:245 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 44 ==== osd_op_reply(245 gc.4 [call] v32'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 90 ==== osd_op_reply(246 gc.5 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 91 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 92 ==== osd_op_reply(248 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 93 ==== osd_op_reply(249 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:250 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 94 ==== osd_op_reply(250 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.685+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:251 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.689+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 95 ==== osd_op_reply(251 gc.5 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.689+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-10T06:23:15.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.689+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.689+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 58 ==== osd_op_reply(252 gc.6 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.689+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 59 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 60 ==== osd_op_reply(254 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 61 ==== osd_op_reply(255 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:256 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 62 ==== osd_op_reply(256 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:257 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 63 ==== osd_op_reply(257 gc.6 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-10T06:23:15.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.693+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.697+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 56 ==== osd_op_reply(258 gc.7 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.697+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.697+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 57 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.697+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.697+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 58 ==== osd_op_reply(260 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:261 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 59 ==== osd_op_reply(261 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:262 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 60 ==== osd_op_reply(262 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.701+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:263 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 61 ==== osd_op_reply(263 gc.7 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-10T06:23:15.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:264 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 45 ==== osd_op_reply(264 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:265 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 46 ==== osd_op_reply(265 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.705+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:266 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 47 ==== osd_op_reply(266 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:267 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 48 ==== osd_op_reply(267 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:268 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 49 ==== osd_op_reply(268 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:269 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 50 ==== osd_op_reply(269 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-10T06:23:15.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.709+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:270 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 96 ==== osd_op_reply(270 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:271 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 97 ==== osd_op_reply(271 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:272 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 98 ==== osd_op_reply(272 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.713+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:273 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 99 ==== osd_op_reply(273 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:274 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 100 ==== osd_op_reply(274 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:275 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075bb170 2024-09-10T06:23:15.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 101 ==== osd_op_reply(275 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-10T06:23:15.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.717+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:276 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 51 ==== osd_op_reply(276 gc.10 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:277 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 52 ==== osd_op_reply(277 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:278 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 53 ==== osd_op_reply(278 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:279 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 54 ==== osd_op_reply(279 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:280 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 55 ==== osd_op_reply(280 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.721+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:281 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.725+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 56 ==== osd_op_reply(281 gc.10 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.725+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-10T06:23:15.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.725+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:282 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 62 ==== osd_op_reply(282 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:283 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 63 ==== osd_op_reply(283 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:284 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 64 ==== osd_op_reply(284 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:285 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 65 ==== osd_op_reply(285 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:286 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 66 ==== osd_op_reply(286 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.729+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:287 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x7fb7140f8030 2024-09-10T06:23:15.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.733+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 67 ==== osd_op_reply(287 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.733+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-10T06:23:15.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.733+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:288 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 57 ==== osd_op_reply(288 gc.12 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:289 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 58 ==== osd_op_reply(289 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:290 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 59 ==== osd_op_reply(290 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:291 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 60 ==== osd_op_reply(291 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:23:15.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:292 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 61 ==== osd_op_reply(292 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:23:15.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.737+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:293 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b6850 2024-09-10T06:23:15.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.741+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 62 ==== osd_op_reply(293 gc.12 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.741+0000 7fb5cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:15.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.741+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446454325536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075f5780 con 0x55e6075b1e90 2024-09-10T06:23:15.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94446454325536] v32'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446454304768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c4120 con 0x55e6075b6850 2024-09-10T06:23:15.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94446454304768] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb71b9bb9c0 20 remove_watcher() i=0 2024-09-10T06:23:15.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb71b9bb9c0 2 removed watcher, disabling cache 2024-09-10T06:23:15.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.745+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446454311664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bf000 con 0x55e6075b1e90 2024-09-10T06:23:15.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94446454311664] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb71b9bb9c0 20 remove_watcher() i=1 2024-09-10T06:23:15.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446454315296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bf000 con 0x55e6075bb170 2024-09-10T06:23:15.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb718cc0640 1 -- 172.21.15.117:0/3198579498 <== osd.3 v2:172.21.15.117:6808/266380039 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94446454315296] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb710036040 con 0x55e6075bb170 2024-09-10T06:23:15.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb71b9bb9c0 20 remove_watcher() i=2 2024-09-10T06:23:15.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.749+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446454318800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c1920 con 0x55e6075b6850 2024-09-10T06:23:15.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.753+0000 7fb7194c1640 1 -- 172.21.15.117:0/3198579498 <== osd.2 v2:172.21.15.117:6816/4244172515 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94446454318800] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7140ec030 con 0x55e6075b6850 2024-09-10T06:23:15.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.753+0000 7fb71b9bb9c0 20 remove_watcher() i=3 2024-09-10T06:23:15.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.753+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446454321008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bf000 con 0x55e6075b1e90 2024-09-10T06:23:15.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.1 v2:172.21.15.117:6800/2871996333 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94446454321008] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x55e6075b1e90 2024-09-10T06:23:15.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb71b9bb9c0 20 remove_watcher() i=4 2024-09-10T06:23:15.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446454306016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c26d0 con 0x7fb7140f8030 2024-09-10T06:23:15.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94446454306016] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb71b9bb9c0 20 remove_watcher() i=5 2024-09-10T06:23:15.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.757+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446454324480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075c1920 con 0x7fb7140f8030 2024-09-10T06:23:15.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94446454324480] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 20 remove_watcher() i=6 2024-09-10T06:23:15.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446454328256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6075bf000 con 0x7fb7140f8030 2024-09-10T06:23:15.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 <== osd.0 v2:172.21.15.84:6800/3404052370 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94446454328256] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c026040 con 0x7fb7140f8030 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 20 remove_watcher() i=7 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb7140f8030 msgr2=0x7fb7141038a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb7140f8030 0x7fb7141038a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e6075b1e90 msgr2=0x55e6075b4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e6075b1e90 0x55e6075b4320 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e6075b6850 msgr2=0x55e6075b8c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e6075b6850 0x55e6075b8c40 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e6075bb170 msgr2=0x55e6075bd5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e6075bb170 0x55e6075bd5a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5e4039ac0 msgr2=0x7fb5e403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5e4039ac0 0x7fb5e403bf80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7100207d0 tx=0x7fb710011000 comp rx=0 tx=0).stop 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 msgr2=0x55e60756f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb719cc2640 1 -- 172.21.15.117:0/3198579498 reap_dead start 2024-09-10T06:23:15.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.761+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb7140b66a0 tx=0x7fb7140cce80 comp rx=0 tx=0).stop 2024-09-10T06:23:15.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 shutdown_connections 2024-09-10T06:23:15.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/3198579498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60759e790 0x55e60756f1c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 >> 172.21.15.117:0/3198579498 conn(0x55e607599bb0 msgr2=0x55e607597dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 shutdown_connections 2024-09-10T06:23:15.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/3198579498 wait complete. 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 msgr2=0x7fb5f403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 0x7fb5f403bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55e607583a00 tx=0x7fb710006000 comp rx=0 tx=0).stop 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 msgr2=0x55e607591480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb71401b0d0 tx=0x7fb7140c6600 comp rx=0 tx=0).stop 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 shutdown_connections 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb5f4039ac0 0x7fb5f403bf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/593168796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607591060 0x55e607591480 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 >> 172.21.15.117:0/593168796 conn(0x55e607586a10 msgr2=0x55e607586df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 shutdown_connections 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/593168796 wait complete. 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e607577ff0 msgr2=0x55e60757a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e607577ff0 0x55e60757a3e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60757cba0 msgr2=0x55e60757ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60757cba0 0x55e60757ef90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e607580aa0 msgr2=0x55e607582e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e607580aa0 0x55e607582e90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb600039a70 msgr2=0x7fb60003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb600039a70 0x7fb60003bf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb710001e60 tx=0x7fb7100013e0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 msgr2=0x55e607572e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 --2- 172.21.15.117:0/1146526385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e607482580 0x55e607572e90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb714018cc0 tx=0x7fb714017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb719cc2640 1 -- 172.21.15.117:0/1146526385 reap_dead start 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 shutdown_connections 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 >> 172.21.15.117:0/1146526385 conn(0x55e60747aec0 msgr2=0x55e607564e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 shutdown_connections 2024-09-10T06:23:15.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.765+0000 7fb71b9bb9c0 1 -- 172.21.15.117:0/1146526385 wait complete. 2024-09-10T06:23:15.781 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T06:23:15.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T06:23:15.782 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T06:23:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf5c4479c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55839e906d20 0x55839e9058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf5c4479c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55839e8449c0 con 0x55839e9067f0 2024-09-10T06:23:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf5c4479c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55839e8946d0 con 0x55839e906d20 2024-09-10T06:23:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf53fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55839e906d20 0x55839e9058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf53fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55839e906d20 0x55839e9058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43436/0 (socket says 172.21.15.117:43436) 2024-09-10T06:23:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf53fff640 1 -- 172.21.15.117:0/423563612 learned_addr learned my addr 172.21.15.117:0/423563612 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf53fff640 1 -- 172.21.15.117:0/423563612 >> v1:172.21.15.84:6789/0 conn(0x55839e9067f0 legacy=0x55839e9051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.861+0000 7faf53fff640 1 -- 172.21.15.117:0/423563612 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839e838ca0 con 0x55839e906d20 2024-09-10T06:23:15.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf53fff640 1 --2- 172.21.15.117:0/423563612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e906d20 0x55839e9058f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf4400a5c0 tx=0x7faf4401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3e6635625958cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5974c640 1 -- 172.21.15.117:0/423563612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440b0070 con 0x55839e906d20 2024-09-10T06:23:15.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5974c640 1 -- 172.21.15.117:0/423563612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440ab540 con 0x55839e906d20 2024-09-10T06:23:15.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5974c640 1 -- 172.21.15.117:0/423563612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf440ab840 con 0x55839e906d20 2024-09-10T06:23:15.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 -- 172.21.15.117:0/423563612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e906d20 msgr2=0x55839e9058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/423563612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e906d20 0x55839e9058f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf4400a5c0 tx=0x7faf4401b280 comp rx=0 tx=0).stop 2024-09-10T06:23:15.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 -- 172.21.15.117:0/423563612 shutdown_connections 2024-09-10T06:23:15.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/423563612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e906d20 0x55839e9058f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 -- 172.21.15.117:0/423563612 >> 172.21.15.117:0/423563612 conn(0x55839e98c010 msgr2=0x55839e98e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 -- 172.21.15.117:0/423563612 shutdown_connections 2024-09-10T06:23:15.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.865+0000 7faf5c4479c0 1 -- 172.21.15.117:0/423563612 wait complete. 2024-09-10T06:23:15.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf5c4479c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf5c4479c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55839e898680 con 0x55839e9067f0 2024-09-10T06:23:15.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43450/0 (socket says 172.21.15.117:43450) 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf59f4d640 1 -- 172.21.15.117:0/2156377233 learned_addr learned my addr 172.21.15.117:0/2156377233 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf59f4d640 1 -- 172.21.15.117:0/2156377233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839e813da0 con 0x55839e9067f0 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7faf59f4d640 1 --2- 172.21.15.117:0/2156377233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b2d0 tx=0x7faf4c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b92eae006a9d8de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.881+0000 7fae47e07640 1 -- 172.21.15.117:0/2156377233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c00a040 con 0x55839e9067f0 2024-09-10T06:23:15.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7fae47e07640 1 -- 172.21.15.117:0/2156377233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c00f750 con 0x55839e9067f0 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7fae47e07640 1 -- 172.21.15.117:0/2156377233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c00fa70 con 0x55839e9067f0 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2156377233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 msgr2=0x55839ea7dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2156377233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b2d0 tx=0x7faf4c00b790 comp rx=0 tx=0).stop 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2156377233 shutdown_connections 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2156377233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea7dd10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2156377233 >> 172.21.15.117:0/2156377233 conn(0x55839e98c010 msgr2=0x55839ea799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2156377233 shutdown_connections 2024-09-10T06:23:15.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2156377233 wait complete. 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea853b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55839e83aa50 con 0x55839e9067f0 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea853b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43458/0 (socket says 172.21.15.117:43458) 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf59f4d640 1 -- 172.21.15.117:0/867129404 learned_addr learned my addr 172.21.15.117:0/867129404 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf59f4d640 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839ea85910 con 0x55839e9067f0 2024-09-10T06:23:15.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf59f4d640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea853b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7faf4c000c10 tx=0x7faf4c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7fae46604640 1 -- 172.21.15.117:0/867129404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c01c9f0 con 0x55839e9067f0 2024-09-10T06:23:15.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7fae46604640 1 -- 172.21.15.117:0/867129404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c01cb90 con 0x55839e9067f0 2024-09-10T06:23:15.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55839ea85ba0 con 0x55839e9067f0 2024-09-10T06:23:15.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7fae46604640 1 -- 172.21.15.117:0/867129404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c01a480 con 0x55839e9067f0 2024-09-10T06:23:15.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.885+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839ea86550 con 0x55839e9067f0 2024-09-10T06:23:15.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7fae46604640 1 -- 172.21.15.117:0/867129404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf4c017050 con 0x55839e9067f0 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7fae46604640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae40039a70 0x7fae4003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7fae46604640 1 -- 172.21.15.117:0/867129404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf4c015020 con 0x55839e9067f0 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf53fff640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae40039a70 0x7fae4003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839e906d20 0x55839ea8c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ea8ca60 con 0x55839e906d20 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5a74e640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839e906d20 0x55839ea8c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf53fff640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae40039a70 0x7fae4003bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad000 tx=0x7faf440a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5a74e640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839e906d20 0x55839ea8c520 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5a74e640 1 -- 172.21.15.117:0/867129404 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839e906d20 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ea8ceb0 con 0x55839e906d20 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5a74e640 1 -- 172.21.15.117:0/867129404 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839e906d20 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839ea8ecc0 0x55839ea910b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ea91780 con 0x55839ea8ecc0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf59f4d640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839ea8ecc0 0x55839ea910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf59f4d640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839ea8ecc0 0x55839ea910b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf59f4d640 1 -- 172.21.15.117:0/867129404 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf4c02e070 con 0x55839ea8ecc0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ea8db60 con 0x55839e906d20 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5a74e640 1 -- 172.21.15.117:0/867129404 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839e906d20 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839ea92bc0 0x55839ea94fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ea95740 con 0x55839ea92bc0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.889+0000 7faf53fff640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839ea92bc0 0x55839ea94fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf53fff640 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839ea92bc0 0x55839ea94fb0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf53fff640 1 -- 172.21.15.117:0/867129404 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf440b3040 con 0x55839ea92bc0 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55839e8a5450 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43460/0 (socket says 172.21.15.117:43460) 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf59f4d640 1 -- 172.21.15.117:0/2972342035 learned_addr learned my addr 172.21.15.117:0/2972342035 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf59f4d640 1 -- 172.21.15.117:0/2972342035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839eaa3c60 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf59f4d640 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf4c018de0 tx=0x7faf4c02f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7fae3f7fe640 1 -- 172.21.15.117:0/2972342035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c045070 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7fae3f7fe640 1 -- 172.21.15.117:0/2972342035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0502c0 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55839eaa44c0 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7fae3f7fe640 1 -- 172.21.15.117:0/2972342035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c0504b0 con 0x55839eaa3200 2024-09-10T06:23:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.893+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839eaa4a30 con 0x55839eaa3200 2024-09-10T06:23:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3f7fe640 1 -- 172.21.15.117:0/2972342035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf4c03e040 con 0x55839eaa3200 2024-09-10T06:23:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3f7fe640 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 0x7fae3403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3f7fe640 1 -- 172.21.15.117:0/2972342035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf4c03b040 con 0x55839eaa3200 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf53fff640 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 0x7fae3403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55839ea7e560 con 0x55839eaaf920 2024-09-10T06:23:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf53fff640 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 0x7fae3403bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf440058c0 tx=0x7faf44005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43466/0 (socket says 172.21.15.117:43466) 2024-09-10T06:23:15.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf59f4d640 1 -- 172.21.15.117:0/4166828193 learned_addr learned my addr 172.21.15.117:0/4166828193 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf59f4d640 1 -- 172.21.15.117:0/4166828193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839eab02d0 con 0x55839eaaf920 2024-09-10T06:23:15.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf59f4d640 1 --2- 172.21.15.117:0/4166828193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf4c01c3b0 tx=0x7faf4c03f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78e1011c14dab45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3d7fa640 1 -- 172.21.15.117:0/4166828193 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c054030 con 0x55839eaaf920 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3d7fa640 1 -- 172.21.15.117:0/4166828193 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c03f590 con 0x55839eaaf920 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7fae3d7fa640 1 -- 172.21.15.117:0/4166828193 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c026c90 con 0x55839eaaf920 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4166828193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 msgr2=0x55839eaafd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4166828193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf4c01c3b0 tx=0x7faf4c03f7f0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4166828193 shutdown_connections 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4166828193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eaafd00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4166828193 >> 172.21.15.117:0/4166828193 conn(0x55839eaabd50 msgr2=0x55839eaa9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4166828193 shutdown_connections 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4166828193 wait complete. 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 Processor -- start 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.897+0000 7faf5c4479c0 1 -- start start 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55839eab07b0 con 0x55839eaaf920 2024-09-10T06:23:15.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf59f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43482/0 (socket says 172.21.15.117:43482) 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 learned_addr learned my addr 172.21.15.117:0/4228466740 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839eab71c0 con 0x55839eaaf920 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf59f4d640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faf4c04ecf0 tx=0x7faf4c0414f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 -- 172.21.15.117:0/4228466740 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c027570 con 0x55839eaaf920 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55839eab71c0 con 0x55839eaaf920 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 -- 172.21.15.117:0/4228466740 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c041020 con 0x55839eaaf920 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839eab71c0 con 0x55839eaaf920 2024-09-10T06:23:15.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 -- 172.21.15.117:0/4228466740 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c054020 con 0x55839eaaf920 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 -- 172.21.15.117:0/4228466740 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf4c068070 con 0x55839eaaf920 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7fae2b7fe640 1 -- 172.21.15.117:0/4228466740 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faf4c06cbd0 con 0x55839eaaf920 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf53fff640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839eac1c50 0x55839eac40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac4830 con 0x55839eac1c50 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5a74e640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839eac1c50 0x55839eac40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf53fff640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55839ea95b40 tx=0x7faf440b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.901+0000 7faf5a74e640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839eac1c50 0x55839eac40e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 realm 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac4c40 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac5510 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839eac63e0 0x55839eac87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac8f10 con 0x55839eac63e0 2024-09-10T06:23:15.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839eac63e0 0x55839eac87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839eac63e0 0x55839eac87d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf4c071020 con 0x55839eac63e0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 20 searching for the correct realm 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839eacaeb0 0x55839eacd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eacd9f0 con 0x55839eacaeb0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf53fff640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839eacaeb0 0x55839eacd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf53fff640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839eacaeb0 0x55839eacd320 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eacd9f0 con 0x55839eac63e0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c071020 con 0x55839eac63e0 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7faf4c01e040 0x7faf4c008960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eacd9f0 con 0x7faf4c01e040 2024-09-10T06:23:15.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.905+0000 7faf5a74e640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7faf4c01e040 0x7faf4c008960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7faf4c01e040 0x7faf4c008960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac63e0 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c071020 con 0x55839eac63e0 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.909+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac63e0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf4c071020 con 0x55839eac63e0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.913+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac63e0 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c071020 con 0x55839eac63e0 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac63e0 2024-09-10T06:23:15.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eacaeb0 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x7faf4c01e040 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac1c50 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55839eac58b0 con 0x55839eac63e0 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.917+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac97d0 con 0x55839eac1c50 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac9bc0 con 0x55839eac1c50 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eac9bc0 con 0x55839eacaeb0 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 zone default found 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 4 Realm: () 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 zonegroup default 2024-09-10T06:23:15.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eacde70 con 0x7faf4c01e040 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eacf860 con 0x55839eacaeb0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eacfc00 con 0x55839eacaeb0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 started sync module instance, tier type = 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:15.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eaced00 con 0x55839eac63e0 2024-09-10T06:23:15.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023791210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead0450 con 0x55839eac63e0 2024-09-10T06:23:15.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.921+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead0ca0 con 0x55839eac1c50 2024-09-10T06:23:15.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.925+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023791210736] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.925+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.925+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023791214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead0ca0 con 0x55839eac1c50 2024-09-10T06:23:15.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.925+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead17a0 con 0x55839eacaeb0 2024-09-10T06:23:15.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023791219344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead2040 con 0x55839eacaeb0 2024-09-10T06:23:15.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead2a40 con 0x55839eac63e0 2024-09-10T06:23:15.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023791214496] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023791216624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead2e30 con 0x55839eac63e0 2024-09-10T06:23:15.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead37f0 con 0x55839eac1c50 2024-09-10T06:23:15.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023791219344] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023791216624] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023791224144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead3340 con 0x55839eac1c50 2024-09-10T06:23:15.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.929+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead3b90 con 0x7faf4c01e040 2024-09-10T06:23:15.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.933+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023791224144] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.933+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.933+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023791227712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead3f80 con 0x7faf4c01e040 2024-09-10T06:23:15.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.933+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead47d0 con 0x7faf4c01e040 2024-09-10T06:23:15.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023791227712] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023791228768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4430 con 0x7faf4c01e040 2024-09-10T06:23:15.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4e90 con 0x7faf4c01e040 2024-09-10T06:23:15.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023791228768] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023791233392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead5070 con 0x7faf4c01e040 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=0 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=1 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=2 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=3 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=4 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=5 2024-09-10T06:23:15.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.937+0000 7faf5c4479c0 20 add_watcher() i=6 2024-09-10T06:23:15.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023791233392] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 20 add_watcher() i=7 2024-09-10T06:23:15.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:15.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839ead8440 con 0x55839eac1c50 2024-09-10T06:23:15.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023791234912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead5830 con 0x55839eac1c50 2024-09-10T06:23:15.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023791234912] v32'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7fae0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:15.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:15.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:15.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.941+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae0c40 con 0x55839eac1c50 2024-09-10T06:23:15.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.945+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.945+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae10f0 con 0x7faf4c01e040 2024-09-10T06:23:15.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.945+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.945+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae12c0 con 0x55839eacaeb0 2024-09-10T06:23:15.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae1830 con 0x55839eac1c50 2024-09-10T06:23:15.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae1ce0 con 0x55839eac63e0 2024-09-10T06:23:15.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.949+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae1ce0 con 0x55839eacaeb0 2024-09-10T06:23:15.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.953+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.953+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae2250 con 0x55839eac1c50 2024-09-10T06:23:15.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.953+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.953+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae2700 con 0x7faf4c01e040 2024-09-10T06:23:15.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.957+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.957+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae2700 con 0x55839eac63e0 2024-09-10T06:23:15.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.957+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.957+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae2700 con 0x55839eacaeb0 2024-09-10T06:23:15.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac63e0 2024-09-10T06:23:15.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x7faf4c01e040 2024-09-10T06:23:15.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.961+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac63e0 2024-09-10T06:23:15.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.965+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.965+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x7faf4c01e040 2024-09-10T06:23:15.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.965+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.965+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac1c50 2024-09-10T06:23:15.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eacaeb0 2024-09-10T06:23:15.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac63e0 2024-09-10T06:23:15.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.969+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eacaeb0 2024-09-10T06:23:15.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac1c50 2024-09-10T06:23:15.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac1c50 2024-09-10T06:23:15.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.973+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eacaeb0 2024-09-10T06:23:15.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.977+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.977+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eac63e0 2024-09-10T06:23:15.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.977+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.977+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae04d0 con 0x55839eacaeb0 2024-09-10T06:23:15.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae0510 con 0x55839eacaeb0 2024-09-10T06:23:15.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae0500 con 0x55839eacaeb0 2024-09-10T06:23:15.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae06d0 con 0x55839eacaeb0 2024-09-10T06:23:15.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.981+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae06d0 con 0x7faf4c01e040 2024-09-10T06:23:15.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.985+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.985+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae06d0 con 0x55839eacaeb0 2024-09-10T06:23:15.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.985+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.989+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae3280 con 0x7faf4c01e040 2024-09-10T06:23:15.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.989+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.989+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae3280 con 0x55839eacaeb0 2024-09-10T06:23:15.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.989+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:15.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.993+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae3280 con 0x7faf4c01e040 2024-09-10T06:23:15.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.993+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:15.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.993+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eae3280 con 0x55839eac63e0 2024-09-10T06:23:15.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:15.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7fae0a7fc640 20 reqs_thread_entry: start 2024-09-10T06:23:15.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:15.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 20 Filter name: none 2024-09-10T06:23:15.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7fad7bfff640 20 reqs_thread_entry: start 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:15.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:15.997+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.001+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.005+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.009+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.013+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.017+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.021+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.025+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.029+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eacaeb0 2024-09-10T06:23:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.033+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eacaeb0 2024-09-10T06:23:16.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x7faf4c01e040 2024-09-10T06:23:16.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.037+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x7faf4c01e040 2024-09-10T06:23:16.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55839eaded70 con 0x55839eac63e0 2024-09-10T06:23:16.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7fae0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.041+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023791234912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eadf220 con 0x55839eac1c50 2024-09-10T06:23:16.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94023791234912] v32'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023791210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4f60 con 0x55839eac63e0 2024-09-10T06:23:16.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94023791210736] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf5c4479c0 20 remove_watcher() i=0 2024-09-10T06:23:16.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf5c4479c0 2 removed watcher, disabling cache 2024-09-10T06:23:16.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.045+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023791214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4f60 con 0x55839eac1c50 2024-09-10T06:23:16.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.049+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94023791214496] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.049+0000 7faf5c4479c0 20 remove_watcher() i=1 2024-09-10T06:23:16.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.049+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023791219344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eacffa0 con 0x55839eacaeb0 2024-09-10T06:23:16.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf53fff640 1 -- 172.21.15.117:0/4228466740 <== osd.3 v2:172.21.15.117:6808/266380039 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94023791219344] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf440c9030 con 0x55839eacaeb0 2024-09-10T06:23:16.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 20 remove_watcher() i=2 2024-09-10T06:23:16.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023791216624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4f60 con 0x55839eac63e0 2024-09-10T06:23:16.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf59f4d640 1 -- 172.21.15.117:0/4228466740 <== osd.2 v2:172.21.15.117:6816/4244172515 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94023791216624] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c08a040 con 0x55839eac63e0 2024-09-10T06:23:16.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 20 remove_watcher() i=3 2024-09-10T06:23:16.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023791224144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead1290 con 0x55839eac1c50 2024-09-10T06:23:16.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94023791224144] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x55839eac1c50 2024-09-10T06:23:16.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 20 remove_watcher() i=4 2024-09-10T06:23:16.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.053+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023791227712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839eacffa0 con 0x7faf4c01e040 2024-09-10T06:23:16.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94023791227712] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5c4479c0 20 remove_watcher() i=5 2024-09-10T06:23:16.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023791228768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead07f0 con 0x7faf4c01e040 2024-09-10T06:23:16.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94023791228768] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5c4479c0 20 remove_watcher() i=6 2024-09-10T06:23:16.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.057+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023791233392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55839ead4f60 con 0x7faf4c01e040 2024-09-10T06:23:16.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94023791233392] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5400a4d0 con 0x7faf4c01e040 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 20 remove_watcher() i=7 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7faf4c01e040 msgr2=0x7faf4c008960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7faf4c01e040 0x7faf4c008960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839eac1c50 msgr2=0x55839eac40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839eac1c50 0x55839eac40e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839eac63e0 msgr2=0x55839eac87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839eac63e0 0x55839eac87d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839eacaeb0 msgr2=0x55839eacd320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839eacaeb0 0x55839eacd320 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae24039a70 msgr2=0x7fae2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55839ea95b40 tx=0x7faf440b9040 comp rx=0 tx=0).stop 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5a74e640 1 -- 172.21.15.117:0/4228466740 reap_dead start 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 msgr2=0x55839eab6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7faf4c04ecf0 tx=0x7faf4c0414f0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 shutdown_connections 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/4228466740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaaf920 0x55839eab6c60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 >> 172.21.15.117:0/4228466740 conn(0x55839eaabd50 msgr2=0x55839eaa9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 shutdown_connections 2024-09-10T06:23:16.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/4228466740 wait complete. 2024-09-10T06:23:16.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 msgr2=0x7fae3403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 0x7fae3403bf80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf440058c0 tx=0x7faf44005ad0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 msgr2=0x55839eaa3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf4c018de0 tx=0x7faf4c02f720 comp rx=0 tx=0).stop 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 shutdown_connections 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae34039ac0 0x7fae3403bf80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.061+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/2972342035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839eaa3200 0x55839eaa3620 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 >> 172.21.15.117:0/2972342035 conn(0x55839ea98bb0 msgr2=0x55839ea98f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 shutdown_connections 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/2972342035 wait complete. 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839e906d20 msgr2=0x55839ea8c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55839e906d20 0x55839ea8c520 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839ea8ecc0 msgr2=0x55839ea910b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55839ea8ecc0 0x55839ea910b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839ea92bc0 msgr2=0x55839ea94fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55839ea92bc0 0x55839ea94fb0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae40039a70 msgr2=0x7fae4003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fae40039a70 0x7fae4003bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad000 tx=0x7faf440a5040 comp rx=0 tx=0).stop 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 msgr2=0x55839ea853b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 --2- 172.21.15.117:0/867129404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55839e9067f0 0x55839ea853b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7faf4c000c10 tx=0x7faf4c000ee0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5a74e640 1 -- 172.21.15.117:0/867129404 reap_dead start 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 shutdown_connections 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 >> 172.21.15.117:0/867129404 conn(0x55839e98c010 msgr2=0x55839ea78440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 shutdown_connections 2024-09-10T06:23:16.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.065+0000 7faf5c4479c0 1 -- 172.21.15.117:0/867129404 wait complete. 2024-09-10T06:23:16.081 INFO:teuthology.orchestra.run.smithi117.stdout:[] 2024-09-10T06:23:16.081 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T06:23:16.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T06:23:16.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T06:23:16.081 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T06:23:16.158 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:16.158 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:16.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58be9a9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5558c68d6770 0x5558c68d6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58be9a9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558c67889c0 con 0x5558c68d98b0 2024-09-10T06:23:16.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58be9a9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5558c67d86d0 con 0x5558c68d6770 2024-09-10T06:23:16.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe5899a0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5558c68d6770 0x5558c68d6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe5899a0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5558c68d6770 0x5558c68d6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43496/0 (socket says 172.21.15.117:43496) 2024-09-10T06:23:16.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe5899a0640 1 -- 172.21.15.117:0/2383474000 learned_addr learned my addr 172.21.15.117:0/2383474000 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe58919f640 1 --1- 172.21.15.117:0/2383474000 >> v1:172.21.15.84:6789/0 conn(0x5558c68d98b0 0x5558c68dbca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55874/0 (socket says 172.21.15.117:55874) 2024-09-10T06:23:16.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe5899a0640 1 -- 172.21.15.117:0/2383474000 >> v1:172.21.15.84:6789/0 conn(0x5558c68d98b0 legacy=0x5558c68dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.157+0000 7fe5899a0640 1 -- 172.21.15.117:0/2383474000 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c677cca0 con 0x5558c68d6770 2024-09-10T06:23:16.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe5899a0640 1 --2- 172.21.15.117:0/2383474000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c68d6b50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a4e0 tx=0x7fe57c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac170fd98bcae76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58899e640 1 -- 172.21.15.117:0/2383474000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0aa540 con 0x5558c68d6770 2024-09-10T06:23:16.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58899e640 1 -- 172.21.15.117:0/2383474000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0aa6e0 con 0x5558c68d6770 2024-09-10T06:23:16.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58899e640 1 -- 172.21.15.117:0/2383474000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0aaa40 con 0x5558c68d6770 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2383474000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 msgr2=0x5558c68d6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2383474000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c68d6b50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a4e0 tx=0x7fe57c01b090 comp rx=0 tx=0).stop 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2383474000 shutdown_connections 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2383474000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c68d6b50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2383474000 >> 172.21.15.117:0/2383474000 conn(0x5558c684a080 msgr2=0x5558c684a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2383474000 shutdown_connections 2024-09-10T06:23:16.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.161+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2383474000 wait complete. 2024-09-10T06:23:16.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe58be9a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe58be9a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558c67dc680 con 0x5558c68d6770 2024-09-10T06:23:16.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43500/0 (socket says 172.21.15.117:43500) 2024-09-10T06:23:16.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe5899a0640 1 -- 172.21.15.117:0/289932017 learned_addr learned my addr 172.21.15.117:0/289932017 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe5899a0640 1 -- 172.21.15.117:0/289932017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c6757da0 con 0x5558c68d6770 2024-09-10T06:23:16.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.177+0000 7fe5899a0640 1 --2- 172.21.15.117:0/289932017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe57c018cc0 tx=0x7fe57c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a776964c19abf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe477e07640 1 -- 172.21.15.117:0/289932017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0b9030 con 0x5558c68d6770 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe477e07640 1 -- 172.21.15.117:0/289932017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0aaa80 con 0x5558c68d6770 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe477e07640 1 -- 172.21.15.117:0/289932017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0aada0 con 0x5558c68d6770 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/289932017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 msgr2=0x5558c69c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/289932017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe57c018cc0 tx=0x7fe57c0033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/289932017 shutdown_connections 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/289932017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c19e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/289932017 >> 172.21.15.117:0/289932017 conn(0x5558c684a080 msgr2=0x5558c69bd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/289932017 shutdown_connections 2024-09-10T06:23:16.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/289932017 wait complete. 2024-09-10T06:23:16.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558c677ea50 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43516/0 (socket says 172.21.15.117:43516) 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe5899a0640 1 -- 172.21.15.117:0/1307238175 learned_addr learned my addr 172.21.15.117:0/1307238175 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe5899a0640 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c69c9450 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe5899a0640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c8ef0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe57c019740 tx=0x7fe57c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe476604640 1 -- 172.21.15.117:0/1307238175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0b9070 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558c69c96e0 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe476604640 1 -- 172.21.15.117:0/1307238175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0c3030 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c69ca090 con 0x5558c68d6770 2024-09-10T06:23:16.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.181+0000 7fe476604640 1 -- 172.21.15.117:0/1307238175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0cd060 con 0x5558c68d6770 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe476604640 1 -- 172.21.15.117:0/1307238175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe57c0b3040 con 0x5558c68d6770 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe476604640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe470039ac0 0x7fe47003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe476604640 1 -- 172.21.15.117:0/1307238175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe57c0ba070 con 0x5558c68d6770 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58919f640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe470039ac0 0x7fe47003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c68d98b0 0x5558c69d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c69d05a0 con 0x5558c68d98b0 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c68d98b0 0x5558c69d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58919f640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe470039ac0 0x7fe47003bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe580001e90 tx=0x7fe5800013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c68d98b0 0x5558c69d0060 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58a1a1640 1 -- 172.21.15.117:0/1307238175 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c68d98b0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c69d0a10 con 0x5558c68d98b0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58a1a1640 1 -- 172.21.15.117:0/1307238175 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c68d98b0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c69d2820 0x5558c69d4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c69d52e0 con 0x5558c69d2820 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe5899a0640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c69d2820 0x5558c69d4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe5899a0640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c69d2820 0x5558c69d4c10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe5899a0640 1 -- 172.21.15.117:0/1307238175 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe57c0c89f0 con 0x5558c69d2820 2024-09-10T06:23:16.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c69d16c0 con 0x5558c68d98b0 2024-09-10T06:23:16.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58a1a1640 1 -- 172.21.15.117:0/1307238175 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c68d98b0 2024-09-10T06:23:16.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c69d6720 0x5558c69d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c69d9280 con 0x5558c69d6720 2024-09-10T06:23:16.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.185+0000 7fe58919f640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c69d6720 0x5558c69d8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58919f640 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c69d6720 0x5558c69d8b10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58919f640 1 -- 172.21.15.117:0/1307238175 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe58000f6e0 con 0x5558c69d6720 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558c67e9450 con 0x5558c69e6d40 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43526/0 (socket says 172.21.15.117:43526) 2024-09-10T06:23:16.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe5899a0640 1 -- 172.21.15.117:0/203718229 learned_addr learned my addr 172.21.15.117:0/203718229 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe5899a0640 1 -- 172.21.15.117:0/203718229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c69e77a0 con 0x5558c69e6d40 2024-09-10T06:23:16.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe5899a0640 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01b0d0 tx=0x7fe57c0d1e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe46f7fe640 1 -- 172.21.15.117:0/203718229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0bcc30 con 0x5558c69e6d40 2024-09-10T06:23:16.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558c69e8000 con 0x5558c69e6d40 2024-09-10T06:23:16.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe46f7fe640 1 -- 172.21.15.117:0/203718229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0bcdd0 con 0x5558c69e6d40 2024-09-10T06:23:16.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe46f7fe640 1 -- 172.21.15.117:0/203718229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0bc6a0 con 0x5558c69e6d40 2024-09-10T06:23:16.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c69e8000 con 0x5558c69e6d40 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.189+0000 7fe46f7fe640 1 -- 172.21.15.117:0/203718229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe57c0b6030 con 0x5558c69e6d40 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe46f7fe640 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 0x7fe46403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe46f7fe640 1 -- 172.21.15.117:0/203718229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe57c0da070 con 0x5558c69e6d40 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58919f640 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 0x7fe46403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58919f640 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 0x7fe46403bee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5558c69d9680 tx=0x7fe58000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558c69c2150 con 0x5558c69f4260 2024-09-10T06:23:16.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43528/0 (socket says 172.21.15.117:43528) 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 -- 172.21.15.117:0/3707559073 learned_addr learned my addr 172.21.15.117:0/3707559073 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 -- 172.21.15.117:0/3707559073 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c69f4c30 con 0x5558c69f4260 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 --2- 172.21.15.117:0/3707559073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0b5690 tx=0x7fe57c004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea631294733c9c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe46d7fa640 1 -- 172.21.15.117:0/3707559073 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0b6710 con 0x5558c69f4260 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe46d7fa640 1 -- 172.21.15.117:0/3707559073 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0fb030 con 0x5558c69f4260 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe46d7fa640 1 -- 172.21.15.117:0/3707559073 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c0b6320 con 0x5558c69f4260 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/3707559073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 msgr2=0x5558c69f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/3707559073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0b5690 tx=0x7fe57c004a90 comp rx=0 tx=0).stop 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/3707559073 shutdown_connections 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/3707559073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69f4640 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/3707559073 >> 172.21.15.117:0/3707559073 conn(0x5558c69ef680 msgr2=0x5558c69ed8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/3707559073 shutdown_connections 2024-09-10T06:23:16.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/3707559073 wait complete. 2024-09-10T06:23:16.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 Processor -- start 2024-09-10T06:23:16.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- start start 2024-09-10T06:23:16.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe58be9a9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5558c69f3030 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43544/0 (socket says 172.21.15.117:43544) 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.193+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 learned_addr learned my addr 172.21.15.117:0/2958484685 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c69fab30 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe5899a0640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0cdff0 tx=0x7fe57c0f0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 -- 172.21.15.117:0/2958484685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c110070 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558c69fab30 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c69fab30 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 -- 172.21.15.117:0/2958484685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c0b1c90 con 0x5558c69f4260 2024-09-10T06:23:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 -- 172.21.15.117:0/2958484685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c005170 con 0x5558c69f4260 2024-09-10T06:23:16.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 -- 172.21.15.117:0/2958484685 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe57c113070 con 0x5558c69f4260 2024-09-10T06:23:16.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe454039a20 0x7fe45403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe45b7fe640 1 -- 172.21.15.117:0/2958484685 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe57c108070 con 0x5558c69f4260 2024-09-10T06:23:16.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58919f640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe454039a20 0x7fe45403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c6a05760 0x5558c6a07c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a08370 con 0x5558c6a05760 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c6a05760 0x5558c6a07c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58919f640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe454039a20 0x7fe45403bee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe580001ec0 tx=0x7fe580010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c6a05760 0x5558c6a07c20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c6a05760 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 realm 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a08780 con 0x5558c6a05760 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c6a05760 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.197+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a09050 con 0x5558c6a05760 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c6a05760 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c6a05760 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c6a0a150 0x5558c6a0c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a0cb00 con 0x5558c6a0a150 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c6a0a150 0x5558c6a0c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c6a0a150 0x5558c6a0c540 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:16.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 20 searching for the correct realm 2024-09-10T06:23:16.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c6a0ea50 0x5558c6a10e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a11530 con 0x5558c6a0ea50 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58919f640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c6a0ea50 0x5558c6a10e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58919f640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c6a0ea50 0x5558c6a10e60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a11530 con 0x5558c6a0a150 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe57c115060 0x7fe57c0a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a11530 con 0x7fe57c115060 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe57c115060 0x7fe57c0a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.201+0000 7fe58a1a1640 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe57c115060 0x7fe57c0a9820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840083f0 con 0x7fe57c115060 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840083f0 con 0x5558c6a05760 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0a150 2024-09-10T06:23:16.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.205+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0a150 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0a150 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.209+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0a150 2024-09-10T06:23:16.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0ea50 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x7fe57c115060 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a05760 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a093f0 con 0x5558c6a0a150 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:16.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.213+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a0d3c0 con 0x5558c6a05760 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a0d7b0 con 0x5558c6a05760 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a0d7b0 con 0x5558c6a0ea50 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:16.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 zone default found 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 4 Realm: () 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 zonegroup default 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a119b0 con 0x7fe57c115060 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a134a0 con 0x5558c6a0ea50 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a139a0 con 0x5558c6a0ea50 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 started sync module instance, tier type = 2024-09-10T06:23:16.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a12840 con 0x5558c6a0a150 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93839777934384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a124a0 con 0x5558c6a0a150 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.217+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a148d0 con 0x5558c6a05760 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.221+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93839777934384] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.221+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.221+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93839777940512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a14cf0 con 0x5558c6a05760 2024-09-10T06:23:16.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.221+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a156b0 con 0x5558c6a0ea50 2024-09-10T06:23:16.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93839777940512] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93839777944064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a15f00 con 0x5558c6a0ea50 2024-09-10T06:23:16.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a14840 con 0x5558c6a0a150 2024-09-10T06:23:16.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93839777948960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a16e70 con 0x5558c6a0a150 2024-09-10T06:23:16.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a17990 con 0x5558c6a05760 2024-09-10T06:23:16.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93839777944064] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93839777948960] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93839777950016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a17950 con 0x5558c6a05760 2024-09-10T06:23:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.225+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a17d80 con 0x7fe57c115060 2024-09-10T06:23:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93839777946192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a17d30 con 0x7fe57c115060 2024-09-10T06:23:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a18c40 con 0x7fe57c115060 2024-09-10T06:23:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93839777950016] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93839777946192] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93839777956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a18790 con 0x7fe57c115060 2024-09-10T06:23:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.229+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a19080 con 0x7fe57c115060 2024-09-10T06:23:16.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93839777956208] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93839777952864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a19260 con 0x7fe57c115060 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=0 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=1 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=2 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=3 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=4 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=5 2024-09-10T06:23:16.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.233+0000 7fe58be9a9c0 20 add_watcher() i=6 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93839777952864] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 20 add_watcher() i=7 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a1c630 con 0x5558c6a05760 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93839777960272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a19a20 con 0x5558c6a05760 2024-09-10T06:23:16.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93839777960272] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe43b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:16.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:16.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a24e10 con 0x5558c6a05760 2024-09-10T06:23:16.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.237+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a24e10 con 0x7fe57c115060 2024-09-10T06:23:16.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.241+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.241+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a25930 con 0x5558c6a0ea50 2024-09-10T06:23:16.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.241+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.241+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a26180 con 0x5558c6a05760 2024-09-10T06:23:16.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a23470 con 0x5558c6a0a150 2024-09-10T06:23:16.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a23470 con 0x5558c6a0ea50 2024-09-10T06:23:16.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.245+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a26ce0 con 0x5558c6a05760 2024-09-10T06:23:16.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.249+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.249+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a26ce0 con 0x7fe57c115060 2024-09-10T06:23:16.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.249+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.249+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a26ce0 con 0x5558c6a0a150 2024-09-10T06:23:16.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.253+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.253+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a26ce0 con 0x5558c6a0ea50 2024-09-10T06:23:16.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.253+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.253+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0a150 2024-09-10T06:23:16.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'60 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x7fe57c115060 2024-09-10T06:23:16.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0a150 2024-09-10T06:23:16.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.257+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x7fe57c115060 2024-09-10T06:23:16.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.261+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.261+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a05760 2024-09-10T06:23:16.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.261+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.261+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0ea50 2024-09-10T06:23:16.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.265+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.265+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0a150 2024-09-10T06:23:16.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.265+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.265+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0ea50 2024-09-10T06:23:16.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.269+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.269+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a05760 2024-09-10T06:23:16.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.269+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.269+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a05760 2024-09-10T06:23:16.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.269+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.273+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0ea50 2024-09-10T06:23:16.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.273+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.273+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27190 con 0x5558c6a0a150 2024-09-10T06:23:16.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.273+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.273+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27360 con 0x5558c6a0ea50 2024-09-10T06:23:16.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27360 con 0x5558c6a0ea50 2024-09-10T06:23:16.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27360 con 0x5558c6a0ea50 2024-09-10T06:23:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.277+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27360 con 0x5558c6a0ea50 2024-09-10T06:23:16.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.281+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.281+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27360 con 0x7fe57c115060 2024-09-10T06:23:16.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.281+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.281+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a22df0 con 0x5558c6a0ea50 2024-09-10T06:23:16.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.285+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.285+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27250 con 0x7fe57c115060 2024-09-10T06:23:16.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.285+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.285+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27290 con 0x5558c6a0ea50 2024-09-10T06:23:16.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.289+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.289+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27250 con 0x7fe57c115060 2024-09-10T06:23:16.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a27250 con 0x5558c6a0a150 2024-09-10T06:23:16.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe43a7fc640 20 reqs_thread_entry: start 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 20 Filter name: none 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe3abfff640 20 reqs_thread_entry: start 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.293+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a22db0 con 0x5558c6a05760 2024-09-10T06:23:16.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:16.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a0a150 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe43b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93839777960272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a05760 2024-09-10T06:23:16.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93839777960272] v32'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.297+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93839777934384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a0a150 2024-09-10T06:23:16.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93839777934384] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58be9a9c0 20 remove_watcher() i=0 2024-09-10T06:23:16.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58be9a9c0 2 removed watcher, disabling cache 2024-09-10T06:23:16.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93839777940512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a05760 2024-09-10T06:23:16.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93839777940512] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58be9a9c0 20 remove_watcher() i=1 2024-09-10T06:23:16.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.301+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93839777944064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a0ea50 2024-09-10T06:23:16.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe58919f640 1 -- 172.21.15.117:0/2958484685 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93839777944064] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe580037040 con 0x5558c6a0ea50 2024-09-10T06:23:16.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe58be9a9c0 20 remove_watcher() i=2 2024-09-10T06:23:16.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93839777948960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a0a150 2024-09-10T06:23:16.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe5899a0640 1 -- 172.21.15.117:0/2958484685 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93839777948960] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c112030 con 0x5558c6a0a150 2024-09-10T06:23:16.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe58be9a9c0 20 remove_watcher() i=3 2024-09-10T06:23:16.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.305+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93839777950016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x5558c6a05760 2024-09-10T06:23:16.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93839777950016] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x5558c6a05760 2024-09-10T06:23:16.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58be9a9c0 20 remove_watcher() i=4 2024-09-10T06:23:16.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93839777946192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x7fe57c115060 2024-09-10T06:23:16.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93839777946192] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58be9a9c0 20 remove_watcher() i=5 2024-09-10T06:23:16.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.309+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93839777956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x7fe57c115060 2024-09-10T06:23:16.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93839777956208] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 20 remove_watcher() i=6 2024-09-10T06:23:16.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93839777952864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558c6a228a0 con 0x7fe57c115060 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93839777952864] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584026040 con 0x7fe57c115060 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 20 remove_watcher() i=7 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe57c115060 msgr2=0x7fe57c0a9820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe57c115060 0x7fe57c0a9820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c6a05760 msgr2=0x5558c6a07c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c6a05760 0x5558c6a07c20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c6a0a150 msgr2=0x5558c6a0c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c6a0a150 0x5558c6a0c540 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c6a0ea50 msgr2=0x5558c6a10e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c6a0ea50 0x5558c6a10e60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe454039a20 msgr2=0x7fe45403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe454039a20 0x7fe45403bee0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe580001ec0 tx=0x7fe580010000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 msgr2=0x5558c69fa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0cdff0 tx=0x7fe57c0f0f90 comp rx=0 tx=0).stop 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58a1a1640 1 -- 172.21.15.117:0/2958484685 reap_dead start 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 shutdown_connections 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.313+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/2958484685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69f4260 0x5558c69fa5d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 >> 172.21.15.117:0/2958484685 conn(0x5558c69ef680 msgr2=0x5558c69ed890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 shutdown_connections 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/2958484685 wait complete. 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 msgr2=0x7fe46403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 0x7fe46403bee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5558c69d9680 tx=0x7fe58000f000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 msgr2=0x5558c69e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01b0d0 tx=0x7fe57c0d1e70 comp rx=0 tx=0).stop 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 shutdown_connections 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe464039a20 0x7fe46403bee0 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5558c69d9680 tx=0x7fe58000f000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/203718229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c69e6d40 0x5558c69e7160 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 >> 172.21.15.117:0/203718229 conn(0x5558c69dc6f0 msgr2=0x5558c69dcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 shutdown_connections 2024-09-10T06:23:16.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/203718229 wait complete. 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c68d98b0 msgr2=0x5558c69d0060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5558c68d98b0 0x5558c69d0060 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c69d2820 msgr2=0x5558c69d4c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5558c69d2820 0x5558c69d4c10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c69d6720 msgr2=0x5558c69d8b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5558c69d6720 0x5558c69d8b10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe470039ac0 msgr2=0x7fe47003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe470039ac0 0x7fe47003bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe580001e90 tx=0x7fe5800013f0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 msgr2=0x5558c69c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 --2- 172.21.15.117:0/1307238175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5558c68d6770 0x5558c69c8ef0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe57c019740 tx=0x7fe57c017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58a1a1640 1 -- 172.21.15.117:0/1307238175 reap_dead start 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 shutdown_connections 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 >> 172.21.15.117:0/1307238175 conn(0x5558c684a080 msgr2=0x5558c69bc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 shutdown_connections 2024-09-10T06:23:16.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.317+0000 7fe58be9a9c0 1 -- 172.21.15.117:0/1307238175 wait complete. 2024-09-10T06:23:16.330 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T06:23:16.346 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-10T06:23:16.351 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.405 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.420 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.465 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T06:23:16.475 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.476 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T06:23:16.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T06:23:16.476 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T06:23:16.515 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:16.515 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:16.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f2741d279c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b3c0c01c80 0x55b3c0c04070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f2741d279c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3c0ab39c0 con 0x55b3c0c045b0 2024-09-10T06:23:16.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f2741d279c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55b3c0b036d0 con 0x55b3c0c01c80 2024-09-10T06:23:16.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f273f82d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b3c0c01c80 0x55b3c0c04070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f273f82d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b3c0c01c80 0x55b3c0c04070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43550/0 (socket says 172.21.15.117:43550) 2024-09-10T06:23:16.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f273f82d640 1 -- 172.21.15.117:0/871655755 learned_addr learned my addr 172.21.15.117:0/871655755 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f273f82d640 1 -- 172.21.15.117:0/871655755 >> v1:172.21.15.84:6789/0 conn(0x55b3c0c045b0 legacy=0x55b3c0c069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.513+0000 7f273f82d640 1 -- 172.21.15.117:0/871655755 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0aa7ca0 con 0x55b3c0c01c80 2024-09-10T06:23:16.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f273f82d640 1 --2- 172.21.15.117:0/871655755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0c04070 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f273000a4e0 tx=0x7f273001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313a4e4090e655f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f273e82b640 1 -- 172.21.15.117:0/871655755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300aa540 con 0x55b3c0c01c80 2024-09-10T06:23:16.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f273e82b640 1 -- 172.21.15.117:0/871655755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300aa6e0 con 0x55b3c0c01c80 2024-09-10T06:23:16.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f273e82b640 1 -- 172.21.15.117:0/871655755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300aaa40 con 0x55b3c0c01c80 2024-09-10T06:23:16.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f2741d279c0 1 -- 172.21.15.117:0/871655755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 msgr2=0x55b3c0c04070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.517+0000 7f2741d279c0 1 --2- 172.21.15.117:0/871655755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0c04070 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f273000a4e0 tx=0x7f273001b090 comp rx=0 tx=0).stop 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.521+0000 7f2741d279c0 1 -- 172.21.15.117:0/871655755 shutdown_connections 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.521+0000 7f2741d279c0 1 --2- 172.21.15.117:0/871655755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0c04070 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.521+0000 7f2741d279c0 1 -- 172.21.15.117:0/871655755 >> 172.21.15.117:0/871655755 conn(0x55b3c0b75010 msgr2=0x55b3c0b75420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.521+0000 7f2741d279c0 1 -- 172.21.15.117:0/871655755 shutdown_connections 2024-09-10T06:23:16.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.521+0000 7f2741d279c0 1 -- 172.21.15.117:0/871655755 wait complete. 2024-09-10T06:23:16.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.533+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.533+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.533+0000 7f2741d279c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.533+0000 7f2741d279c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0b07680 con 0x55b3c0c01c80 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43558/0 (socket says 172.21.15.117:43558) 2024-09-10T06:23:16.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 -- 172.21.15.117:0/792776197 learned_addr learned my addr 172.21.15.117:0/792776197 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 -- 172.21.15.117:0/792776197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0a82da0 con 0x55b3c0c01c80 2024-09-10T06:23:16.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 --2- 172.21.15.117:0/792776197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2730018cc0 tx=0x7f27300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6814e234c603db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f262de0b640 1 -- 172.21.15.117:0/792776197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300b9070 con 0x55b3c0c01c80 2024-09-10T06:23:16.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f262de0b640 1 -- 172.21.15.117:0/792776197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300aaa80 con 0x55b3c0c01c80 2024-09-10T06:23:16.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f262de0b640 1 -- 172.21.15.117:0/792776197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300aad60 con 0x55b3c0c01c80 2024-09-10T06:23:16.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- 172.21.15.117:0/792776197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 msgr2=0x55b3c0ceca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 --2- 172.21.15.117:0/792776197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2730018cc0 tx=0x7f27300033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- 172.21.15.117:0/792776197 shutdown_connections 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 --2- 172.21.15.117:0/792776197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0ceca40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- 172.21.15.117:0/792776197 >> 172.21.15.117:0/792776197 conn(0x55b3c0b75010 msgr2=0x55b3c0ce86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- 172.21.15.117:0/792776197 shutdown_connections 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- 172.21.15.117:0/792776197 wait complete. 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0cf3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f2741d279c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0aa9a50 con 0x55b3c0c01c80 2024-09-10T06:23:16.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0cf3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0cf3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43574/0 (socket says 172.21.15.117:43574) 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.537+0000 7f273f82d640 1 -- 172.21.15.117:0/540151177 learned_addr learned my addr 172.21.15.117:0/540151177 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f273f82d640 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0cf4490 con 0x55b3c0c01c80 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f273f82d640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0cf3f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2730018cc0 tx=0x7f2730017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 -- 172.21.15.117:0/540151177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300b9070 con 0x55b3c0c01c80 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 -- 172.21.15.117:0/540151177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300b5a50 con 0x55b3c0c01c80 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0cf4720 con 0x55b3c0c01c80 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 -- 172.21.15.117:0/540151177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300b5d30 con 0x55b3c0c01c80 2024-09-10T06:23:16.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0cf5080 con 0x55b3c0c01c80 2024-09-10T06:23:16.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 -- 172.21.15.117:0/540151177 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f27300b3040 con 0x55b3c0c01c80 2024-09-10T06:23:16.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2628039a70 0x7f262803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2627fff640 1 -- 172.21.15.117:0/540151177 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f27300c4070 con 0x55b3c0c01c80 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f273f02c640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2628039a70 0x7f262803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0c045b0 0x55b3c0cfb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0cfb590 con 0x55b3c0c045b0 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f274002e640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0c045b0 0x55b3c0cfb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f273f02c640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2628039a70 0x7f262803bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ec0 tx=0x7f2728001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f274002e640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0c045b0 0x55b3c0cfb050 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f274002e640 1 -- 172.21.15.117:0/540151177 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0c045b0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0cf5470 con 0x55b3c0c045b0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.541+0000 7f274002e640 1 -- 172.21.15.117:0/540151177 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0c045b0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0cfd8a0 0x55b3c0cffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d00380 con 0x55b3c0cfd8a0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0cfd8a0 0x55b3c0cffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0cfd8a0 0x55b3c0cffc90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 -- 172.21.15.117:0/540151177 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0cfd8a0 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0cfc710 con 0x55b3c0c045b0 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f274002e640 1 -- 172.21.15.117:0/540151177 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0c045b0 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d017e0 0x55b3c0d03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d042d0 con 0x55b3c0d017e0 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f02c640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d017e0 0x55b3c0d03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f02c640 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d017e0 0x55b3c0d03bd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f02c640 1 -- 172.21.15.117:0/540151177 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f272800d040 con 0x55b3c0d017e0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f2741d279c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0b14450 con 0x55b3c0d11dd0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43578/0 (socket says 172.21.15.117:43578) 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 -- 172.21.15.117:0/1283077437 learned_addr learned my addr 172.21.15.117:0/1283077437 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 -- 172.21.15.117:0/1283077437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0d12830 con 0x55b3c0d11dd0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.545+0000 7f273f82d640 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27300e91c0 tx=0x7f27300b2450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 -- 172.21.15.117:0/1283077437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300a93c0 con 0x55b3c0d11dd0 2024-09-10T06:23:16.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 -- 172.21.15.117:0/1283077437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300a9560 con 0x55b3c0d11dd0 2024-09-10T06:23:16.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0d13090 con 0x55b3c0d11dd0 2024-09-10T06:23:16.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 -- 172.21.15.117:0/1283077437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300a9880 con 0x55b3c0d11dd0 2024-09-10T06:23:16.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0d13600 con 0x55b3c0d11dd0 2024-09-10T06:23:16.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 -- 172.21.15.117:0/1283077437 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f27300e2030 con 0x55b3c0d11dd0 2024-09-10T06:23:16.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 0x7f261803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f26257fa640 1 -- 172.21.15.117:0/1283077437 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f27300da070 con 0x55b3c0d11dd0 2024-09-10T06:23:16.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f02c640 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 0x7f261803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f2741d279c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0ced1b0 con 0x55b3c0d1e530 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f02c640 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 0x7f261803bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b3c0cfba20 tx=0x7f2728006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43590/0 (socket says 172.21.15.117:43590) 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f82d640 1 -- 172.21.15.117:0/1924843706 learned_addr learned my addr 172.21.15.117:0/1924843706 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f82d640 1 -- 172.21.15.117:0/1924843706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0d1ef00 con 0x55b3c0d1e530 2024-09-10T06:23:16.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f273f82d640 1 --2- 172.21.15.117:0/1924843706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27300b2ee0 tx=0x7f27300b4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f11b8c0ccabf560 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f261effd640 1 -- 172.21.15.117:0/1924843706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300cadf0 con 0x55b3c0d1e530 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f261effd640 1 -- 172.21.15.117:0/1924843706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300c5c30 con 0x55b3c0d1e530 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.549+0000 7f261effd640 1 -- 172.21.15.117:0/1924843706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300bda50 con 0x55b3c0d1e530 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/1924843706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 msgr2=0x55b3c0d1e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1924843706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27300b2ee0 tx=0x7f27300b4de0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/1924843706 shutdown_connections 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1924843706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d1e910 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/1924843706 >> 172.21.15.117:0/1924843706 conn(0x55b3c0d1a960 msgr2=0x55b3c0d18ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/1924843706 shutdown_connections 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/1924843706 wait complete. 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 Processor -- start 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- start start 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b3c0d1f3c0 con 0x55b3c0d1e530 2024-09-10T06:23:16.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f273f82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43592/0 (socket says 172.21.15.117:43592) 2024-09-10T06:23:16.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 learned_addr learned my addr 172.21.15.117:0/147612240 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c0d25e10 con 0x55b3c0d1e530 2024-09-10T06:23:16.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f273f82d640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d258b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f27300b2ee0 tx=0x7f27300bf0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f261d7fa640 1 -- 172.21.15.117:0/147612240 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300bd530 con 0x55b3c0d1e530 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3c0d25e10 con 0x55b3c0d1e530 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f261d7fa640 1 -- 172.21.15.117:0/147612240 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27300dec90 con 0x55b3c0d1e530 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c0d263e0 con 0x55b3c0d1e530 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f261d7fa640 1 -- 172.21.15.117:0/147612240 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27300c8420 con 0x55b3c0d1e530 2024-09-10T06:23:16.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.553+0000 7f261d7fa640 1 -- 172.21.15.117:0/147612240 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f273010e030 con 0x55b3c0d1e530 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f261d7fa640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2608039a70 0x7f260803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f261d7fa640 1 -- 172.21.15.117:0/147612240 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f273010c020 con 0x55b3c0d1e530 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f02c640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2608039a70 0x7f260803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0d30a80 0x55b3c0d32f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d33660 con 0x55b3c0d30a80 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0d30a80 0x55b3c0d32f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f02c640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2608039a70 0x7f260803bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2728010fd0 tx=0x7f2728011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0d30a80 0x55b3c0d32f10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0d30a80 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 realm 2024-09-10T06:23:16.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d33a70 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d34340 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0d30a80 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0d35440 0x55b3c0d37830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d37e80 con 0x55b3c0d35440 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f82d640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0d35440 0x55b3c0d37830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f82d640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0d35440 0x55b3c0d37830 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 20 searching for the correct realm 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d39d60 0x55b3c0d3c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3c810 con 0x55b3c0d39d60 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f02c640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d39d60 0x55b3c0d3c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.557+0000 7f273f02c640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d39d60 0x55b3c0d3c190 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3c810 con 0x55b3c0d35440 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f82d640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f273011c040 0x7f27300fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3c810 con 0x7f273011c040 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f273011c040 0x7f27300fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f273011c040 0x7f27300fd7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27380083f0 con 0x7f273011c040 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27380083f0 con 0x55b3c0d30a80 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d35440 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.561+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d35440 2024-09-10T06:23:16.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.565+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d35440 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d35440 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d39d60 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.569+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x7f273011c040 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d30a80 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d346e0 con 0x55b3c0d35440 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:16.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d386d0 con 0x55b3c0d30a80 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d38ac0 con 0x55b3c0d30a80 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d38ac0 con 0x55b3c0d39d60 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 zone default found 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 4 Realm: () 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:16.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 zonegroup default 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3cc90 con 0x7f273011c040 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3e7b0 con 0x55b3c0d39d60 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3ec40 con 0x55b3c0d39d60 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 started sync module instance, tier type = 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.573+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3db20 con 0x55b3c0d35440 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230522617616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3f550 con 0x55b3c0d35440 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3fda0 con 0x55b3c0d30a80 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230522617616] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230522622112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3fda0 con 0x55b3c0d30a80 2024-09-10T06:23:16.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.577+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d40880 con 0x55b3c0d39d60 2024-09-10T06:23:16.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230522622112] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230522624240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d3fd10 con 0x55b3c0d39d60 2024-09-10T06:23:16.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d41630 con 0x55b3c0d35440 2024-09-10T06:23:16.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230522630432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d41ed0 con 0x55b3c0d35440 2024-09-10T06:23:16.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.581+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d428d0 con 0x55b3c0d30a80 2024-09-10T06:23:16.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230522624240] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230522630432] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230522629232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d41a20 con 0x55b3c0d30a80 2024-09-10T06:23:16.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d43170 con 0x7f273011c040 2024-09-10T06:23:16.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230522629232] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230522635232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d41a20 con 0x7f273011c040 2024-09-10T06:23:16.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.585+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d43600 con 0x7f273011c040 2024-09-10T06:23:16.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.589+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.589+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230522638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d43a20 con 0x7f273011c040 2024-09-10T06:23:16.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.589+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d44520 con 0x7f273011c040 2024-09-10T06:23:16.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.589+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230522635232] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230522642448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d444e0 con 0x7f273011c040 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=0 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=1 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=2 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=3 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=4 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=5 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230522638608] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=6 2024-09-10T06:23:16.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230522642448] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 add_watcher() i=7 2024-09-10T06:23:16.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:16.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d43530 con 0x55b3c0d30a80 2024-09-10T06:23:16.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230522639664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d44940 con 0x55b3c0d30a80 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230522639664] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f25f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.593+0000 7f2741d279c0 5 note: GC not initialized 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f25f4fe1640 20 reqs_thread_entry: start 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 Filter name: none 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f256e7fc640 20 reqs_thread_entry: start 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d6b060 con 0x55b3c0d35440 2024-09-10T06:23:16.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:23:16.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:23:16.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 : miss 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.4 8:2026732e:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d6cb00 con 0x55b3c0d35440 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(63 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 info.flags=0x17 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 to cache LRU end 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 get_obj_state: octx=0x7f27300f4c90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b3c0d6ecb8 s->prefetch_data=0 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 3.16 3:6926ffd3:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d35440 2024-09-10T06:23:16.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(64 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 10 manifest: total_size = 5 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 20 get_obj_state: setting s->obj_tag to _QzBG2DkgV8BltSO-im2nL0Apf_Nuier 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f25f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.597+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230522639664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d30a80 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94230522639664] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230522617616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d35440 2024-09-10T06:23:16.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94230522617616] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f2741d279c0 20 remove_watcher() i=0 2024-09-10T06:23:16.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f2741d279c0 2 removed watcher, disabling cache 2024-09-10T06:23:16.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.601+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230522622112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d30a80 2024-09-10T06:23:16.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94230522622112] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 20 remove_watcher() i=1 2024-09-10T06:23:16.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230522624240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d39d60 2024-09-10T06:23:16.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f273f02c640 1 -- 172.21.15.117:0/147612240 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94230522624240] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728036040 con 0x55b3c0d39d60 2024-09-10T06:23:16.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 20 remove_watcher() i=2 2024-09-10T06:23:16.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230522630432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d35440 2024-09-10T06:23:16.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f273f82d640 1 -- 172.21.15.117:0/147612240 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94230522630432] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27300cd060 con 0x55b3c0d35440 2024-09-10T06:23:16.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 20 remove_watcher() i=3 2024-09-10T06:23:16.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.605+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230522629232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x55b3c0d30a80 2024-09-10T06:23:16.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.609+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94230522629232] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x55b3c0d30a80 2024-09-10T06:23:16.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.609+0000 7f2741d279c0 20 remove_watcher() i=4 2024-09-10T06:23:16.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.609+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230522635232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x7f273011c040 2024-09-10T06:23:16.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94230522635232] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f2741d279c0 20 remove_watcher() i=5 2024-09-10T06:23:16.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230522638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x7f273011c040 2024-09-10T06:23:16.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94230522638608] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f2741d279c0 20 remove_watcher() i=6 2024-09-10T06:23:16.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230522642448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3c0d701d0 con 0x7f273011c040 2024-09-10T06:23:16.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94230522642448] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2738026040 con 0x7f273011c040 2024-09-10T06:23:16.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.613+0000 7f2741d279c0 20 remove_watcher() i=7 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f273011c040 msgr2=0x7f27300fd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f273011c040 0x7f27300fd7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0d30a80 msgr2=0x55b3c0d32f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0d30a80 0x55b3c0d32f10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0d35440 msgr2=0x55b3c0d37830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0d35440 0x55b3c0d37830 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d39d60 msgr2=0x55b3c0d3c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d39d60 0x55b3c0d3c190 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2608039a70 msgr2=0x7f260803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2608039a70 0x7f260803bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2728010fd0 tx=0x7f2728011000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 msgr2=0x55b3c0d258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/147612240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d1e530 0x55b3c0d258b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f27300b2ee0 tx=0x7f27300bf0a0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 reap_dead start 2024-09-10T06:23:16.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f274002e640 1 -- 172.21.15.117:0/147612240 reap_dead start 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 shutdown_connections 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 >> 172.21.15.117:0/147612240 conn(0x55b3c0d1a960 msgr2=0x55b3c0d18b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 shutdown_connections 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/147612240 wait complete. 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 msgr2=0x7f261803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 0x7f261803bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b3c0cfba20 tx=0x7f2728006000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 msgr2=0x55b3c0d121f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27300e91c0 tx=0x7f27300b2450 comp rx=0 tx=0).stop 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 shutdown_connections 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2618039a70 0x7f261803bf30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/1283077437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0d11dd0 0x55b3c0d121f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 >> 172.21.15.117:0/1283077437 conn(0x55b3c0d07780 msgr2=0x55b3c0d07b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 shutdown_connections 2024-09-10T06:23:16.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/1283077437 wait complete. 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0c045b0 msgr2=0x55b3c0cfb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b3c0c045b0 0x55b3c0cfb050 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0cfd8a0 msgr2=0x55b3c0cffc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b3c0cfd8a0 0x55b3c0cffc90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d017e0 msgr2=0x55b3c0d03bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b3c0d017e0 0x55b3c0d03bd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2628039a70 msgr2=0x7f262803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2628039a70 0x7f262803bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2728001ec0 tx=0x7f2728001440 comp rx=0 tx=0).stop 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 msgr2=0x55b3c0cf3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 --2- 172.21.15.117:0/540151177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b3c0c01c80 0x55b3c0cf3f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2730018cc0 tx=0x7f2730017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f274002e640 1 -- 172.21.15.117:0/540151177 reap_dead start 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 shutdown_connections 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 >> 172.21.15.117:0/540151177 conn(0x55b3c0b75010 msgr2=0x55b3c0ce7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 shutdown_connections 2024-09-10T06:23:16.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.617+0000 7f2741d279c0 1 -- 172.21.15.117:0/540151177 wait complete. 2024-09-10T06:23:16.630 INFO:teuthology.orchestra.run.smithi117.stdout:fooFoofooFooFULL_CONTROL 2024-09-10T06:23:16.631 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-10T06:23:16.633 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-10T06:23:16.640 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.640 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T06:23:16.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T06:23:16.641 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T06:23:16.710 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:16.710 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:16.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a279e99c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc49b486f0 0x55cc49b48ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a279e99c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc499fe9c0 con 0x55cc49b49040 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a279e99c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55cc49a4e6d0 con 0x55cc49b486f0 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a254ef640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc49b486f0 0x55cc49b48ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a254ef640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55cc49b486f0 0x55cc49b48ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43606/0 (socket says 172.21.15.117:43606) 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a24cee640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55cc49b49040 0x55cc49b4fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55890/0 (socket says 172.21.15.117:55890) 2024-09-10T06:23:16.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a254ef640 1 -- 172.21.15.117:0/1949103792 learned_addr learned my addr 172.21.15.117:0/1949103792 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a254ef640 1 -- 172.21.15.117:0/1949103792 >> v1:172.21.15.84:6789/0 conn(0x55cc49b49040 legacy=0x55cc49b4fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.709+0000 7f4a254ef640 1 -- 172.21.15.117:0/1949103792 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc499f2ca0 con 0x55cc49b486f0 2024-09-10T06:23:16.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a254ef640 1 --2- 172.21.15.117:0/1949103792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b48ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800a4e0 tx=0x7f4a1801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26c65a28b5a4cae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a17fff640 1 -- 172.21.15.117:0/1949103792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180aa540 con 0x55cc49b486f0 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a17fff640 1 -- 172.21.15.117:0/1949103792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180aa6e0 con 0x55cc49b486f0 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a17fff640 1 -- 172.21.15.117:0/1949103792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180aaa40 con 0x55cc49b486f0 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 -- 172.21.15.117:0/1949103792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 msgr2=0x55cc49b48ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/1949103792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b48ad0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800a4e0 tx=0x7f4a1801b090 comp rx=0 tx=0).stop 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 -- 172.21.15.117:0/1949103792 shutdown_connections 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/1949103792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b48ad0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 -- 172.21.15.117:0/1949103792 >> 172.21.15.117:0/1949103792 conn(0x55cc49b44640 msgr2=0x55cc49b46a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 -- 172.21.15.117:0/1949103792 shutdown_connections 2024-09-10T06:23:16.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.713+0000 7f4a279e99c0 1 -- 172.21.15.117:0/1949103792 wait complete. 2024-09-10T06:23:16.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a279e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a279e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc49a52680 con 0x55cc49b486f0 2024-09-10T06:23:16.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43610/0 (socket says 172.21.15.117:43610) 2024-09-10T06:23:16.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a254ef640 1 -- 172.21.15.117:0/2651090874 learned_addr learned my addr 172.21.15.117:0/2651090874 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a254ef640 1 -- 172.21.15.117:0/2651090874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc499cdda0 con 0x55cc49b486f0 2024-09-10T06:23:16.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4a254ef640 1 --2- 172.21.15.117:0/2651090874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4a18019740 tx=0x7f4a180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d304dd847cdc0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4913606640 1 -- 172.21.15.117:0/2651090874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180b9070 con 0x55cc49b486f0 2024-09-10T06:23:16.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4913606640 1 -- 172.21.15.117:0/2651090874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180aaa90 con 0x55cc49b486f0 2024-09-10T06:23:16.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.729+0000 7f4913606640 1 -- 172.21.15.117:0/2651090874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180aad70 con 0x55cc49b486f0 2024-09-10T06:23:16.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/2651090874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 msgr2=0x55cc49b4af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/2651090874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4a18019740 tx=0x7f4a180033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/2651090874 shutdown_connections 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/2651090874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49b4af20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/2651090874 >> 172.21.15.117:0/2651090874 conn(0x55cc49b44640 msgr2=0x55cc49c314a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/2651090874 shutdown_connections 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/2651090874 wait complete. 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49c3ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc499f4a50 con 0x55cc49b486f0 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49c3ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49c3ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43620/0 (socket says 172.21.15.117:43620) 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a254ef640 1 -- 172.21.15.117:0/4139053726 learned_addr learned my addr 172.21.15.117:0/4139053726 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a254ef640 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc49c3f480 con 0x55cc49b486f0 2024-09-10T06:23:16.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a254ef640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49c3ef20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4a18018cc0 tx=0x7f4a18017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4911e03640 1 -- 172.21.15.117:0/4139053726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180b9070 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc49c3f710 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4911e03640 1 -- 172.21.15.117:0/4139053726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180b5b10 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4911e03640 1 -- 172.21.15.117:0/4139053726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180b5df0 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.733+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc49c40070 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4911e03640 1 -- 172.21.15.117:0/4139053726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a180b3040 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4911e03640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f490c039a70 0x7f490c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4911e03640 1 -- 172.21.15.117:0/4139053726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4a180c4070 con 0x55cc49b486f0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a24cee640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f490c039a70 0x7f490c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49b49040 0x55cc49c46040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c46580 con 0x55cc49b49040 2024-09-10T06:23:16.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49b49040 0x55cc49c46040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a24cee640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f490c039a70 0x7f490c03bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c001e90 tx=0x7f4a1c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49b49040 0x55cc49c46040 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a25cf0640 1 -- 172.21.15.117:0/4139053726 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49b49040 2024-09-10T06:23:16.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c46e20 con 0x55cc49b49040 2024-09-10T06:23:16.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a25cf0640 1 -- 172.21.15.117:0/4139053726 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49b49040 2024-09-10T06:23:16.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c48770 0x55cc49c4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c4b390 con 0x55cc49c48770 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a254ef640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c48770 0x55cc49c4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a254ef640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c48770 0x55cc49c4ac00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a254ef640 1 -- 172.21.15.117:0/4139053726 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a180c6d80 con 0x55cc49c48770 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c47670 con 0x55cc49b49040 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a25cf0640 1 -- 172.21.15.117:0/4139053726 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49b49040 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c4c7f0 0x55cc49c4ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c4f320 con 0x55cc49c4c7f0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a24cee640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c4c7f0 0x55cc49c4ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.737+0000 7f4a24cee640 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c4c7f0 0x55cc49c4ebe0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a24cee640 1 -- 172.21.15.117:0/4139053726 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a1c00f6e0 con 0x55cc49c4c7f0 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc49a5f450 con 0x55cc49c5ce00 2024-09-10T06:23:16.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43624/0 (socket says 172.21.15.117:43624) 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a254ef640 1 -- 172.21.15.117:0/321089422 learned_addr learned my addr 172.21.15.117:0/321089422 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a254ef640 1 -- 172.21.15.117:0/321089422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc49c5d860 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a254ef640 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4a180c6ae0 tx=0x7f4a180c7fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f490affd640 1 -- 172.21.15.117:0/321089422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180b3540 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f490affd640 1 -- 172.21.15.117:0/321089422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180b36e0 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc49c5e0c0 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f490affd640 1 -- 172.21.15.117:0/321089422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180bd710 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.741+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc49c5e630 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f490affd640 1 -- 172.21.15.117:0/321089422 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a180da030 con 0x55cc49c5ce00 2024-09-10T06:23:16.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f490affd640 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 0x7f48fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f490affd640 1 -- 172.21.15.117:0/321089422 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4a180edba0 con 0x55cc49c5ce00 2024-09-10T06:23:16.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a24cee640 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 0x7f48fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a24cee640 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 0x7f48fc03bf30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cc49c40560 tx=0x7f4a1c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc49b4b6b0 con 0x55cc49c6a510 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43632/0 (socket says 172.21.15.117:43632) 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a254ef640 1 -- 172.21.15.117:0/828285272 learned_addr learned my addr 172.21.15.117:0/828285272 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a254ef640 1 -- 172.21.15.117:0/828285272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc49c6aee0 con 0x55cc49c6a510 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a254ef640 1 --2- 172.21.15.117:0/828285272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b4f70 tx=0x7f4a180db640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d5f1ed94a7e402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4908ff9640 1 -- 172.21.15.117:0/828285272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18103070 con 0x55cc49c6a510 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4908ff9640 1 -- 172.21.15.117:0/828285272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180bda90 con 0x55cc49c6a510 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4908ff9640 1 -- 172.21.15.117:0/828285272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a180c9df0 con 0x55cc49c6a510 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- 172.21.15.117:0/828285272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 msgr2=0x55cc49c6a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/828285272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b4f70 tx=0x7f4a180db640 comp rx=0 tx=0).stop 2024-09-10T06:23:16.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- 172.21.15.117:0/828285272 shutdown_connections 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/828285272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c6a8f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- 172.21.15.117:0/828285272 >> 172.21.15.117:0/828285272 conn(0x55cc49c658d0 msgr2=0x55cc49c63b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- 172.21.15.117:0/828285272 shutdown_connections 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- 172.21.15.117:0/828285272 wait complete. 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 Processor -- start 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- start start 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.745+0000 7f4a279e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc49c69280 con 0x55cc49c6a510 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a254ef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43648/0 (socket says 172.21.15.117:43648) 2024-09-10T06:23:16.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 learned_addr learned my addr 172.21.15.117:0/345999563 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc49c70d10 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a254ef640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c707b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4a180edfd0 tx=0x7f4a180caed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 -- 172.21.15.117:0/345999563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a1810d070 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc49c70d10 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc49c70d10 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 -- 172.21.15.117:0/345999563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180eb3a0 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 -- 172.21.15.117:0/345999563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18117060 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 -- 172.21.15.117:0/345999563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a18110070 con 0x55cc49c6a510 2024-09-10T06:23:16.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48f0039a70 0x7f48f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f48faffd640 1 -- 172.21.15.117:0/345999563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4a180a4160 con 0x55cc49c6a510 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a24cee640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48f0039a70 0x7f48f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49c7b9c0 0x55cc49c7de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7e5a0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49c7b9c0 0x55cc49c7de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a24cee640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48f0039a70 0x7f48f003bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cc49c4f700 tx=0x7f4a1c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.749+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49c7b9c0 0x55cc49c7de50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 realm 2024-09-10T06:23:16.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7e9b0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f280 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c80380 0x55cc49c82770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c82dc0 con 0x55cc49c80380 2024-09-10T06:23:16.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c80380 0x55cc49c82770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c80380 0x55cc49c82770 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 20 searching for the correct realm 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c84ca0 0x55cc49c870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c87750 con 0x55cc49c84ca0 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a24cee640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c84ca0 0x55cc49c870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a24cee640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c84ca0 0x55cc49c870d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c87750 con 0x55cc49c80380 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4a18112070 0x7f4a180e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c87750 con 0x7f4a18112070 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.753+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4a18112070 0x7f4a180e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4a18112070 0x7f4a180e25f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a200083f0 con 0x7f4a18112070 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a200083f0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c80380 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.757+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c80380 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.761+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c80380 2024-09-10T06:23:16.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c80380 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c84ca0 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x7f4a18112070 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c7b9c0 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.765+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c7f620 con 0x55cc49c80380 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:16.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c83610 con 0x55cc49c7b9c0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c83a00 con 0x55cc49c7b9c0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:16.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c83a00 con 0x55cc49c84ca0 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 zone default found 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 4 Realm: () 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 zonegroup default 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c87bd0 con 0x7f4a18112070 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c89720 con 0x55cc49c84ca0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c89c20 con 0x55cc49c84ca0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 started sync module instance, tier type = 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:16.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.769+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c88a60 con 0x55cc49c80380 2024-09-10T06:23:16.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94335899569744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c886c0 con 0x55cc49c80380 2024-09-10T06:23:16.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8ab50 con 0x55cc49c7b9c0 2024-09-10T06:23:16.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94335899569744] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94335899575968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8af70 con 0x55cc49c7b9c0 2024-09-10T06:23:16.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.773+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8b800 con 0x55cc49c84ca0 2024-09-10T06:23:16.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94335899575968] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94335899577296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8bbf0 con 0x55cc49c84ca0 2024-09-10T06:23:16.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8c5b0 con 0x55cc49c80380 2024-09-10T06:23:16.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94335899583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8ce50 con 0x55cc49c80380 2024-09-10T06:23:16.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8d810 con 0x55cc49c7b9c0 2024-09-10T06:23:16.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94335899577296] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.777+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94335899583024] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94335899587424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8ce50 con 0x55cc49c7b9c0 2024-09-10T06:23:16.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8d780 con 0x7f4a18112070 2024-09-10T06:23:16.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94335899587424] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94335899584928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8cdc0 con 0x7f4a18112070 2024-09-10T06:23:16.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.781+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8e640 con 0x7f4a18112070 2024-09-10T06:23:16.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94335899591056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8ea60 con 0x7f4a18112070 2024-09-10T06:23:16.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8f4a0 con 0x7f4a18112070 2024-09-10T06:23:16.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94335899584928] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94335899591056] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94335899594608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8e5b0 con 0x7f4a18112070 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=0 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=1 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=2 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=3 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=4 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=5 2024-09-10T06:23:16.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.785+0000 7f4a279e99c0 20 add_watcher() i=6 2024-09-10T06:23:16.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94335899594608] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 add_watcher() i=7 2024-09-10T06:23:16.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:16.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c925a0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94335899589408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8fa20 con 0x55cc49c7b9c0 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94335899589408] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f48db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 5 note: GC not initialized 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f48da7e4640 20 reqs_thread_entry: start 2024-09-10T06:23:16.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:16.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 Filter name: none 2024-09-10T06:23:16.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f484bfff640 20 reqs_thread_entry: start 2024-09-10T06:23:16.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:23:16.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.789+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cb5f80 con 0x55cc49c80380 2024-09-10T06:23:16.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 : miss 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.4 8:2026732e:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cb7a00 con 0x55cc49c80380 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(63 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 info.flags=0x17 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 to cache LRU end 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:16.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 20 get_obj_state: octx=0x7f4a180b45d0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cc49cb9bb8 s->prefetch_data=0 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 3.16 3:6926ffd3:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cbb130 con 0x55cc49c80380 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(64 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 10 manifest: total_size = 5 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 20 get_obj_state: setting s->obj_tag to _Tux7ISQxfcOf0InI6sd4rzSzfuhXSSP 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f48db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:16.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94335899589408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cbb130 con 0x55cc49c7b9c0 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94335899589408] v32'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.793+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94335899569744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cbb130 con 0x55cc49c80380 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94335899569744] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a279e99c0 20 remove_watcher() i=0 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a279e99c0 2 removed watcher, disabling cache 2024-09-10T06:23:16.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94335899575968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cbb130 con 0x55cc49c7b9c0 2024-09-10T06:23:16.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94335899575968] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a279e99c0 20 remove_watcher() i=1 2024-09-10T06:23:16.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.797+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94335899577296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49cbb130 con 0x55cc49c84ca0 2024-09-10T06:23:16.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a24cee640 1 -- 172.21.15.117:0/345999563 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94335899577296] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1c037040 con 0x55cc49c84ca0 2024-09-10T06:23:16.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a279e99c0 20 remove_watcher() i=2 2024-09-10T06:23:16.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94335899583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8a6a0 con 0x55cc49c80380 2024-09-10T06:23:16.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a254ef640 1 -- 172.21.15.117:0/345999563 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94335899583024] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a1810f030 con 0x55cc49c80380 2024-09-10T06:23:16.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a279e99c0 20 remove_watcher() i=3 2024-09-10T06:23:16.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.801+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94335899587424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8abd0 con 0x55cc49c7b9c0 2024-09-10T06:23:16.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94335899587424] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x55cc49c7b9c0 2024-09-10T06:23:16.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a279e99c0 20 remove_watcher() i=4 2024-09-10T06:23:16.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94335899584928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8d360 con 0x7f4a18112070 2024-09-10T06:23:16.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94335899584928] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a279e99c0 20 remove_watcher() i=5 2024-09-10T06:23:16.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.805+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94335899591056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8abd0 con 0x7f4a18112070 2024-09-10T06:23:16.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94335899591056] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 20 remove_watcher() i=6 2024-09-10T06:23:16.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94335899594608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cc49c8c9a0 con 0x7f4a18112070 2024-09-10T06:23:16.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94335899594608] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a20026040 con 0x7f4a18112070 2024-09-10T06:23:16.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 20 remove_watcher() i=7 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4a18112070 msgr2=0x7f4a180e25f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4a18112070 0x7f4a180e25f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49c7b9c0 msgr2=0x55cc49c7de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49c7b9c0 0x55cc49c7de50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c80380 msgr2=0x55cc49c82770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c80380 0x55cc49c82770 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c84ca0 msgr2=0x55cc49c870d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c84ca0 0x55cc49c870d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48f0039a70 msgr2=0x7f48f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48f0039a70 0x7f48f003bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55cc49c4f700 tx=0x7f4a1c010000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 msgr2=0x55cc49c707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/345999563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c6a510 0x55cc49c707b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4a180edfd0 tx=0x7f4a180caed0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a25cf0640 1 -- 172.21.15.117:0/345999563 reap_dead start 2024-09-10T06:23:16.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 shutdown_connections 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 >> 172.21.15.117:0/345999563 conn(0x55cc49c658d0 msgr2=0x55cc49c63ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 shutdown_connections 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/345999563 wait complete. 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 msgr2=0x7f48fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 0x7f48fc03bf30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cc49c40560 tx=0x7f4a1c00f000 comp rx=0 tx=0).stop 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 msgr2=0x55cc49c5d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.809+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4a180c6ae0 tx=0x7f4a180c7fe0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 shutdown_connections 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f48fc039a70 0x7f48fc03bf30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/321089422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49c5ce00 0x55cc49c5d220 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 >> 172.21.15.117:0/321089422 conn(0x55cc49c527b0 msgr2=0x55cc49c52b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 shutdown_connections 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/321089422 wait complete. 2024-09-10T06:23:16.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49b49040 msgr2=0x55cc49c46040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55cc49b49040 0x55cc49c46040 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c48770 msgr2=0x55cc49c4ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55cc49c48770 0x55cc49c4ac00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c4c7f0 msgr2=0x55cc49c4ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55cc49c4c7f0 0x55cc49c4ebe0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f490c039a70 msgr2=0x7f490c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f490c039a70 0x7f490c03bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c001e90 tx=0x7f4a1c0013f0 comp rx=0 tx=0).stop 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 msgr2=0x55cc49c3ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 --2- 172.21.15.117:0/4139053726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc49b486f0 0x55cc49c3ef20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4a18018cc0 tx=0x7f4a18017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a25cf0640 1 -- 172.21.15.117:0/4139053726 reap_dead start 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 shutdown_connections 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 >> 172.21.15.117:0/4139053726 conn(0x55cc49b44640 msgr2=0x55cc49b49b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 shutdown_connections 2024-09-10T06:23:16.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.813+0000 7f4a279e99c0 1 -- 172.21.15.117:0/4139053726 wait complete. 2024-09-10T06:23:16.825 INFO:teuthology.orchestra.run.smithi117.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T06:23:16.825 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T06:23:16.828 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-10T06:23:16.853 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:16.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T06:23:16.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T06:23:16.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T06:23:16.958 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T06:23:16.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T06:23:16.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T06:23:16.958 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-10T06:23:16.999 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:16.999 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:17.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acec089c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562870df28c0 0x562870df4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acec089c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562870ca29c0 con 0x562870d62770 2024-09-10T06:23:17.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acec089c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x562870cf26d0 con 0x562870df28c0 2024-09-10T06:23:17.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acbf0d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562870df28c0 0x562870df4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acc70e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x562870d62770 0x562870df11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55904/0 (socket says 172.21.15.117:55904) 2024-09-10T06:23:17.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acc70e640 1 -- 172.21.15.117:0/2581707291 learned_addr learned my addr 172.21.15.117:0/2581707291 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:17.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acbf0d640 1 -- 172.21.15.117:0/2581707291 >> v1:172.21.15.84:6789/0 conn(0x562870d62770 legacy=0x562870df11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:16.997+0000 7f2acbf0d640 1 -- 172.21.15.117:0/2581707291 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870c96ca0 con 0x562870df28c0 2024-09-10T06:23:17.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/2581707291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870df28c0 0x562870df4cb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000a480 tx=0x7f2ac001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e56c20aaa622624 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acb70c640 1 -- 172.21.15.117:0/2581707291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac00af070 con 0x562870df28c0 2024-09-10T06:23:17.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acb70c640 1 -- 172.21.15.117:0/2581707291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac00aa530 con 0x562870df28c0 2024-09-10T06:23:17.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acb70c640 1 -- 172.21.15.117:0/2581707291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac00aa830 con 0x562870df28c0 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 -- 172.21.15.117:0/2581707291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870df28c0 msgr2=0x562870df4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 --2- 172.21.15.117:0/2581707291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870df28c0 0x562870df4cb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000a480 tx=0x7f2ac001b280 comp rx=0 tx=0).stop 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 -- 172.21.15.117:0/2581707291 shutdown_connections 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 --2- 172.21.15.117:0/2581707291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870df28c0 0x562870df4cb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 -- 172.21.15.117:0/2581707291 >> 172.21.15.117:0/2581707291 conn(0x562870de8e90 msgr2=0x562870deb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 -- 172.21.15.117:0/2581707291 shutdown_connections 2024-09-10T06:23:17.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.001+0000 7f2acec089c0 1 -- 172.21.15.117:0/2581707291 wait complete. 2024-09-10T06:23:17.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acec089c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acec089c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562870cf6680 con 0x562870d62770 2024-09-10T06:23:17.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43660/0 (socket says 172.21.15.117:43660) 2024-09-10T06:23:17.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.017+0000 7f2acc70e640 1 -- 172.21.15.117:0/4070962147 learned_addr learned my addr 172.21.15.117:0/4070962147 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 -- 172.21.15.117:0/4070962147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870c71da0 con 0x562870d62770 2024-09-10T06:23:17.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 --2- 172.21.15.117:0/4070962147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4001810 tx=0x7f2ac4001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6953740d2683e70a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29ba60c640 1 -- 172.21.15.117:0/4070962147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4004530 con 0x562870d62770 2024-09-10T06:23:17.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29ba60c640 1 -- 172.21.15.117:0/4070962147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac40046d0 con 0x562870d62770 2024-09-10T06:23:17.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29ba60c640 1 -- 172.21.15.117:0/4070962147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac40049f0 con 0x562870d62770 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/4070962147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 msgr2=0x562870ed9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 --2- 172.21.15.117:0/4070962147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4001810 tx=0x7f2ac4001cd0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/4070962147 shutdown_connections 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 --2- 172.21.15.117:0/4070962147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ed9910 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/4070962147 >> 172.21.15.117:0/4070962147 conn(0x562870de8e90 msgr2=0x562870ed55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/4070962147 shutdown_connections 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/4070962147 wait complete. 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ee0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562870c98a50 con 0x562870d62770 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ee0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ee0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43664/0 (socket says 172.21.15.117:43664) 2024-09-10T06:23:17.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 -- 172.21.15.117:0/1477858754 learned_addr learned my addr 172.21.15.117:0/1477858754 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870ee1510 con 0x562870d62770 2024-09-10T06:23:17.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ee0fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000f90 tx=0x7f2ac4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29b8e09640 1 -- 172.21.15.117:0/1477858754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4013820 con 0x562870d62770 2024-09-10T06:23:17.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29b8e09640 1 -- 172.21.15.117:0/1477858754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac40139c0 con 0x562870d62770 2024-09-10T06:23:17.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562870ee17a0 con 0x562870d62770 2024-09-10T06:23:17.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f29b8e09640 1 -- 172.21.15.117:0/1477858754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4013ce0 con 0x562870d62770 2024-09-10T06:23:17.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.021+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562870ee2150 con 0x562870d62770 2024-09-10T06:23:17.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f29b8e09640 1 -- 172.21.15.117:0/1477858754 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ac4010070 con 0x562870d62770 2024-09-10T06:23:17.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f29b8e09640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29b4039ac0 0x7f29b403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f29b8e09640 1 -- 172.21.15.117:0/1477858754 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2ac4018070 con 0x562870d62770 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29b4039ac0 0x7f29b403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870df28c0 0x562870ee8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870ee8660 con 0x562870df28c0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870df28c0 0x562870ee8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29b4039ac0 0x7f29b403bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00ac000 tx=0x7f2ac00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870df28c0 0x562870ee8120 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2accf0f640 1 -- 172.21.15.117:0/1477858754 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870df28c0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870ee8a90 con 0x562870df28c0 2024-09-10T06:23:17.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2accf0f640 1 -- 172.21.15.117:0/1477858754 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870df28c0 2024-09-10T06:23:17.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870eea8a0 0x562870eecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870eed380 con 0x562870eea8a0 2024-09-10T06:23:17.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870eea8a0 0x562870eecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870eea8a0 0x562870eecc90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acc70e640 1 -- 172.21.15.117:0/1477858754 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ac401b030 con 0x562870eea8a0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.025+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870ee9740 con 0x562870df28c0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2accf0f640 1 -- 172.21.15.117:0/1477858754 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870df28c0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870eee7e0 0x562870ef0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870ef1310 con 0x562870eee7e0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870eee7e0 0x562870ef0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870eee7e0 0x562870ef0bd0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1477858754 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ac00a8070 con 0x562870eee7e0 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562870d03450 con 0x562870efee10 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43666/0 (socket says 172.21.15.117:43666) 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acc70e640 1 -- 172.21.15.117:0/3523678185 learned_addr learned my addr 172.21.15.117:0/3523678185 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acc70e640 1 -- 172.21.15.117:0/3523678185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870eff870 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acc70e640 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404e970 tx=0x7f2ac4012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f29b1ffb640 1 -- 172.21.15.117:0/3523678185 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4047070 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562870f000d0 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f29b1ffb640 1 -- 172.21.15.117:0/3523678185 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac4010810 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f29b1ffb640 1 -- 172.21.15.117:0/3523678185 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4011c80 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.029+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562870f00640 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29b1ffb640 1 -- 172.21.15.117:0/3523678185 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ac404a070 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29b1ffb640 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 0x7f29a403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29b1ffb640 1 -- 172.21.15.117:0/3523678185 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2ac4051de0 con 0x562870efee10 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 0x7f29a403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 0x7f29a403bf80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x562870ee2470 tx=0x7f2ac0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562870eda160 con 0x562870f0c520 2024-09-10T06:23:17.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43670/0 (socket says 172.21.15.117:43670) 2024-09-10T06:23:17.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acc70e640 1 -- 172.21.15.117:0/3322951197 learned_addr learned my addr 172.21.15.117:0/3322951197 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acc70e640 1 -- 172.21.15.117:0/3322951197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870f0cf10 con 0x562870f0c520 2024-09-10T06:23:17.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acc70e640 1 --2- 172.21.15.117:0/3322951197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40109e0 tx=0x7f2ac4035d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9823e72359aa625d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29ab7fe640 1 -- 172.21.15.117:0/3322951197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4061070 con 0x562870f0c520 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29ab7fe640 1 -- 172.21.15.117:0/3322951197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac40333d0 con 0x562870f0c520 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f29ab7fe640 1 -- 172.21.15.117:0/3322951197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4056040 con 0x562870f0c520 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- 172.21.15.117:0/3322951197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 msgr2=0x562870f0c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3322951197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40109e0 tx=0x7f2ac4035d00 comp rx=0 tx=0).stop 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- 172.21.15.117:0/3322951197 shutdown_connections 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3322951197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870f0c920 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- 172.21.15.117:0/3322951197 >> 172.21.15.117:0/3322951197 conn(0x562870f07940 msgr2=0x562870f05b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- 172.21.15.117:0/3322951197 shutdown_connections 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 -- 172.21.15.117:0/3322951197 wait complete. 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.033+0000 7f2acec089c0 1 Processor -- start 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 -- start start 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870dee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562870f0b2f0 con 0x562870f0c520 2024-09-10T06:23:17.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870dee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acc70e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870dee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43682/0 (socket says 172.21.15.117:43682) 2024-09-10T06:23:17.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 learned_addr learned my addr 172.21.15.117:0/1198981088 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562870deedc0 con 0x562870f0c520 2024-09-10T06:23:17.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870dee860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4007ea0 tx=0x7f2ac400dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 -- 172.21.15.117:0/1198981088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4061070 con 0x562870f0c520 2024-09-10T06:23:17.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562870deedc0 con 0x562870f0c520 2024-09-10T06:23:17.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562870deedc0 con 0x562870f0c520 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 -- 172.21.15.117:0/1198981088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac401d530 con 0x562870f0c520 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 -- 172.21.15.117:0/1198981088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac4012740 con 0x562870f0c520 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 -- 172.21.15.117:0/1198981088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ac402b1e0 con 0x562870f0c520 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f299c039ac0 0x7f299c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f29a9ffb640 1 -- 172.21.15.117:0/1198981088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2ac402c100 con 0x562870f0c520 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f299c039ac0 0x7f299c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870f1fbc0 0x562870f22080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f227d0 con 0x562870f1fbc0 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.037+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870f1fbc0 0x562870f22080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f299c039ac0 0x7f299c03bf80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00aafd0 tx=0x7f2ac00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870f1fbc0 0x562870f22080 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870f1fbc0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 realm 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f22be0 con 0x562870f1fbc0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870f1fbc0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f234b0 con 0x562870f1fbc0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870f1fbc0 2024-09-10T06:23:17.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870f1fbc0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870f245b0 0x562870f269a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f26f70 con 0x562870f245b0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870f245b0 0x562870f269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870f245b0 0x562870f269a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 20 searching for the correct realm 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870f28ec0 0x562870f2b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f2b970 con 0x562870f28ec0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870f28ec0 0x562870f2b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acbf0d640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870f28ec0 0x562870f2b2f0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f2b970 con 0x562870f245b0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2ac404c060 0x7f2ac401b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.041+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f26f70 con 0x7f2ac404c060 2024-09-10T06:23:17.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2ac404c060 0x7f2ac401b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2ac404c060 0x7f2ac401b620 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc0083f0 con 0x7f2ac404c060 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc0083f0 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f245b0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.045+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f245b0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.049+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f245b0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f245b0 2024-09-10T06:23:17.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f28ec0 2024-09-10T06:23:17.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x7f2ac404c060 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.053+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f1fbc0 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562870f23850 con 0x562870f245b0 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:17.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f26f70 con 0x562870f1fbc0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f27830 con 0x562870f1fbc0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f27c50 con 0x562870f28ec0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 zone default found 2024-09-10T06:23:17.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 4 Realm: () 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 zonegroup default 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f27420 con 0x7f2ac404c060 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f2d7e0 con 0x562870f28ec0 2024-09-10T06:23:17.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f2db80 con 0x562870f28ec0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 started sync module instance, tier type = 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.057+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2cc80 con 0x562870f245b0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94731693642192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2cc80 con 0x562870f245b0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2e540 con 0x562870f1fbc0 2024-09-10T06:23:17.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94731693642192] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94731693639904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2e540 con 0x562870f1fbc0 2024-09-10T06:23:17.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.061+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2ef00 con 0x562870f28ec0 2024-09-10T06:23:17.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94731693639904] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94731693645968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2e4b0 con 0x562870f28ec0 2024-09-10T06:23:17.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2fc60 con 0x562870f245b0 2024-09-10T06:23:17.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94731693651792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f30500 con 0x562870f245b0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f30f00 con 0x562870f1fbc0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.065+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94731693645968] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94731693651792] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94731693654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f30a10 con 0x562870f1fbc0 2024-09-10T06:23:17.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f313d0 con 0x7f2ac404c060 2024-09-10T06:23:17.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94731693654096] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94731693650592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f313d0 con 0x7f2ac404c060 2024-09-10T06:23:17.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.069+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f31c60 con 0x7f2ac404c060 2024-09-10T06:23:17.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94731693659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f322f0 con 0x7f2ac404c060 2024-09-10T06:23:17.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f32b80 con 0x7f2ac404c060 2024-09-10T06:23:17.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94731693650592] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94731693657888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f32d60 con 0x7f2ac404c060 2024-09-10T06:23:17.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=0 2024-09-10T06:23:17.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=1 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=2 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=3 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=4 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.073+0000 7f2acec089c0 20 add_watcher() i=5 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94731693659088] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 20 add_watcher() i=6 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94731693657888] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 20 add_watcher() i=7 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f35c80 con 0x562870f1fbc0 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94731693662016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f33100 con 0x562870f1fbc0 2024-09-10T06:23:17.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94731693662016] v32'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f29827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:17.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:17.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.077+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3e3d0 con 0x562870f1fbc0 2024-09-10T06:23:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.081+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.081+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3e3d0 con 0x7f2ac404c060 2024-09-10T06:23:17.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.081+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.081+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3ee90 con 0x562870f28ec0 2024-09-10T06:23:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3f8b0 con 0x562870f1fbc0 2024-09-10T06:23:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f245b0 2024-09-10T06:23:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.085+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f28ec0 2024-09-10T06:23:17.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.089+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.089+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f1fbc0 2024-09-10T06:23:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.089+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.089+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x7f2ac404c060 2024-09-10T06:23:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f245b0 2024-09-10T06:23:17.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f405d0 con 0x562870f28ec0 2024-09-10T06:23:17.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.093+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40660 con 0x562870f245b0 2024-09-10T06:23:17.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.097+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.097+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40660 con 0x7f2ac404c060 2024-09-10T06:23:17.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.097+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.097+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40660 con 0x562870f245b0 2024-09-10T06:23:17.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.101+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.101+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40830 con 0x7f2ac404c060 2024-09-10T06:23:17.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.101+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.101+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40830 con 0x562870f1fbc0 2024-09-10T06:23:17.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.105+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.105+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40830 con 0x562870f28ec0 2024-09-10T06:23:17.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.105+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.105+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f245b0 2024-09-10T06:23:17.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.105+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.109+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3cac0 con 0x562870f28ec0 2024-09-10T06:23:17.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.109+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.109+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f1fbc0 2024-09-10T06:23:17.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.109+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.109+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f1fbc0 2024-09-10T06:23:17.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f28ec0 2024-09-10T06:23:17.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f245b0 2024-09-10T06:23:17.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.113+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f28ec0 2024-09-10T06:23:17.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f28ec0 2024-09-10T06:23:17.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f28ec0 2024-09-10T06:23:17.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.117+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x562870f28ec0 2024-09-10T06:23:17.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.121+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.121+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40cc0 con 0x7f2ac404c060 2024-09-10T06:23:17.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.121+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.121+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40ca0 con 0x562870f28ec0 2024-09-10T06:23:17.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.125+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.125+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40ca0 con 0x7f2ac404c060 2024-09-10T06:23:17.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.125+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.125+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40c80 con 0x562870f28ec0 2024-09-10T06:23:17.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.129+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.129+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40c80 con 0x7f2ac404c060 2024-09-10T06:23:17.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.129+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.129+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f40c80 con 0x562870f245b0 2024-09-10T06:23:17.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f29817e2640 20 reqs_thread_entry: start 2024-09-10T06:23:17.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:17.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 Filter name: none 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f28f2ffd640 20 reqs_thread_entry: start 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f5c0e0 con 0x562870f245b0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 : miss 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 8.4 8:2026732e:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f5d790 con 0x562870f245b0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(95 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 info.flags=0x17 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 to cache LRU end 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.133+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:96 4.1b 4:d8275aee:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdad70 con 0x562870f245b0 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(96 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 4.1 4:8032c342:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdad70 con 0x562870f245b0 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(97 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadf0 con 0x7f2ac404c060 2024-09-10T06:23:17.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(98 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-10T06:23:17.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 4.c 4:32d27e63:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadf0 con 0x562870f1fbc0 2024-09-10T06:23:17.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(99 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 4.10 4:09b18263:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadf0 con 0x562870f28ec0 2024-09-10T06:23:17.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(100 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 4.23 4:c421775e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadf0 con 0x7f2ac404c060 2024-09-10T06:23:17.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.137+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadf0 con 0x562870f28ec0 2024-09-10T06:23:17.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(102 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-10T06:23:17.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 4.26 4:677c561f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadb0 con 0x7f2ac404c060 2024-09-10T06:23:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(103 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:104 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdadb0 con 0x562870f28ec0 2024-09-10T06:23:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(104 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T06:23:17.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:105 4.4 4:217aab77:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdad90 con 0x7f2ac404c060 2024-09-10T06:23:17.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(105 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:106 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fdad90 con 0x7f2ac404c060 2024-09-10T06:23:17.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.141+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(106 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [call out=701b] v0'0 uv11 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-10T06:23:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-10T06:23:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 3.1e 3:7aa70f89:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fda780 con 0x7f2ac404c060 2024-09-10T06:23:17.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(107 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 10 manifest: total_size = 6 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.4852517781016464199 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 20 prepare_atomic_modification: state is not atomic. state=0x562870f5e038 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 2024-09-10T06:23:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:108 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f62ea0 con 0x7f2ac404c060 2024-09-10T06:23:17.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(108 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.145+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:109 3.1e 3:7aa70f89:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f60e80 con 0x7f2ac404c060 2024-09-10T06:23:17.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(109 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f62ea0 con 0x7f2ac404c060 2024-09-10T06:23:17.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:111 3.19 3:987d611c:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f62ea0 con 0x562870f1fbc0 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(111 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 10 manifest: total_size = 3 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.3472020316315740618 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 20 prepare_atomic_modification: state is not atomic. state=0x562870f5e038 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 2024-09-10T06:23:17.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.149+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:112 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f681c0 con 0x562870f28ec0 2024-09-10T06:23:17.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(112 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:113 3.19 3:987d611c:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f661a0 con 0x562870f1fbc0 2024-09-10T06:23:17.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(110 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f29ab7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-10T06:23:17.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(113 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:114 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x562870f28ec0 2024-09-10T06:23:17.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:115 3.31 3:8c63c861:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x7f2ac404c060 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(115 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 10 manifest: total_size = 4 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.2460315434469302613 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 20 prepare_atomic_modification: state is not atomic. state=0x562870f5e038 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 2024-09-10T06:23:17.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.153+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:116 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x562870f28ec0 2024-09-10T06:23:17.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.157+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(114 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.157+0000 7f29aaffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-10T06:23:17.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.157+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(116 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.157+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:117 3.31 3:8c63c861:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x7f2ac404c060 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(117 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:118 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x562870f28ec0 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:119 3.20 3:04ae017a:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f645e0 con 0x562870f245b0 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(119 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 10 manifest: total_size = 5 2024-09-10T06:23:17.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.8904587219007483772 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 20 prepare_atomic_modification: state is not atomic. state=0x562870f5e038 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:120 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c40 con 0x7f2ac404c060 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(118 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f29ab7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T06:23:17.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(120 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.161+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:121 3.20 3:04ae017a:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69750 con 0x562870f245b0 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(121 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:122 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c00 con 0x7f2ac404c060 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:123 3.16 3:6926ffd3:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c00 con 0x562870f245b0 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(123 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 10 manifest: total_size = 5 2024-09-10T06:23:17.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 20 get_obj_state: setting s->obj_tag to _Tux7ISQxfcOf0InI6sd4rzSzfuhXSSP 2024-09-10T06:23:17.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 20 get_obj_state: octx=0x7f2ac404ee50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x562870f5e038 s->prefetch_data=0 2024-09-10T06:23:17.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 20 prepare_atomic_modification: state is not atomic. state=0x562870f5e038 2024-09-10T06:23:17.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 2024-09-10T06:23:17.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.165+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:124 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c00 con 0x7f2ac404c060 2024-09-10T06:23:17.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(122 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f29aaffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-10T06:23:17.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(124 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:125 3.16 3:6926ffd3:::be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69750 con 0x562870f245b0 2024-09-10T06:23:17.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(125 be621638-e902-4133-b94d-0397be1b6a7c.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:126 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c00 con 0x7f2ac404c060 2024-09-10T06:23:17.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 20 list_objects_ordered: starting attempt 1 2024-09-10T06:23:17.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T06:23:17.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:127 4.1b 4:d8275aee:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f69c00 con 0x562870f245b0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:128 4.1 4:8032c342:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f62340 con 0x562870f245b0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:129 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6cda0 con 0x7f2ac404c060 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:130 4.c 4:32d27e63:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f990 con 0x562870f1fbc0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:131 4.10 4:09b18263:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6cda0 con 0x562870f28ec0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:132 4.23 4:c421775e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f74a40 con 0x7f2ac404c060 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:133 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f774c0 con 0x562870f28ec0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:134 4.26 4:677c561f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f7a130 con 0x7f2ac404c060 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:135 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f7cca0 con 0x562870f28ec0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:136 4.4 4:217aab77:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f7f670 con 0x7f2ac404c060 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:137 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f82440 con 0x7f2ac404c060 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(127 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(130 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(128 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(131 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(133 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.169+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(129 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(135 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(132 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(134 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(136 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(126 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f29aaffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(137 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T06:23:17.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.5])"; uploads.size()=0; is_truncated=0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:138 4.1b 4:d8275aee:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f77550 con 0x562870f245b0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:139 4.1 4:8032c342:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f990 con 0x562870f245b0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:140 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x7f2ac404c060 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:141 4.c 4:32d27e63:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f75ef0 con 0x562870f1fbc0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:142 4.10 4:09b18263:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f77550 con 0x562870f28ec0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:143 4.23 4:c421775e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f990 con 0x7f2ac404c060 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:144 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f28ec0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:145 4.26 4:677c561f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f79e70 con 0x7f2ac404c060 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:146 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f77550 con 0x562870f28ec0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:147 4.4 4:217aab77:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f75ef0 con 0x7f2ac404c060 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:148 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f990 con 0x7f2ac404c060 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(138 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(142 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(139 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(140 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(141 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(144 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(146 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(143 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(145 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(147 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 47 ==== osd_op_reply(148 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [call out=128b] v0'0 uv15 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.173+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f245b0 2024-09-10T06:23:17.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(149 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acec089c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-10T06:23:17.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f75ef0 con 0x562870f245b0 2024-09-10T06:23:17.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(150 myfoo [call,call,delete] v32'40 uv40 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acec089c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T06:23:17.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.177+0000 7f2acec089c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:23:17.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94731694343904 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f62640 con 0x7f2ac404c060 2024-09-10T06:23:17.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 48 ==== watch-notify(notify (1) cookie 94731693659088 notify 137438953495 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562870f3d190 con 0x7f2ac404c060 2024-09-10T06:23:17.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f29ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94731693659088 notifier 4645 bl.length()=149 2024-09-10T06:23:17.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 49 ==== osd_op_reply(151 notify.6 [notify cookie 94731694343904 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f29ab7fe640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2990003d70 con 0x7f2ac404c060 2024-09-10T06:23:17.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 50 ==== watch-notify(notify_complete (2) cookie 94731694343904 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562870f3e9e0 con 0x7f2ac404c060 2024-09-10T06:23:17.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 51 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:153 8.4 8:2026732e:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f245b0 2024-09-10T06:23:17.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(153 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2acec089c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5 from cache 2024-09-10T06:23:17.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.181+0000 7f2acec089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.5, ofs0, ns] 2024-09-10T06:23:17.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94731694343904 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f81e40 con 0x7f2ac404c060 2024-09-10T06:23:17.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 52 ==== watch-notify(notify (1) cookie 94731693650592 notify 137438953496 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562870f3e9e0 con 0x7f2ac404c060 2024-09-10T06:23:17.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f29ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94731693650592 notifier 4645 bl.length()=206 2024-09-10T06:23:17.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f29ab7fe640 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2990003d70 con 0x7f2ac404c060 2024-09-10T06:23:17.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 53 ==== osd_op_reply(154 notify.5 [notify cookie 94731694343904 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 54 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 55 ==== watch-notify(notify_complete (2) cookie 94731694343904 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562870f37e60 con 0x7f2ac404c060 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:156 4.1b 4:d8275aee:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f245b0 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:157 4.1 4:8032c342:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f770 con 0x562870f245b0 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:158 4.24 4:24cf8753:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f5c590 con 0x7f2ac404c060 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:159 4.c 4:32d27e63:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f7fb60 con 0x562870f1fbc0 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:160 4.10 4:09b18263:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f770 con 0x562870f28ec0 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:161 4.23 4:c421775e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f5c590 con 0x7f2ac404c060 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:162 4.d 4:b09d0484:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f28ec0 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:163 4.26 4:677c561f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f7fb60 con 0x7f2ac404c060 2024-09-10T06:23:17.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:164 4.15 4:a8ef96a0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f770 con 0x562870f28ec0 2024-09-10T06:23:17.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:165 4.4 4:217aab77:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f5c590 con 0x7f2ac404c060 2024-09-10T06:23:17.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.185+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:166 4.1e 4:785c2bca:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x7f2ac404c060 2024-09-10T06:23:17.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(156 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(159 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.3 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 56 ==== osd_op_reply(161 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.5 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(157 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 57 ==== osd_op_reply(163 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 58 ==== osd_op_reply(158 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 59 ==== osd_op_reply(165 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.9 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(164 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.8 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(162 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(160 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 60 ==== osd_op_reply(166 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.5.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.5 : miss 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:167 6.1f 6:fbdfa94a:::pubsub..bucket.myfoo%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562870f6f770 con 0x7f2ac404c060 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 61 ==== osd_op_reply(167 pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.5 info.flags=0x0 2024-09-10T06:23:17.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 10 adding default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.5 to cache LRU end 2024-09-10T06:23:17.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.189+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:168 6.1f 6:fbdfa94a:::pubsub..bucket.myfoo%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f7fb60 con 0x7f2ac404c060 2024-09-10T06:23:17.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.193+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 62 ==== osd_op_reply(168 pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.5 [delete] v32'27 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.193+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870fd86e0 con 0x562870f245b0 2024-09-10T06:23:17.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.193+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(169 foo.buckets [call] v32'41 uv41 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.193+0000 7f29827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94731693662016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x562870f1fbc0 2024-09-10T06:23:17.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94731693662016] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94731693642192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x562870f245b0 2024-09-10T06:23:17.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94731693642192] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acec089c0 20 remove_watcher() i=0 2024-09-10T06:23:17.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acec089c0 2 removed watcher, disabling cache 2024-09-10T06:23:17.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.197+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94731693639904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x562870f1fbc0 2024-09-10T06:23:17.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94731693639904] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2acec089c0 20 remove_watcher() i=1 2024-09-10T06:23:17.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94731693645968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x562870f28ec0 2024-09-10T06:23:17.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2acbf0d640 1 -- 172.21.15.117:0/1198981088 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94731693645968] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac00d9070 con 0x562870f28ec0 2024-09-10T06:23:17.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2acec089c0 20 remove_watcher() i=2 2024-09-10T06:23:17.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.201+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94731693651792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2e090 con 0x562870f245b0 2024-09-10T06:23:17.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2acc70e640 1 -- 172.21.15.117:0/1198981088 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94731693651792] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ac4059040 con 0x562870f245b0 2024-09-10T06:23:17.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2acec089c0 20 remove_watcher() i=3 2024-09-10T06:23:17.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94731693654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x562870f1fbc0 2024-09-10T06:23:17.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94731693654096] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x562870f1fbc0 2024-09-10T06:23:17.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2acec089c0 20 remove_watcher() i=4 2024-09-10T06:23:17.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.205+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94731693650592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2f750 con 0x7f2ac404c060 2024-09-10T06:23:17.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 63 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94731693650592] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2acec089c0 20 remove_watcher() i=5 2024-09-10T06:23:17.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94731693659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f2e090 con 0x7f2ac404c060 2024-09-10T06:23:17.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 64 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94731693659088] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2acec089c0 20 remove_watcher() i=6 2024-09-10T06:23:17.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.209+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94731693657888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562870f3dcb0 con 0x7f2ac404c060 2024-09-10T06:23:17.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 <== osd.0 v2:172.21.15.84:6800/3404052370 65 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94731693657888] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2abc026040 con 0x7f2ac404c060 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 20 remove_watcher() i=7 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2ac404c060 msgr2=0x7f2ac401b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f2ac404c060 0x7f2ac401b620 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870f1fbc0 msgr2=0x562870f22080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870f1fbc0 0x562870f22080 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870f245b0 msgr2=0x562870f269a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870f245b0 0x562870f269a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870f28ec0 msgr2=0x562870f2b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870f28ec0 0x562870f2b2f0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f299c039ac0 msgr2=0x7f299c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f299c039ac0 0x7f299c03bf80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00aafd0 tx=0x7f2ac00a7000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 msgr2=0x562870dee860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1198981088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870f0c520 0x562870dee860 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4007ea0 tx=0x7f2ac400dee0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2accf0f640 1 -- 172.21.15.117:0/1198981088 reap_dead start 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 shutdown_connections 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 >> 172.21.15.117:0/1198981088 conn(0x562870f07940 msgr2=0x562870f05b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 shutdown_connections 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1198981088 wait complete. 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 msgr2=0x7f29a403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 0x7f29a403bf80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x562870ee2470 tx=0x7f2ac0005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 msgr2=0x562870eff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404e970 tx=0x7f2ac4012ea0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 shutdown_connections 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29a4039ac0 0x7f29a403bf80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/3523678185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870efee10 0x562870eff230 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 >> 172.21.15.117:0/3523678185 conn(0x562870ef47c0 msgr2=0x562870ef4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 shutdown_connections 2024-09-10T06:23:17.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/3523678185 wait complete. 2024-09-10T06:23:17.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870df28c0 msgr2=0x562870ee8120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562870df28c0 0x562870ee8120 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870eea8a0 msgr2=0x562870eecc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562870eea8a0 0x562870eecc90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870eee7e0 msgr2=0x562870ef0bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562870eee7e0 0x562870ef0bd0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29b4039ac0 msgr2=0x7f29b403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.213+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f29b4039ac0 0x7f29b403bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00ac000 tx=0x7f2ac00a5000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 msgr2=0x562870ee0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 --2- 172.21.15.117:0/1477858754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562870d62770 0x562870ee0fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000f90 tx=0x7f2ac4001260 comp rx=0 tx=0).stop 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2accf0f640 1 -- 172.21.15.117:0/1477858754 reap_dead start 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 shutdown_connections 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 >> 172.21.15.117:0/1477858754 conn(0x562870de8e90 msgr2=0x562870ed4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 shutdown_connections 2024-09-10T06:23:17.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.217+0000 7f2acec089c0 1 -- 172.21.15.117:0/1477858754 wait complete. 2024-09-10T06:23:17.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T06:23:17.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T06:23:17.231 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-10T06:23:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.309+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.309+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.309+0000 7f72a30ee9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55936773c370 0x55936773c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.309+0000 7f72a30ee9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5593675f19c0 con 0x55936773f550 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.309+0000 7f72a30ee9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5593676416d0 con 0x55936773c370 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55936773c370 0x55936773c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55936773c370 0x55936773c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43684/0 (socket says 172.21.15.117:43684) 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a03f3640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55936773f550 0x559367741940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55910/0 (socket says 172.21.15.117:55910) 2024-09-10T06:23:17.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3481217863 learned_addr learned my addr 172.21.15.117:0/3481217863 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3481217863 >> v1:172.21.15.84:6789/0 conn(0x55936773f550 legacy=0x559367741940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3481217863 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593675e5ca0 con 0x55936773c370 2024-09-10T06:23:17.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/3481217863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936773c750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f729800a4e0 tx=0x7f729801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8bc416afc1f7cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f729fbf2640 1 -- 172.21.15.117:0/3481217863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980aa540 con 0x55936773c370 2024-09-10T06:23:17.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f729fbf2640 1 -- 172.21.15.117:0/3481217863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980aa6e0 con 0x55936773c370 2024-09-10T06:23:17.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.313+0000 7f729fbf2640 1 -- 172.21.15.117:0/3481217863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980aaa40 con 0x55936773c370 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3481217863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 msgr2=0x55936773c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3481217863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936773c750 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f729800a4e0 tx=0x7f729801b090 comp rx=0 tx=0).stop 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3481217863 shutdown_connections 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3481217863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936773c750 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3481217863 >> 172.21.15.117:0/3481217863 conn(0x559367737e90 msgr2=0x55936773a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3481217863 shutdown_connections 2024-09-10T06:23:17.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.317+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3481217863 wait complete. 2024-09-10T06:23:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367645680 con 0x55936773c370 2024-09-10T06:23:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43688/0 (socket says 172.21.15.117:43688) 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a0bf4640 1 -- 172.21.15.117:0/1581415716 learned_addr learned my addr 172.21.15.117:0/1581415716 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a0bf4640 1 -- 172.21.15.117:0/1581415716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593675c0da0 con 0x55936773c370 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/1581415716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7298019740 tx=0x7f72980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dc59579d6a555d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f718ee0d640 1 -- 172.21.15.117:0/1581415716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980c1070 con 0x55936773c370 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f718ee0d640 1 -- 172.21.15.117:0/1581415716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980aaa10 con 0x55936773c370 2024-09-10T06:23:17.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f718ee0d640 1 -- 172.21.15.117:0/1581415716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980aacf0 con 0x55936773c370 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/1581415716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 msgr2=0x559367827660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/1581415716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7298019740 tx=0x7f72980033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/1581415716 shutdown_connections 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/1581415716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x559367827660 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/1581415716 >> 172.21.15.117:0/1581415716 conn(0x559367737e90 msgr2=0x5593678232e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/1581415716 shutdown_connections 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/1581415716 wait complete. 2024-09-10T06:23:17.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936782daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.333+0000 7f72a30ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5593675e7a50 con 0x55936773c370 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936782daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936782daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43702/0 (socket says 172.21.15.117:43702) 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2268635959 learned_addr learned my addr 172.21.15.117:0/2268635959 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936782e000 con 0x55936773c370 2024-09-10T06:23:17.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936782daa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7298000f90 tx=0x7f7298017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 -- 172.21.15.117:0/2268635959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980ca020 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 -- 172.21.15.117:0/2268635959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980c2040 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55936782e290 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 -- 172.21.15.117:0/2268635959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980c1070 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936782ec40 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 -- 172.21.15.117:0/2268635959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f72980c6440 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7188039a70 0x7f718803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f718d60a640 1 -- 172.21.15.117:0/2268635959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f72980b8030 con 0x55936773c370 2024-09-10T06:23:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7188039a70 0x7f718803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936773f550 0x559367834c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367835150 con 0x55936773f550 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a13f5640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936773f550 0x559367834c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7188039a70 0x7f718803bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7288001e90 tx=0x7f72880013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a13f5640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936773f550 0x559367834c10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a13f5640 1 -- 172.21.15.117:0/2268635959 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72900083f0 con 0x55936773f550 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.337+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678355c0 con 0x55936773f550 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a13f5640 1 -- 172.21.15.117:0/2268635959 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72900083f0 con 0x55936773f550 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5593678373d0 0x5593678397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367839e90 con 0x5593678373d0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5593678373d0 0x5593678397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5593678373d0 0x5593678397c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2268635959 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72980cc020 con 0x5593678373d0 2024-09-10T06:23:17.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367836270 con 0x55936773f550 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a13f5640 1 -- 172.21.15.117:0/2268635959 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72900083f0 con 0x55936773f550 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55936783b2d0 0x55936783d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936783de30 con 0x55936783b2d0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55936783b2d0 0x55936783d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55936783b2d0 0x55936783d6c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a03f3640 1 -- 172.21.15.117:0/2268635959 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f728800f6e0 con 0x55936783b2d0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a30ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367652450 con 0x55936784b8f0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43706/0 (socket says 172.21.15.117:43706) 2024-09-10T06:23:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.341+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2646177778 learned_addr learned my addr 172.21.15.117:0/2646177778 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2646177778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936784c350 con 0x55936784b8f0 2024-09-10T06:23:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72980bb590 tx=0x7f72980cfda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 -- 172.21.15.117:0/2646177778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980c68b0 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 -- 172.21.15.117:0/2646177778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980c6a50 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55936784cbb0 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 -- 172.21.15.117:0/2646177778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980c6d70 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936784d120 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 -- 172.21.15.117:0/2646177778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f72980f2030 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 0x7f717803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f71867fc640 1 -- 172.21.15.117:0/2646177778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f72980e7bf0 con 0x55936784b8f0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 0x7f717803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a03f3640 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 0x7f717803bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55936783e230 tx=0x7f728800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a30ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367827df0 con 0x559367858ff0 2024-09-10T06:23:17.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43710/0 (socket says 172.21.15.117:43710) 2024-09-10T06:23:17.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2618574056 learned_addr learned my addr 172.21.15.117:0/2618574056 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.345+0000 7f72a0bf4640 1 -- 172.21.15.117:0/2618574056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593678599e0 con 0x559367858ff0 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/2618574056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72980ab450 tx=0x7f72980dac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4312094d9dfae60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f7177fff640 1 -- 172.21.15.117:0/2618574056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980acd10 con 0x559367858ff0 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f7177fff640 1 -- 172.21.15.117:0/2618574056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980a93c0 con 0x559367858ff0 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f7177fff640 1 -- 172.21.15.117:0/2618574056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980ce8d0 con 0x559367858ff0 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2618574056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 msgr2=0x5593678593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2618574056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72980ab450 tx=0x7f72980dac50 comp rx=0 tx=0).stop 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2618574056 shutdown_connections 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2618574056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x5593678593f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2618574056 >> 172.21.15.117:0/2618574056 conn(0x559367854410 msgr2=0x559367852650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2618574056 shutdown_connections 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2618574056 wait complete. 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 Processor -- start 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- start start 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367857dc0 con 0x559367858ff0 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43720/0 (socket says 172.21.15.117:43720) 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 learned_addr learned my addr 172.21.15.117:0/3740493572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559367863bf0 con 0x559367858ff0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72980ea190 tx=0x7f72980caf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f71767fc640 1 -- 172.21.15.117:0/3740493572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298110070 con 0x559367858ff0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559367863bf0 con 0x559367858ff0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f71767fc640 1 -- 172.21.15.117:0/3740493572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72980ce8d0 con 0x559367858ff0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559367863bf0 con 0x559367858ff0 2024-09-10T06:23:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.349+0000 7f71767fc640 1 -- 172.21.15.117:0/3740493572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72980dbd60 con 0x559367858ff0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f71767fc640 1 -- 172.21.15.117:0/3740493572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7298113070 con 0x559367858ff0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f71767fc640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f716c039a70 0x7f716c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f71767fc640 1 -- 172.21.15.117:0/3740493572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7298107030 con 0x559367858ff0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a03f3640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f716c039a70 0x7f716c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936786e850 0x559367870d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367871460 con 0x55936786e850 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936786e850 0x559367870d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a03f3640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f716c039a70 0x7f716c03bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7288001ec0 tx=0x7f7288010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936786e850 0x559367870d10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72900083f0 con 0x55936786e850 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 realm 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367871870 con 0x55936786e850 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72900083f0 con 0x55936786e850 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367872140 con 0x55936786e850 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72900083f0 con 0x55936786e850 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72900083f0 con 0x55936786e850 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559367873240 0x559367875630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367875bf0 con 0x559367873240 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559367873240 0x559367875630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559367873240 0x559367875630 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.353+0000 7f72a30ee9c0 20 searching for the correct realm 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559367877b40 0x559367879f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936787a620 con 0x559367877b40 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a03f3640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559367877b40 0x559367879f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a03f3640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559367877b40 0x559367879f50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936787a620 con 0x559367873240 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a0bf4640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7298115060 0x7f7298007240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936787a620 con 0x7f7298115060 2024-09-10T06:23:17.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7298115060 0x7f7298007240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7298115060 0x7f7298007240 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900083f0 con 0x7f7298115060 2024-09-10T06:23:17.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72900083f0 con 0x55936786e850 2024-09-10T06:23:17.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.357+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367873240 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367873240 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.361+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367873240 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.365+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367873240 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367877b40 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x7f7298115060 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x55936786e850 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5593678724e0 con 0x559367873240 2024-09-10T06:23:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678764b0 con 0x55936786e850 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678768a0 con 0x55936786e850 2024-09-10T06:23:17.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678768a0 con 0x559367877b40 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 zone default found 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 4 Realm: () 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 zonegroup default 2024-09-10T06:23:17.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936787aaa0 con 0x7f7298115060 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936787c590 con 0x559367877b40 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.369+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936787ca90 con 0x559367877b40 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 20 started sync module instance, tier type = 2024-09-10T06:23:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787b930 con 0x559367873240 2024-09-10T06:23:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94091585502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787b590 con 0x559367873240 2024-09-10T06:23:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787d9c0 con 0x55936786e850 2024-09-10T06:23:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94091585502496] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94091585508624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787dde0 con 0x55936786e850 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.373+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787e7a0 con 0x559367877b40 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94091585508624] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94091585509680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787dd50 con 0x559367877b40 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787f4a0 con 0x559367873240 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94091585515808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787fd70 con 0x559367873240 2024-09-10T06:23:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.377+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367880730 con 0x55936786e850 2024-09-10T06:23:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94091585509680] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94091585515808] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94091585520256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787fd70 con 0x55936786e850 2024-09-10T06:23:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678806a0 con 0x7f7298115060 2024-09-10T06:23:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94091585520256] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.381+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94091585517760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787fce0 con 0x7f7298115060 2024-09-10T06:23:17.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.385+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367881430 con 0x7f7298115060 2024-09-10T06:23:17.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.385+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94091585517760] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.385+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.385+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94091585522320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367881360 con 0x7f7298115060 2024-09-10T06:23:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.385+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367881e20 con 0x7f7298115060 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94091585526000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367881de0 con 0x7f7298115060 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=0 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=1 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=2 2024-09-10T06:23:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=3 2024-09-10T06:23:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=4 2024-09-10T06:23:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=5 2024-09-10T06:23:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94091585522320] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=6 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94091585526000] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 20 add_watcher() i=7 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559367880eb0 con 0x55936786e850 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94091585528256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559367880eb0 con 0x55936786e850 2024-09-10T06:23:17.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.389+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94091585528256] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f71577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 5 note: GC not initialized 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f71567e4640 20 reqs_thread_entry: start 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 Filter name: none 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f714f7fe640 20 reqs_thread_entry: start 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:23:17.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678a8920 con 0x55936786e850 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678aee70 con 0x55936786e850 2024-09-10T06:23:17.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:23:17.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94091585710304 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5593678aa7c0 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== watch-notify(notify (1) cookie 94091585520256 notify 137438953490 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f7290010040 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f7177fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94091585520256 notifier 4652 bl.length()=579 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(64 notify.4 [notify cookie 94091585710304 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f7177fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f7177fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f7177fff640 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7164003eb0 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.393+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== watch-notify(notify_complete (2) cookie 94091585710304 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f729000ad50 con 0x55936786e850 2024-09-10T06:23:17.398 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:23:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f71577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94091585528256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678a6680 con 0x55936786e850 2024-09-10T06:23:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94091585528256] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94091585502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678a6680 con 0x559367873240 2024-09-10T06:23:17.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94091585502496] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a30ee9c0 20 remove_watcher() i=0 2024-09-10T06:23:17.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a30ee9c0 2 removed watcher, disabling cache 2024-09-10T06:23:17.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.397+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94091585508624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678a6680 con 0x55936786e850 2024-09-10T06:23:17.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94091585508624] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a30ee9c0 20 remove_watcher() i=1 2024-09-10T06:23:17.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94091585509680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5593678a6680 con 0x559367877b40 2024-09-10T06:23:17.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a03f3640 1 -- 172.21.15.117:0/3740493572 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94091585509680] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288037040 con 0x559367877b40 2024-09-10T06:23:17.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a30ee9c0 20 remove_watcher() i=2 2024-09-10T06:23:17.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.401+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94091585515808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787bd20 con 0x559367873240 2024-09-10T06:23:17.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a0bf4640 1 -- 172.21.15.117:0/3740493572 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94091585515808] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7298112030 con 0x559367873240 2024-09-10T06:23:17.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a30ee9c0 20 remove_watcher() i=3 2024-09-10T06:23:17.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94091585520256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787bd20 con 0x55936786e850 2024-09-10T06:23:17.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94091585520256] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x55936786e850 2024-09-10T06:23:17.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a30ee9c0 20 remove_watcher() i=4 2024-09-10T06:23:17.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.405+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94091585517760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787bd20 con 0x7f7298115060 2024-09-10T06:23:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94091585517760] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a30ee9c0 20 remove_watcher() i=5 2024-09-10T06:23:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94091585522320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787f8c0 con 0x7f7298115060 2024-09-10T06:23:17.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94091585522320] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a30ee9c0 20 remove_watcher() i=6 2024-09-10T06:23:17.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.409+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94091585526000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936787bd20 con 0x7f7298115060 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94091585526000] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7290026040 con 0x7f7298115060 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 20 remove_watcher() i=7 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7298115060 msgr2=0x7f7298007240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f7298115060 0x7f7298007240 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936786e850 msgr2=0x559367870d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936786e850 0x559367870d10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559367873240 msgr2=0x559367875630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x559367873240 0x559367875630 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559367877b40 msgr2=0x559367879f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x559367877b40 0x559367879f50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f716c039a70 msgr2=0x7f716c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f716c039a70 0x7f716c03bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7288001ec0 tx=0x7f7288010000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 msgr2=0x559367863690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72980ea190 tx=0x7f72980caf60 comp rx=0 tx=0).stop 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a13f5640 1 -- 172.21.15.117:0/3740493572 reap_dead start 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 shutdown_connections 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/3740493572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367858ff0 0x559367863690 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 >> 172.21.15.117:0/3740493572 conn(0x559367854410 msgr2=0x559367852620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 shutdown_connections 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/3740493572 wait complete. 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 msgr2=0x7f717803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 0x7f717803bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55936783e230 tx=0x7f728800f000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 msgr2=0x55936784bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72980bb590 tx=0x7f72980cfda0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 shutdown_connections 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7178039ac0 0x7f717803bf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2646177778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936784b8f0 0x55936784bd10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 >> 172.21.15.117:0/2646177778 conn(0x5593678412a0 msgr2=0x559367841680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 shutdown_connections 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2646177778 wait complete. 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936773f550 msgr2=0x559367834c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55936773f550 0x559367834c10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5593678373d0 msgr2=0x5593678397c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5593678373d0 0x5593678397c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55936783b2d0 msgr2=0x55936783d6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55936783b2d0 0x55936783d6c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7188039a70 msgr2=0x7f718803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7188039a70 0x7f718803bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7288001e90 tx=0x7f72880013f0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 msgr2=0x55936782daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 --2- 172.21.15.117:0/2268635959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55936773c370 0x55936782daa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7298000f90 tx=0x7f7298017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a13f5640 1 -- 172.21.15.117:0/2268635959 reap_dead start 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 shutdown_connections 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 >> 172.21.15.117:0/2268635959 conn(0x559367737e90 msgr2=0x559367821d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 shutdown_connections 2024-09-10T06:23:17.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.413+0000 7f72a30ee9c0 1 -- 172.21.15.117:0/2268635959 wait complete. 2024-09-10T06:23:17.426 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:23:17.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T06:23:17.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T06:23:17.427 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-10T06:23:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.501+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d7ddc9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557968c8d8c0 0x557968c8fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d7ddc9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557968b3b9c0 con 0x557968c89770 2024-09-10T06:23:17.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d7ddc9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x557968b8b6d0 con 0x557968c8d8c0 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d50e1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557968c8d8c0 0x557968c8fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d58e2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x557968c89770 0x557968c89b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:55918/0 (socket says 172.21.15.117:55918) 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d50e1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557968c8d8c0 0x557968c8fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43736/0 (socket says 172.21.15.117:43736) 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d58e2640 1 -- 172.21.15.117:0/3680347882 learned_addr learned my addr 172.21.15.117:0/3680347882 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d50e1640 1 -- 172.21.15.117:0/3680347882 >> v1:172.21.15.84:6789/0 conn(0x557968c89770 legacy=0x557968c89b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d50e1640 1 -- 172.21.15.117:0/3680347882 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968b2fca0 con 0x557968c8d8c0 2024-09-10T06:23:17.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d50e1640 1 --2- 172.21.15.117:0/3680347882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c8d8c0 0x557968c8fcb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f05c000a480 tx=0x7f05c001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61939f8cbf89914 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d48e0640 1 -- 172.21.15.117:0/3680347882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c00aa570 con 0x557968c8d8c0 2024-09-10T06:23:17.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d48e0640 1 -- 172.21.15.117:0/3680347882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c00af070 con 0x557968c8d8c0 2024-09-10T06:23:17.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.505+0000 7f05d48e0640 1 -- 172.21.15.117:0/3680347882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c00aa860 con 0x557968c8d8c0 2024-09-10T06:23:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3680347882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c8d8c0 msgr2=0x557968c8fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3680347882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c8d8c0 0x557968c8fcb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f05c000a480 tx=0x7f05c001b310 comp rx=0 tx=0).stop 2024-09-10T06:23:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3680347882 shutdown_connections 2024-09-10T06:23:17.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3680347882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c8d8c0 0x557968c8fcb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3680347882 >> 172.21.15.117:0/3680347882 conn(0x557968bfd080 msgr2=0x557968bfd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3680347882 shutdown_connections 2024-09-10T06:23:17.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.509+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3680347882 wait complete. 2024-09-10T06:23:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557968b8f680 con 0x557968c89770 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43738/0 (socket says 172.21.15.117:43738) 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 -- 172.21.15.117:0/1455562709 learned_addr learned my addr 172.21.15.117:0/1455562709 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 -- 172.21.15.117:0/1455562709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968b0ada0 con 0x557968c89770 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 --2- 172.21.15.117:0/1455562709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f05d00017b0 tx=0x7f05d0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e2bcf0a23b63e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f04c3e07640 1 -- 172.21.15.117:0/1455562709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d00044f0 con 0x557968c89770 2024-09-10T06:23:17.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f04c3e07640 1 -- 172.21.15.117:0/1455562709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00046b0 con 0x557968c89770 2024-09-10T06:23:17.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f04c3e07640 1 -- 172.21.15.117:0/1455562709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0004a10 con 0x557968c89770 2024-09-10T06:23:17.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/1455562709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 msgr2=0x557968d749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/1455562709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f05d00017b0 tx=0x7f05d0001c70 comp rx=0 tx=0).stop 2024-09-10T06:23:17.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/1455562709 shutdown_connections 2024-09-10T06:23:17.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/1455562709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d749b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/1455562709 >> 172.21.15.117:0/1455562709 conn(0x557968bfd080 msgr2=0x557968d70650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/1455562709 shutdown_connections 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/1455562709 wait complete. 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d7c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d7ddc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557968b31a50 con 0x557968c89770 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d7c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d7c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43746/0 (socket says 172.21.15.117:43746) 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.525+0000 7f05d58e2640 1 -- 172.21.15.117:0/376643858 learned_addr learned my addr 172.21.15.117:0/376643858 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d58e2640 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968d7c5b0 con 0x557968c89770 2024-09-10T06:23:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d58e2640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d7c050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f05d00012f0 tx=0x7f05d0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 -- 172.21.15.117:0/376643858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0013820 con 0x557968c89770 2024-09-10T06:23:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557968d7c840 con 0x557968c89770 2024-09-10T06:23:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 -- 172.21.15.117:0/376643858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00139c0 con 0x557968c89770 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 -- 172.21.15.117:0/376643858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0013ca0 con 0x557968c89770 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557968d7d1f0 con 0x557968c89770 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 -- 172.21.15.117:0/376643858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05d0010070 con 0x557968c89770 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04bc039a70 0x7f04bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f04c2604640 1 -- 172.21.15.117:0/376643858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f05d0018070 con 0x557968c89770 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d50e1640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04bc039a70 0x7f04bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968c8d8c0 0x557968d831c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968d83700 con 0x557968c8d8c0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d60e3640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968c8d8c0 0x557968d831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d50e1640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04bc039a70 0x7f04bc03bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05c00ae000 tx=0x7f05c00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d60e3640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968c8d8c0 0x557968d831c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d60e3640 1 -- 172.21.15.117:0/376643858 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c80083f0 con 0x557968c8d8c0 2024-09-10T06:23:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.529+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968d7d560 con 0x557968c8d8c0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d60e3640 1 -- 172.21.15.117:0/376643858 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c80083f0 con 0x557968c8d8c0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968d859a0 0x557968d87d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968d88460 con 0x557968d859a0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968d859a0 0x557968d87d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968d859a0 0x557968d87d90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 -- 172.21.15.117:0/376643858 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05d001b030 con 0x557968d859a0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968d84840 con 0x557968c8d8c0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d60e3640 1 -- 172.21.15.117:0/376643858 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c80083f0 con 0x557968c8d8c0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968d898a0 0x557968d8bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968d8c420 con 0x557968d898a0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d50e1640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968d898a0 0x557968d8bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d50e1640 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968d898a0 0x557968d8bc90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d50e1640 1 -- 172.21.15.117:0/376643858 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05c00a8070 con 0x557968d898a0 2024-09-10T06:23:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d7ddc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557968b9c450 con 0x557968d99ee0 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43760/0 (socket says 172.21.15.117:43760) 2024-09-10T06:23:17.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 -- 172.21.15.117:0/211303450 learned_addr learned my addr 172.21.15.117:0/211303450 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 -- 172.21.15.117:0/211303450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968d9a940 con 0x557968d99ee0 2024-09-10T06:23:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.533+0000 7f05d58e2640 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f05d004ea00 tx=0x7f05d0028e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 -- 172.21.15.117:0/211303450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0047070 con 0x557968d99ee0 2024-09-10T06:23:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557968d9b1a0 con 0x557968d99ee0 2024-09-10T06:23:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 -- 172.21.15.117:0/211303450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00500b0 con 0x557968d99ee0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 -- 172.21.15.117:0/211303450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d001da10 con 0x557968d99ee0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557968d9b710 con 0x557968d99ee0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 -- 172.21.15.117:0/211303450 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05d001dbb0 con 0x557968d99ee0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 0x7f04b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04bb7fe640 1 -- 172.21.15.117:0/211303450 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f05d004cba0 con 0x557968d99ee0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d50e1640 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 0x7f04b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d7ddc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557968d75200 con 0x557968da6610 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d50e1640 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 0x7f04b003bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05c00aa650 tx=0x7f05c0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43770/0 (socket says 172.21.15.117:43770) 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d58e2640 1 -- 172.21.15.117:0/3258280937 learned_addr learned my addr 172.21.15.117:0/3258280937 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d58e2640 1 -- 172.21.15.117:0/3258280937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968da6fc0 con 0x557968da6610 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f05d58e2640 1 --2- 172.21.15.117:0/3258280937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f05d00298b0 tx=0x7f05d001d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0ceb53242b30cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04b97fa640 1 -- 172.21.15.117:0/3258280937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d004ce60 con 0x557968da6610 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04b97fa640 1 -- 172.21.15.117:0/3258280937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0055070 con 0x557968da6610 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.537+0000 7f04b97fa640 1 -- 172.21.15.117:0/3258280937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0026320 con 0x557968da6610 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3258280937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 msgr2=0x557968da69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3258280937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f05d00298b0 tx=0x7f05d001d350 comp rx=0 tx=0).stop 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3258280937 shutdown_connections 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3258280937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968da69f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3258280937 >> 172.21.15.117:0/3258280937 conn(0x557968da2a40 msgr2=0x557968da0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3258280937 shutdown_connections 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3258280937 wait complete. 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 Processor -- start 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- start start 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968dad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557968da74a0 con 0x557968da6610 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968dad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d58e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968dad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43778/0 (socket says 172.21.15.117:43778) 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 learned_addr learned my addr 172.21.15.117:0/3538551711 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557968dade80 con 0x557968da6610 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d58e2640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968dad920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f05d004ee70 tx=0x7f05d0017f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f04a77fe640 1 -- 172.21.15.117:0/3538551711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d006c020 con 0x557968da6610 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557968dade80 con 0x557968da6610 2024-09-10T06:23:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f04a77fe640 1 -- 172.21.15.117:0/3538551711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00355b0 con 0x557968da6610 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f04a77fe640 1 -- 172.21.15.117:0/3538551711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d00283d0 con 0x557968da6610 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.541+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557968dae450 con 0x557968da6610 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f04a77fe640 1 -- 172.21.15.117:0/3538551711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05d006f020 con 0x557968da6610 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f04a77fe640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04a0039a70 0x7f04a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f04a77fe640 1 -- 172.21.15.117:0/3538551711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f05d0072bb0 con 0x557968da6610 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d50e1640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04a0039a70 0x7f04a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968db8ae0 0x557968dbafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dbb6f0 con 0x557968db8ae0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968db8ae0 0x557968dbafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d50e1640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04a0039a70 0x7f04a003bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cd040 tx=0x7f05c00a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968db8ae0 0x557968dbafa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c80083f0 con 0x557968db8ae0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 realm 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dbbb00 con 0x557968db8ae0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c80083f0 con 0x557968db8ae0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc3d0 con 0x557968db8ae0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c80083f0 con 0x557968db8ae0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c80083f0 con 0x557968db8ae0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968dbd4d0 0x557968dbf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dbfed0 con 0x557968dbd4d0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d58e2640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968dbd4d0 0x557968dbf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d58e2640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968dbd4d0 0x557968dbf8c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 20 searching for the correct realm 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968dc1e20 0x557968dc4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dc48b0 con 0x557968dc1e20 2024-09-10T06:23:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.545+0000 7f05d50e1640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968dc1e20 0x557968dc4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d50e1640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968dc1e20 0x557968dc4230 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dc48b0 con 0x557968dbd4d0 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d58e2640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f05d007c040 0x7f05d005c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dc48b0 con 0x7f05d007c040 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f05d007c040 0x7f05d005c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f05d007c040 0x7f05d005c480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c80083f0 con 0x7f05d007c040 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c80083f0 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.549+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dbd4d0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dbd4d0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.553+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dbd4d0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dbd4d0 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dc1e20 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.557+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x7f05d007c040 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968db8ae0 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557968dbc770 con 0x557968dbd4d0 2024-09-10T06:23:17.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc0790 con 0x557968db8ae0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc0b80 con 0x557968db8ae0 2024-09-10T06:23:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc0b80 con 0x557968dc1e20 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 zone default found 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 4 Realm: () 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 zonegroup default 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc4d30 con 0x7f05d007c040 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc6820 con 0x557968dc1e20 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dc6c90 con 0x557968dc1e20 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 started sync module instance, tier type = 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:17.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.561+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc5bc0 con 0x557968dbd4d0 2024-09-10T06:23:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93979938676656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc5820 con 0x557968dbd4d0 2024-09-10T06:23:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc7ba0 con 0x557968db8ae0 2024-09-10T06:23:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93979938676656] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93979938681040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc7ba0 con 0x557968db8ae0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.565+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc8560 con 0x557968dc1e20 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93979938681040] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93979938682608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc7b10 con 0x557968dc1e20 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc92f0 con 0x557968dbd4d0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93979938688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc9b90 con 0x557968dbd4d0 2024-09-10T06:23:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dca590 con 0x557968db8ae0 2024-09-10T06:23:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.569+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93979938682608] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93979938688512] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93979938687312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc96e0 con 0x557968db8ae0 2024-09-10T06:23:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcae30 con 0x7f05d007c040 2024-09-10T06:23:17.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93979938687312] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93979938693280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc96e0 con 0x7f05d007c040 2024-09-10T06:23:17.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.573+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcb2e0 con 0x7f05d007c040 2024-09-10T06:23:17.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93979938693280] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93979938695120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcb2a0 con 0x7f05d007c040 2024-09-10T06:23:17.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcbca0 con 0x7f05d007c040 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93979938699184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcc0e0 con 0x7f05d007c040 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=0 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=1 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=2 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=3 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=4 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=5 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93979938695120] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.577+0000 7f05d7ddc9c0 20 add_watcher() i=6 2024-09-10T06:23:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93979938699184] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 add_watcher() i=7 2024-09-10T06:23:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968dcadf0 con 0x557968db8ae0 2024-09-10T06:23:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93979938696688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dcc5f0 con 0x557968db8ae0 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93979938696688] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f04877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 5 note: GC not initialized 2024-09-10T06:23:17.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f04867fc640 20 reqs_thread_entry: start 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 Filter name: none 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f03f7fff640 20 reqs_thread_entry: start 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.581+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968df27e0 con 0x557968db8ae0 2024-09-10T06:23:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-10T06:23:17.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:23:17.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:17.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df8d80 con 0x557968db8ae0 2024-09-10T06:23:17.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:23:17.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93979938883568 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557968df4680 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== watch-notify(notify (1) cookie 93979938687312 notify 137438953491 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f05c8010040 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f04b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 93979938687312 notifier 4659 bl.length()=567 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f04b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f04b97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f04b97fa640 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0498003eb0 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(64 notify.4 [notify cookie 93979938883568 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 93979938883568 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05c800aaf0 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.589 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T06:22:50.966515Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:22:50.966502Z","tags":[],"group_ids":[]} 2024-09-10T06:23:17.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.585+0000 7f04877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93979938696688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df0510 con 0x557968db8ae0 2024-09-10T06:23:17.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93979938696688] v32'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93979938676656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df0510 con 0x557968dbd4d0 2024-09-10T06:23:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93979938676656] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d7ddc9c0 20 remove_watcher() i=0 2024-09-10T06:23:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d7ddc9c0 2 removed watcher, disabling cache 2024-09-10T06:23:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.589+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93979938681040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df0510 con 0x557968db8ae0 2024-09-10T06:23:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93979938681040] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 20 remove_watcher() i=1 2024-09-10T06:23:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93979938682608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc70d0 con 0x557968dc1e20 2024-09-10T06:23:17.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d50e1640 1 -- 172.21.15.117:0/3538551711 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93979938682608] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c00a8070 con 0x557968dc1e20 2024-09-10T06:23:17.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 20 remove_watcher() i=2 2024-09-10T06:23:17.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93979938688512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df0510 con 0x557968dbd4d0 2024-09-10T06:23:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d58e2640 1 -- 172.21.15.117:0/3538551711 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93979938688512] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d001b030 con 0x557968dbd4d0 2024-09-10T06:23:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 20 remove_watcher() i=3 2024-09-10T06:23:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.593+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93979938687312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc76f0 con 0x557968db8ae0 2024-09-10T06:23:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93979938687312] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x557968db8ae0 2024-09-10T06:23:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d7ddc9c0 20 remove_watcher() i=4 2024-09-10T06:23:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93979938693280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc70d0 con 0x7f05d007c040 2024-09-10T06:23:17.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93979938693280] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d7ddc9c0 20 remove_watcher() i=5 2024-09-10T06:23:17.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.597+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93979938695120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968df0510 con 0x7f05d007c040 2024-09-10T06:23:17.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.601+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93979938695120] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.601+0000 7f05d7ddc9c0 20 remove_watcher() i=6 2024-09-10T06:23:17.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.601+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93979938699184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557968dc76f0 con 0x7f05d007c040 2024-09-10T06:23:17.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93979938699184] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8026040 con 0x7f05d007c040 2024-09-10T06:23:17.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 20 remove_watcher() i=7 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f05d007c040 msgr2=0x7f05d005c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f05d007c040 0x7f05d005c480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968db8ae0 msgr2=0x557968dbafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968db8ae0 0x557968dbafa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968dbd4d0 msgr2=0x557968dbf8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968dbd4d0 0x557968dbf8c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968dc1e20 msgr2=0x557968dc4230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968dc1e20 0x557968dc4230 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04a0039a70 msgr2=0x7f04a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04a0039a70 0x7f04a003bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cd040 tx=0x7f05c00a8000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 msgr2=0x557968dad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/3538551711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968da6610 0x557968dad920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f05d004ee70 tx=0x7f05d0017f30 comp rx=0 tx=0).stop 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 reap_dead start 2024-09-10T06:23:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d60e3640 1 -- 172.21.15.117:0/3538551711 reap_dead start 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 shutdown_connections 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 >> 172.21.15.117:0/3538551711 conn(0x557968da2a40 msgr2=0x557968da0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 shutdown_connections 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/3538551711 wait complete. 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 msgr2=0x7f04b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 0x7f04b003bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05c00aa650 tx=0x7f05c0005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 msgr2=0x557968d9a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f05d004ea00 tx=0x7f05d0028e60 comp rx=0 tx=0).stop 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 shutdown_connections 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04b0039a70 0x7f04b003bf30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/211303450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968d99ee0 0x557968d9a300 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 >> 172.21.15.117:0/211303450 conn(0x557968d8f890 msgr2=0x557968d8fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 shutdown_connections 2024-09-10T06:23:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/211303450 wait complete. 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968c8d8c0 msgr2=0x557968d831c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557968c8d8c0 0x557968d831c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968d859a0 msgr2=0x557968d87d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557968d859a0 0x557968d87d90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968d898a0 msgr2=0x557968d8bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557968d898a0 0x557968d8bc90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04bc039a70 msgr2=0x7f04bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f04bc039a70 0x7f04bc03bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05c00ae000 tx=0x7f05c00a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 msgr2=0x557968d7c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 --2- 172.21.15.117:0/376643858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557968c89770 0x557968d7c050 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f05d00012f0 tx=0x7f05d0000f50 comp rx=0 tx=0).stop 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d60e3640 1 -- 172.21.15.117:0/376643858 reap_dead start 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 shutdown_connections 2024-09-10T06:23:17.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 >> 172.21.15.117:0/376643858 conn(0x557968bfd080 msgr2=0x557968d6f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 shutdown_connections 2024-09-10T06:23:17.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.605+0000 7f05d7ddc9c0 1 -- 172.21.15.117:0/376643858 wait complete. 2024-09-10T06:23:17.619 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T06:22:50.966515Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:22:50.966502Z', 'tags': [], 'group_ids': []} 2024-09-10T06:23:17.635 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:17.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T06:23:17.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T06:23:17.636 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T06:23:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f350b4e99c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56252aca3880 0x56252aca5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f350b4e99c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56252ab539c0 con 0x56252ac137b0 2024-09-10T06:23:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f350b4e99c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56252aba36d0 con 0x56252aca3880 2024-09-10T06:23:17.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f35087ee640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56252aca3880 0x56252aca5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f35087ee640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56252aca3880 0x56252aca5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43786/0 (socket says 172.21.15.117:43786) 2024-09-10T06:23:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f35087ee640 1 -- 172.21.15.117:0/2970269466 learned_addr learned my addr 172.21.15.117:0/2970269466 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f35087ee640 1 -- 172.21.15.117:0/2970269466 >> v1:172.21.15.84:6789/0 conn(0x56252ac137b0 legacy=0x56252aca2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.693+0000 7f35087ee640 1 -- 172.21.15.117:0/2970269466 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252ab47ca0 con 0x56252aca3880 2024-09-10T06:23:17.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f35087ee640 1 --2- 172.21.15.117:0/2970269466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252aca3880 0x56252aca5c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00a5c0 tx=0x7f34fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb389f8398017564 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f3507fed640 1 -- 172.21.15.117:0/2970269466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34fc0b1070 con 0x56252aca3880 2024-09-10T06:23:17.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f3507fed640 1 -- 172.21.15.117:0/2970269466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc0a8070 con 0x56252aca3880 2024-09-10T06:23:17.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f3507fed640 1 -- 172.21.15.117:0/2970269466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34fc0ac5b0 con 0x56252aca3880 2024-09-10T06:23:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2970269466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252aca3880 msgr2=0x56252aca5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/2970269466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252aca3880 0x56252aca5c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00a5c0 tx=0x7f34fc01b340 comp rx=0 tx=0).stop 2024-09-10T06:23:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2970269466 shutdown_connections 2024-09-10T06:23:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/2970269466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252aca3880 0x56252aca5c70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2970269466 >> 172.21.15.117:0/2970269466 conn(0x56252ac99e90 msgr2=0x56252ac9c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2970269466 shutdown_connections 2024-09-10T06:23:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.697+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2970269466 wait complete. 2024-09-10T06:23:17.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56252aba7680 con 0x56252ac137b0 2024-09-10T06:23:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43800/0 (socket says 172.21.15.117:43800) 2024-09-10T06:23:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f3508fef640 1 -- 172.21.15.117:0/3520735326 learned_addr learned my addr 172.21.15.117:0/3520735326 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f3508fef640 1 -- 172.21.15.117:0/3520735326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252ab22da0 con 0x56252ac137b0 2024-09-10T06:23:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f3508fef640 1 --2- 172.21.15.117:0/3520735326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f34f800b220 tx=0x7f34f800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d95adc6c53d0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f33f6e0d640 1 -- 172.21.15.117:0/3520735326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f800a040 con 0x56252ac137b0 2024-09-10T06:23:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f33f6e0d640 1 -- 172.21.15.117:0/3520735326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f800f750 con 0x56252ac137b0 2024-09-10T06:23:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f33f6e0d640 1 -- 172.21.15.117:0/3520735326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f800fa70 con 0x56252ac137b0 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- 172.21.15.117:0/3520735326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 msgr2=0x56252ac9f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/3520735326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f34f800b220 tx=0x7f34f800b6e0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- 172.21.15.117:0/3520735326 shutdown_connections 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/3520735326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ac9f660 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- 172.21.15.117:0/3520735326 >> 172.21.15.117:0/3520735326 conn(0x56252ac99e90 msgr2=0x56252ad865b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- 172.21.15.117:0/3520735326 shutdown_connections 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.713+0000 7f350b4e99c0 1 -- 172.21.15.117:0/3520735326 wait complete. 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ad941c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56252ab49a50 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ad941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ad941c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43808/0 (socket says 172.21.15.117:43808) 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f3508fef640 1 -- 172.21.15.117:0/737111011 learned_addr learned my addr 172.21.15.117:0/737111011 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f3508fef640 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252ad94720 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f3508fef640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ad941c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x56252ac9f220 tx=0x7f34f8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 -- 172.21.15.117:0/737111011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f801a880 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 -- 172.21.15.117:0/737111011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f801aa20 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56252ad949b0 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 -- 172.21.15.117:0/737111011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f801ad00 con 0x56252ac137b0 2024-09-10T06:23:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252ad95360 con 0x56252ac137b0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 -- 172.21.15.117:0/737111011 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34f8017050 con 0x56252ac137b0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33f0039a70 0x7f33f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f33f560a640 1 -- 172.21.15.117:0/737111011 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34f8015020 con 0x56252ac137b0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f35087ee640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33f0039a70 0x7f33f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252aca3880 0x56252ad9b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ad9b870 con 0x56252aca3880 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.717+0000 7f35097f0640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252aca3880 0x56252ad9b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35087ee640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33f0039a70 0x7f33f003bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ae000 tx=0x7f34fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35097f0640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252aca3880 0x56252ad9b330 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35097f0640 1 -- 172.21.15.117:0/737111011 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252aca3880 2024-09-10T06:23:17.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ad9bca0 con 0x56252aca3880 2024-09-10T06:23:17.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35097f0640 1 -- 172.21.15.117:0/737111011 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f350000a4d0 con 0x56252aca3880 2024-09-10T06:23:17.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252ad9dab0 0x56252ad9fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ada0570 con 0x56252ad9dab0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f3508fef640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252ad9dab0 0x56252ad9fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f3508fef640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252ad9dab0 0x56252ad9fea0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f3508fef640 1 -- 172.21.15.117:0/737111011 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34f802e070 con 0x56252ad9dab0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ad9c950 con 0x56252aca3880 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35097f0640 1 -- 172.21.15.117:0/737111011 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f350000a4d0 con 0x56252aca3880 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252ada19b0 0x56252ada3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ada4510 con 0x56252ada19b0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35087ee640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252ada19b0 0x56252ada3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35087ee640 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252ada19b0 0x56252ada3da0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f35087ee640 1 -- 172.21.15.117:0/737111011 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34fc0be040 con 0x56252ada19b0 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.721+0000 7f350b4e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56252abb4450 con 0x56252adb1fd0 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43822/0 (socket says 172.21.15.117:43822) 2024-09-10T06:23:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 -- 172.21.15.117:0/819666964 learned_addr learned my addr 172.21.15.117:0/819666964 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 -- 172.21.15.117:0/819666964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252adb2a30 con 0x56252adb1fd0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f34f8018ce0 tx=0x7f34f800e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 -- 172.21.15.117:0/819666964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f800e870 con 0x56252adb1fd0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 -- 172.21.15.117:0/819666964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f804d3a0 con 0x56252adb1fd0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56252adb3290 con 0x56252adb1fd0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 -- 172.21.15.117:0/819666964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f804d6a0 con 0x56252adb1fd0 2024-09-10T06:23:17.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252adb3800 con 0x56252adb1fd0 2024-09-10T06:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 -- 172.21.15.117:0/819666964 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34f80509a0 con 0x56252adb1fd0 2024-09-10T06:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 0x7f33e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f33ee7fc640 1 -- 172.21.15.117:0/819666964 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34f8041e00 con 0x56252adb1fd0 2024-09-10T06:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f35087ee640 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 0x7f33e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f35087ee640 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 0x7f33e003bf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ac890 tx=0x7f34fc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f350b4e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56252ac9feb0 con 0x56252adbf800 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.725+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43838/0 (socket says 172.21.15.117:43838) 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 -- 172.21.15.117:0/2440845909 learned_addr learned my addr 172.21.15.117:0/2440845909 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 -- 172.21.15.117:0/2440845909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252adc01b0 con 0x56252adbf800 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 --2- 172.21.15.117:0/2440845909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34f804da40 tx=0x7f34f8031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a82ed45496da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33dffff640 1 -- 172.21.15.117:0/2440845909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f8062070 con 0x56252adbf800 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33dffff640 1 -- 172.21.15.117:0/2440845909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f8055070 con 0x56252adbf800 2024-09-10T06:23:17.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33dffff640 1 -- 172.21.15.117:0/2440845909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f8057070 con 0x56252adbf800 2024-09-10T06:23:17.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2440845909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 msgr2=0x56252adbfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/2440845909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34f804da40 tx=0x7f34f8031480 comp rx=0 tx=0).stop 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2440845909 shutdown_connections 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/2440845909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adbfbe0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2440845909 >> 172.21.15.117:0/2440845909 conn(0x56252adbabc0 msgr2=0x56252adb8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2440845909 shutdown_connections 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/2440845909 wait complete. 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 Processor -- start 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- start start 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adc5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56252adbe570 con 0x56252adbf800 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adc5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adc5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:43848/0 (socket says 172.21.15.117:43848) 2024-09-10T06:23:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 learned_addr learned my addr 172.21.15.117:0/4219250932 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252adc6010 con 0x56252adbf800 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f3508fef640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adc5ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f34f8041d90 tx=0x7f34f804f060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33de7fc640 1 -- 172.21.15.117:0/4219250932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f8062070 con 0x56252adbf800 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56252adc6010 con 0x56252adbf800 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252adc6010 con 0x56252adbf800 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33de7fc640 1 -- 172.21.15.117:0/4219250932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f8058040 con 0x56252adbf800 2024-09-10T06:23:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.729+0000 7f33de7fc640 1 -- 172.21.15.117:0/4219250932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f803bcb0 con 0x56252adbf800 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f33de7fc640 1 -- 172.21.15.117:0/4219250932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34f8071020 con 0x56252adbf800 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f33de7fc640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33d4039a20 0x7f33d403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f33de7fc640 1 -- 172.21.15.117:0/4219250932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f34f806f020 con 0x56252adbf800 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35087ee640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33d4039a20 0x7f33d403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252add0c60 0x56252add3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add3870 con 0x56252add0c60 2024-09-10T06:23:17.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252add0c60 0x56252add3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35087ee640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33d4039a20 0x7f33d403bee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56252ada4910 tx=0x7f34fc0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252add0c60 0x56252add3120 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 realm 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add3c80 con 0x56252add0c60 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add4550 con 0x56252add0c60 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252add5650 0x56252add7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add8000 con 0x56252add5650 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.733+0000 7f3508fef640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252add5650 0x56252add7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f3508fef640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252add5650 0x56252add7a40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f350b4e99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f350b4e99c0 20 searching for the correct realm 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252add9f50 0x56252addc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252addca30 con 0x56252add9f50 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35087ee640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252add9f50 0x56252addc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35087ee640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252add9f50 0x56252addc360 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252addca30 con 0x56252add5650 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f3508fef640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f34f804bac0 0x7f34f805ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:17.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252addca30 con 0x7f34f804bac0 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f34f804bac0 0x7f34f805ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f34f804bac0 0x7f34f805ca50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.737+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add5650 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add5650 2024-09-10T06:23:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.741+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add5650 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.745+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add5650 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add9f50 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x7f34f804bac0 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add0c60 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56252add48f0 con 0x56252add5650 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:17.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add88c0 con 0x56252add0c60 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add8cb0 con 0x56252add0c60 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.749+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252add8cb0 con 0x56252add9f50 2024-09-10T06:23:17.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 zone default found 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 4 Realm: () 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 zonegroup default 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252addceb0 con 0x7f34f804bac0 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252adde9a0 con 0x56252add9f50 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252addee00 con 0x56252add9f50 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 started sync module instance, tier type = 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:17.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adddd40 con 0x56252add5650 2024-09-10T06:23:17.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94717632962864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252addd9a0 con 0x56252add5650 2024-09-10T06:23:17.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.753+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252addfd10 con 0x56252add0c60 2024-09-10T06:23:17.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94717632962864] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94717632967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252addfd10 con 0x56252add0c60 2024-09-10T06:23:17.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade06d0 con 0x56252add9f50 2024-09-10T06:23:17.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94717632967232] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94717632968800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252addfc80 con 0x56252add9f50 2024-09-10T06:23:17.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.757+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade1410 con 0x56252add5650 2024-09-10T06:23:17.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94717632974624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade1cb0 con 0x56252add5650 2024-09-10T06:23:17.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade26b0 con 0x56252add0c60 2024-09-10T06:23:17.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94717632968800] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94717632974624] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94717632973424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade1800 con 0x56252add0c60 2024-09-10T06:23:17.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.761+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade2f50 con 0x7f34f804bac0 2024-09-10T06:23:17.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94717632973424] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94717632979392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade2c70 con 0x7f34f804bac0 2024-09-10T06:23:17.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade34c0 con 0x7f34f804bac0 2024-09-10T06:23:17.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94717632979392] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94717632981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade32a0 con 0x7f34f804bac0 2024-09-10T06:23:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.765+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade3dc0 con 0x7f34f804bac0 2024-09-10T06:23:17.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94717632985232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade4230 con 0x7f34f804bac0 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=0 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=1 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=2 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=3 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=4 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=5 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94717632981200] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=6 2024-09-10T06:23:17.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94717632985232] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 20 add_watcher() i=7 2024-09-10T06:23:17.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:17.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.769+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252ade4230 con 0x56252add0c60 2024-09-10T06:23:17.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94717632986496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252ade41a0 con 0x56252add0c60 2024-09-10T06:23:17.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94717632986496] v32'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f33bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f350b4e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:17.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f350b4e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:17.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adefc80 con 0x56252add0c60 2024-09-10T06:23:17.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.773+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf0310 con 0x7f34f804bac0 2024-09-10T06:23:17.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.777+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.777+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf0730 con 0x56252add9f50 2024-09-10T06:23:17.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.777+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.777+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1020 con 0x56252add0c60 2024-09-10T06:23:17.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1590 con 0x56252add5650 2024-09-10T06:23:17.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1590 con 0x56252add9f50 2024-09-10T06:23:17.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.781+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1b00 con 0x56252add0c60 2024-09-10T06:23:17.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.785+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.785+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1b90 con 0x7f34f804bac0 2024-09-10T06:23:17.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.785+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.785+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1b90 con 0x56252add5650 2024-09-10T06:23:17.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.789+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.789+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf1d60 con 0x56252add9f50 2024-09-10T06:23:17.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.789+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.789+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x56252add5650 2024-09-10T06:23:17.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.793+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.793+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x7f34f804bac0 2024-09-10T06:23:17.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.793+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.793+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x56252add5650 2024-09-10T06:23:17.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.793+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.797+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x7f34f804bac0 2024-09-10T06:23:17.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.797+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.797+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x56252add0c60 2024-09-10T06:23:17.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.797+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.797+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2370 con 0x56252add9f50 2024-09-10T06:23:17.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.801+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.801+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2630 con 0x56252add5650 2024-09-10T06:23:17.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.801+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.801+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add0c60 2024-09-10T06:23:17.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add0c60 2024-09-10T06:23:17.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.805+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.809+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.809+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add5650 2024-09-10T06:23:17.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.809+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.809+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf25d0 con 0x56252add9f50 2024-09-10T06:23:17.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.813+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.817+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2660 con 0x7f34f804bac0 2024-09-10T06:23:17.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.817+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.817+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2660 con 0x56252add9f50 2024-09-10T06:23:17.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.817+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.817+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2660 con 0x7f34f804bac0 2024-09-10T06:23:17.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.821+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.821+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf2660 con 0x56252add9f50 2024-09-10T06:23:17.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.825+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.825+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf26c0 con 0x7f34f804bac0 2024-09-10T06:23:17.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.825+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.825+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adf26c0 con 0x56252add5650 2024-09-10T06:23:17.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f33be7e4640 20 reqs_thread_entry: start 2024-09-10T06:23:17.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:17.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 20 Filter name: none 2024-09-10T06:23:17.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f33b77fe640 20 reqs_thread_entry: start 2024-09-10T06:23:17.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:23:17.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:17.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252adef530 con 0x56252add0c60 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add5650 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.832 INFO:teuthology.orchestra.run.smithi117.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T06:23:17.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f33bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:17.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.829+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94717632986496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add0c60 2024-09-10T06:23:17.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94717632986496] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94717632962864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add5650 2024-09-10T06:23:17.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94717632962864] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f350b4e99c0 20 remove_watcher() i=0 2024-09-10T06:23:17.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f350b4e99c0 2 removed watcher, disabling cache 2024-09-10T06:23:17.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.833+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94717632967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add0c60 2024-09-10T06:23:17.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94717632967232] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f350b4e99c0 20 remove_watcher() i=1 2024-09-10T06:23:17.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94717632968800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add9f50 2024-09-10T06:23:17.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f35087ee640 1 -- 172.21.15.117:0/4219250932 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94717632968800] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34fc0cc070 con 0x56252add9f50 2024-09-10T06:23:17.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f350b4e99c0 20 remove_watcher() i=2 2024-09-10T06:23:17.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.837+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94717632974624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add5650 2024-09-10T06:23:17.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f3508fef640 1 -- 172.21.15.117:0/4219250932 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94717632974624] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34f805a070 con 0x56252add5650 2024-09-10T06:23:17.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f350b4e99c0 20 remove_watcher() i=3 2024-09-10T06:23:17.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94717632973424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x56252add0c60 2024-09-10T06:23:17.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94717632973424] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x56252add0c60 2024-09-10T06:23:17.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f350b4e99c0 20 remove_watcher() i=4 2024-09-10T06:23:17.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.841+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94717632979392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x7f34f804bac0 2024-09-10T06:23:17.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94717632979392] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f350b4e99c0 20 remove_watcher() i=5 2024-09-10T06:23:17.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94717632981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x7f34f804bac0 2024-09-10T06:23:17.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94717632981200] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f350b4e99c0 20 remove_watcher() i=6 2024-09-10T06:23:17.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.845+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94717632985232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56252adef010 con 0x7f34f804bac0 2024-09-10T06:23:17.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94717632985232] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350000a4d0 con 0x7f34f804bac0 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 20 remove_watcher() i=7 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f34f804bac0 msgr2=0x7f34f805ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f34f804bac0 0x7f34f805ca50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252add0c60 msgr2=0x56252add3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252add0c60 0x56252add3120 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252add5650 msgr2=0x56252add7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252add5650 0x56252add7a40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252add9f50 msgr2=0x56252addc360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252add9f50 0x56252addc360 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33d4039a20 msgr2=0x7f33d403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33d4039a20 0x7f33d403bee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56252ada4910 tx=0x7f34fc0a8000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 msgr2=0x56252adc5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/4219250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adbf800 0x56252adc5ab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f34f8041d90 tx=0x7f34f804f060 comp rx=0 tx=0).stop 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f35097f0640 1 -- 172.21.15.117:0/4219250932 reap_dead start 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 shutdown_connections 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 >> 172.21.15.117:0/4219250932 conn(0x56252adbabc0 msgr2=0x56252adb8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 shutdown_connections 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/4219250932 wait complete. 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 msgr2=0x7f33e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 0x7f33e003bf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ac890 tx=0x7f34fc005ad0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 msgr2=0x56252adb23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f34f8018ce0 tx=0x7f34f800e740 comp rx=0 tx=0).stop 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 shutdown_connections 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33e0039a70 0x7f33e003bf30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/819666964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252adb1fd0 0x56252adb23f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 >> 172.21.15.117:0/819666964 conn(0x56252ada7980 msgr2=0x56252ada7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 shutdown_connections 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/819666964 wait complete. 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252aca3880 msgr2=0x56252ad9b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56252aca3880 0x56252ad9b330 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252ad9dab0 msgr2=0x56252ad9fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56252ad9dab0 0x56252ad9fea0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252ada19b0 msgr2=0x56252ada3da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56252ada19b0 0x56252ada3da0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33f0039a70 msgr2=0x7f33f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f33f0039a70 0x7f33f003bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0ae000 tx=0x7f34fc0a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 msgr2=0x56252ad941c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:17.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 --2- 172.21.15.117:0/737111011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56252ac137b0 0x56252ad941c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x56252ac9f220 tx=0x7f34f8000bd0 comp rx=0 tx=0).stop 2024-09-10T06:23:17.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f35097f0640 1 -- 172.21.15.117:0/737111011 reap_dead start 2024-09-10T06:23:17.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 shutdown_connections 2024-09-10T06:23:17.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 >> 172.21.15.117:0/737111011 conn(0x56252ac99e90 msgr2=0x56252ac9e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:17.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 shutdown_connections 2024-09-10T06:23:17.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:17.849+0000 7f350b4e99c0 1 -- 172.21.15.117:0/737111011 wait complete. 2024-09-10T06:23:17.864 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T06:23:17.888 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:17.893 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T06:23:52.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-10T06:23:52.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-10T06:23:52.895 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-10T06:23:52.934 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:52.934 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b66f19c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557b78a4c770 0x557b78a4cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b66f19c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b788fe9c0 con 0x557b78a4f8b0 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b66f19c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x557b7894e6d0 con 0x557b78a4c770 2024-09-10T06:23:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b41f7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557b78a4c770 0x557b78a4cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b41f7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557b78a4c770 0x557b78a4cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56546/0 (socket says 172.21.15.117:56546) 2024-09-10T06:23:52.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b41f7640 1 -- 172.21.15.117:0/281245549 learned_addr learned my addr 172.21.15.117:0/281245549 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b39f6640 1 --1- 172.21.15.117:0/281245549 >> v1:172.21.15.84:6789/0 conn(0x557b78a4f8b0 0x557b78a51ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45836/0 (socket says 172.21.15.117:45836) 2024-09-10T06:23:52.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b41f7640 1 -- 172.21.15.117:0/281245549 >> v1:172.21.15.84:6789/0 conn(0x557b78a4f8b0 legacy=0x557b78a51ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:52.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.931+0000 7fb8b41f7640 1 -- 172.21.15.117:0/281245549 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b788f2ca0 con 0x557b78a4c770 2024-09-10T06:23:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/281245549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78a4cb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a4e0 tx=0x7fb89c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad54d222823c04f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b31f5640 1 -- 172.21.15.117:0/281245549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0aa540 con 0x557b78a4c770 2024-09-10T06:23:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b31f5640 1 -- 172.21.15.117:0/281245549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0aa6e0 con 0x557b78a4c770 2024-09-10T06:23:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b31f5640 1 -- 172.21.15.117:0/281245549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0aaa40 con 0x557b78a4c770 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/281245549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 msgr2=0x557b78a4cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/281245549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78a4cb50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a4e0 tx=0x7fb89c01b090 comp rx=0 tx=0).stop 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/281245549 shutdown_connections 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/281245549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78a4cb50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/281245549 >> 172.21.15.117:0/281245549 conn(0x557b789c0080 msgr2=0x557b789c0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/281245549 shutdown_connections 2024-09-10T06:23:52.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.935+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/281245549 wait complete. 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b66f19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b66f19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b78952680 con 0x557b78a4c770 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56556/0 (socket says 172.21.15.117:56556) 2024-09-10T06:23:52.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.951+0000 7fb8b41f7640 1 -- 172.21.15.117:0/2436174325 learned_addr learned my addr 172.21.15.117:0/2436174325 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 -- 172.21.15.117:0/2436174325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b788cdda0 con 0x557b78a4c770 2024-09-10T06:23:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/2436174325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb89c017ca0 tx=0x7fb89c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909f06b72e69f5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb7a260c640 1 -- 172.21.15.117:0/2436174325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b9030 con 0x557b78a4c770 2024-09-10T06:23:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb7a260c640 1 -- 172.21.15.117:0/2436174325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0aaa80 con 0x557b78a4c770 2024-09-10T06:23:52.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb7a260c640 1 -- 172.21.15.117:0/2436174325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0aada0 con 0x557b78a4c770 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/2436174325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 msgr2=0x557b78b37a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/2436174325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb89c017ca0 tx=0x7fb89c0033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/2436174325 shutdown_connections 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/2436174325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b37a00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/2436174325 >> 172.21.15.117:0/2436174325 conn(0x557b789c0080 msgr2=0x557b78b336a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/2436174325 shutdown_connections 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/2436174325 wait complete. 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b3ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b66f19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b788f4a50 con 0x557b78a4c770 2024-09-10T06:23:52.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b3ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b3ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56558/0 (socket says 172.21.15.117:56558) 2024-09-10T06:23:52.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 -- 172.21.15.117:0/544777845 learned_addr learned my addr 172.21.15.117:0/544777845 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b78b3f470 con 0x557b78a4c770 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b3ef10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb89c017ca0 tx=0x7fb89c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.955+0000 7fb7a0e09640 1 -- 172.21.15.117:0/544777845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b9070 con 0x557b78a4c770 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b78b3f700 con 0x557b78a4c770 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb7a0e09640 1 -- 172.21.15.117:0/544777845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0c3030 con 0x557b78a4c770 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb7a0e09640 1 -- 172.21.15.117:0/544777845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b5bf0 con 0x557b78a4c770 2024-09-10T06:23:52.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b78b400b0 con 0x557b78a4c770 2024-09-10T06:23:52.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb7a0e09640 1 -- 172.21.15.117:0/544777845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb89c0b3040 con 0x557b78a4c770 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb7a0e09640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb79c039a70 0x7fb79c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb7a0e09640 1 -- 172.21.15.117:0/544777845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb89c0ba070 con 0x557b78a4c770 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb79c039a70 0x7fb79c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78a4f8b0 0x557b78b46080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b465c0 con 0x557b78a4f8b0 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78a4f8b0 0x557b78b46080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb79c039a70 0x7fb79c03bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4001e40 tx=0x7fb8a40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78a4f8b0 0x557b78b46080 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b49f8640 1 -- 172.21.15.117:0/544777845 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78a4f8b0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b46a00 con 0x557b78a4f8b0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b49f8640 1 -- 172.21.15.117:0/544777845 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78a4f8b0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b48810 0x557b78b4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b4b2d0 con 0x557b78b48810 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b48810 0x557b78b4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.959+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b48810 0x557b78b4ac00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 -- 172.21.15.117:0/544777845 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb89c0cf070 con 0x557b78b48810 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b476b0 con 0x557b78a4f8b0 2024-09-10T06:23:52.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b49f8640 1 -- 172.21.15.117:0/544777845 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78a4f8b0 2024-09-10T06:23:52.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b4c710 0x557b78b4eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b4f240 con 0x557b78b4c710 2024-09-10T06:23:52.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b4c710 0x557b78b4eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b4c710 0x557b78b4eb00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b39f6640 1 -- 172.21.15.117:0/544777845 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8a400bd60 con 0x557b78b4c710 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b66f19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b7895f450 con 0x557b78b5cd00 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56574/0 (socket says 172.21.15.117:56574) 2024-09-10T06:23:52.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1111250553 learned_addr learned my addr 172.21.15.117:0/1111250553 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1111250553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b78b5d760 con 0x557b78b5cd00 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0b5e20 tx=0x7fb89c0bdf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb799ffb640 1 -- 172.21.15.117:0/1111250553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0e2020 con 0x557b78b5cd00 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb799ffb640 1 -- 172.21.15.117:0/1111250553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0b4af0 con 0x557b78b5cd00 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.963+0000 7fb799ffb640 1 -- 172.21.15.117:0/1111250553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b4dd0 con 0x557b78b5cd00 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b78b5dfc0 con 0x557b78b5cd00 2024-09-10T06:23:52.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b78b5dfc0 con 0x557b78b5cd00 2024-09-10T06:23:52.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb799ffb640 1 -- 172.21.15.117:0/1111250553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb89c0e9b00 con 0x557b78b5cd00 2024-09-10T06:23:52.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb799ffb640 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 0x7fb78c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb799ffb640 1 -- 172.21.15.117:0/1111250553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb89c0c92e0 con 0x557b78b5cd00 2024-09-10T06:23:52.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 0x7fb78c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 0x7fb78c03bee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557b78b4f640 tx=0x7fb8a400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b66f19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b78b38170 con 0x557b78b6a280 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56582/0 (socket says 172.21.15.117:56582) 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1299961864 learned_addr learned my addr 172.21.15.117:0/1299961864 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1299961864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b78b6ac50 con 0x557b78b6a280 2024-09-10T06:23:52.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1299961864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0bd8d0 tx=0x7fb89c0bcf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd372f048f4207e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb78b7fe640 1 -- 172.21.15.117:0/1299961864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0be540 con 0x557b78b6a280 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb78b7fe640 1 -- 172.21.15.117:0/1299961864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0c8470 con 0x557b78b6a280 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.967+0000 7fb78b7fe640 1 -- 172.21.15.117:0/1299961864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b4560 con 0x557b78b6a280 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1299961864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 msgr2=0x557b78b6a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1299961864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0bd8d0 tx=0x7fb89c0bcf10 comp rx=0 tx=0).stop 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1299961864 shutdown_connections 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1299961864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b6a660 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1299961864 >> 172.21.15.117:0/1299961864 conn(0x557b78b656a0 msgr2=0x557b78b638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:52.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1299961864 shutdown_connections 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1299961864 wait complete. 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 Processor -- start 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- start start 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b78b69050 con 0x557b78b6a280 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b41f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56588/0 (socket says 172.21.15.117:56588) 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 learned_addr learned my addr 172.21.15.117:0/1913963656 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b78b70af0 con 0x557b78b6a280 2024-09-10T06:23:52.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0bd8d0 tx=0x7fb89c0ddf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb789ffb640 1 -- 172.21.15.117:0/1913963656 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0b4560 con 0x557b78b6a280 2024-09-10T06:23:52.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b78b70af0 con 0x557b78b6a280 2024-09-10T06:23:52.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb789ffb640 1 -- 172.21.15.117:0/1913963656 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89c0b4700 con 0x557b78b6a280 2024-09-10T06:23:52.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb789ffb640 1 -- 172.21.15.117:0/1913963656 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89c0e7b80 con 0x557b78b6a280 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b78b710c0 con 0x557b78b6a280 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.971+0000 7fb789ffb640 1 -- 172.21.15.117:0/1913963656 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb89c0cb120 con 0x557b78b6a280 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb789ffb640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb77c039a70 0x7fb77c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb789ffb640 1 -- 172.21.15.117:0/1913963656 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb89c0f6070 con 0x557b78b6a280 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb77c039a70 0x7fb77c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78b7b770 0x557b78b7dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7e350 con 0x557b78b7b770 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78b7b770 0x557b78b7dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb77c039a70 0x7fb77c03bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400fe90 tx=0x7fb8a4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78b7b770 0x557b78b7dc00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78b7b770 2024-09-10T06:23:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 realm 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7e760 con 0x557b78b7b770 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78b7b770 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f030 con 0x557b78b7b770 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78b7b770 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78b7b770 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b7fec0 0x557b78b822b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b829f0 con 0x557b78b7fec0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b7fec0 0x557b78b822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b7fec0 0x557b78b822b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 20 searching for the correct realm 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b84990 0x557b78b86e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b87500 con 0x557b78b84990 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b84990 0x557b78b86e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b84990 0x557b78b86e30 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b87500 con 0x557b78b7fec0 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb89c104040 0x7fb89c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.975+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b87500 con 0x7fb89c104040 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb89c104040 0x7fb89c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb89c104040 0x7fb89c10d430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac0083f0 con 0x7fb89c104040 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac0083f0 con 0x557b78b7b770 2024-09-10T06:23:52.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7fec0 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.979+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7fec0 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.983+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7fec0 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7fec0 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b84990 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:52.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.987+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x7fb89c104040 2024-09-10T06:23:52.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:52.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7b770 2024-09-10T06:23:52.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:52.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b78b7f3d0 con 0x557b78b7fec0 2024-09-10T06:23:52.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:52.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:52.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:52.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b832b0 con 0x557b78b7b770 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b836a0 con 0x557b78b7b770 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b836a0 con 0x557b78b84990 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 zone default found 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 4 Realm: () 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 zonegroup default 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b87980 con 0x7fb89c104040 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b89370 con 0x557b78b84990 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b89710 con 0x557b78b84990 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.991+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b88810 con 0x557b78b7fec0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988794698752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b88470 con 0x557b78b7fec0 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8a640 con 0x557b78b7b770 2024-09-10T06:23:53.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988794698752] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988794704272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8aa60 con 0x557b78b7b770 2024-09-10T06:23:53.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.995+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8b330 con 0x557b78b84990 2024-09-10T06:23:53.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988794704272] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988794705600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8b720 con 0x557b78b84990 2024-09-10T06:23:53.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8c0e0 con 0x557b78b7fec0 2024-09-10T06:23:53.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988794713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8cda0 con 0x557b78b7fec0 2024-09-10T06:23:53.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8d760 con 0x557b78b7b770 2024-09-10T06:23:53.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:52.999+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988794705600] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988794713296] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988794706752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8d760 con 0x557b78b7b770 2024-09-10T06:23:53.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8e000 con 0x7fb89c104040 2024-09-10T06:23:53.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988794706752] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988794717120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8dd70 con 0x7fb89c104040 2024-09-10T06:23:53.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.003+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8e860 con 0x7fb89c104040 2024-09-10T06:23:53.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.007+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.007+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988794721072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8ecd0 con 0x7fb89c104040 2024-09-10T06:23:53.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.007+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8f790 con 0x7fb89c104040 2024-09-10T06:23:53.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.007+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988794717120] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988794721072] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988794724960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8e820 con 0x7fb89c104040 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=0 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=1 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=2 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=3 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=4 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=5 2024-09-10T06:23:53.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=6 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988794724960] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 20 add_watcher() i=7 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78b92890 con 0x557b78b7b770 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988794718176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8fd10 con 0x557b78b7b770 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.011+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988794718176] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb76a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 5 note: GC not initialized 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb7697e2640 20 reqs_thread_entry: start 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 20 Filter name: none 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb6daffd640 20 reqs_thread_entry: start 2024-09-10T06:23:53.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6270 con 0x557b78b7b770 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6270 con 0x557b78b7fec0 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6230 con 0x557b78b7b770 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6230 con 0x557b78b84990 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6740 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6740 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6740 con 0x557b78b7b770 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb6740 con 0x557b78b7b770 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66f0 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66f0 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.015+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66f0 con 0x7fb89c104040 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7d00 con 0x557b78b7b770 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7d00 con 0x557b78b7fec0 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7d00 con 0x557b78b84990 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7d00 con 0x7fb89c104040 2024-09-10T06:23:53.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x7fb89c104040 2024-09-10T06:23:53.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.019+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x7fb89c104040 2024-09-10T06:23:53.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7b770 2024-09-10T06:23:53.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x7fb89c104040 2024-09-10T06:23:53.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7fec0 2024-09-10T06:23:53.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x7fb89c104040 2024-09-10T06:23:53.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7b770 2024-09-10T06:23:53.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.023+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7b770 2024-09-10T06:23:53.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7b770 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b7b770 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb7cb0 con 0x7fb89c104040 2024-09-10T06:23:53.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb76a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.027+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988794718176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78b8fd10 con 0x557b78b7b770 2024-09-10T06:23:53.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93988794718176] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988794698752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x557b78b7fec0 2024-09-10T06:23:53.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93988794698752] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b66f19c0 20 remove_watcher() i=0 2024-09-10T06:23:53.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b66f19c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.031+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988794704272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x557b78b7b770 2024-09-10T06:23:53.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93988794704272] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 20 remove_watcher() i=1 2024-09-10T06:23:53.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988794705600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x557b78b84990 2024-09-10T06:23:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b39f6640 1 -- 172.21.15.117:0/1913963656 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93988794705600] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8a4037040 con 0x557b78b84990 2024-09-10T06:23:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 20 remove_watcher() i=2 2024-09-10T06:23:53.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988794713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x557b78b7fec0 2024-09-10T06:23:53.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b41f7640 1 -- 172.21.15.117:0/1913963656 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93988794713296] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89c113020 con 0x557b78b7fec0 2024-09-10T06:23:53.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 20 remove_watcher() i=3 2024-09-10T06:23:53.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.035+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988794706752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x557b78b7b770 2024-09-10T06:23:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.039+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93988794706752] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x557b78b7b770 2024-09-10T06:23:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.039+0000 7fb8b66f19c0 20 remove_watcher() i=4 2024-09-10T06:23:53.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.039+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988794717120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x7fb89c104040 2024-09-10T06:23:53.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93988794717120] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b66f19c0 20 remove_watcher() i=5 2024-09-10T06:23:53.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988794721072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x7fb89c104040 2024-09-10T06:23:53.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93988794721072] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b66f19c0 20 remove_watcher() i=6 2024-09-10T06:23:53.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.043+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988794724960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b78bb66d0 con 0x7fb89c104040 2024-09-10T06:23:53.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93988794724960] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8ac026040 con 0x7fb89c104040 2024-09-10T06:23:53.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 20 remove_watcher() i=7 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb89c104040 msgr2=0x7fb89c10d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb89c104040 0x7fb89c10d430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78b7b770 msgr2=0x557b78b7dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78b7b770 0x557b78b7dc00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b7fec0 msgr2=0x557b78b822b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b7fec0 0x557b78b822b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b84990 msgr2=0x557b78b86e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b84990 0x557b78b86e30 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb77c039a70 msgr2=0x7fb77c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb77c039a70 0x7fb77c03bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400fe90 tx=0x7fb8a4010000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 msgr2=0x557b78b70590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b49f8640 1 -- 172.21.15.117:0/1913963656 reap_dead start 2024-09-10T06:23:53.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0bd8d0 tx=0x7fb89c0ddf30 comp rx=0 tx=0).stop 2024-09-10T06:23:53.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 shutdown_connections 2024-09-10T06:23:53.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1913963656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b6a280 0x557b78b70590 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 >> 172.21.15.117:0/1913963656 conn(0x557b78b656a0 msgr2=0x557b78b638b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 shutdown_connections 2024-09-10T06:23:53.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1913963656 wait complete. 2024-09-10T06:23:53.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 msgr2=0x7fb78c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 0x7fb78c03bee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557b78b4f640 tx=0x7fb8a400f000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 msgr2=0x557b78b5d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0b5e20 tx=0x7fb89c0bdf30 comp rx=0 tx=0).stop 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 shutdown_connections 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb78c039a20 0x7fb78c03bee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/1111250553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78b5cd00 0x557b78b5d120 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 >> 172.21.15.117:0/1111250553 conn(0x557b78b526b0 msgr2=0x557b78b52a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 shutdown_connections 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/1111250553 wait complete. 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78a4f8b0 msgr2=0x557b78b46080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557b78a4f8b0 0x557b78b46080 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b48810 msgr2=0x557b78b4ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557b78b48810 0x557b78b4ac00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b4c710 msgr2=0x557b78b4eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557b78b4c710 0x557b78b4eb00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb79c039a70 msgr2=0x7fb79c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb79c039a70 0x7fb79c03bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4001e40 tx=0x7fb8a40013a0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 msgr2=0x557b78b3ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 --2- 172.21.15.117:0/544777845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b78a4c770 0x557b78b3ef10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb89c017ca0 tx=0x7fb89c017e30 comp rx=0 tx=0).stop 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b49f8640 1 -- 172.21.15.117:0/544777845 reap_dead start 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 shutdown_connections 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 >> 172.21.15.117:0/544777845 conn(0x557b789c0080 msgr2=0x557b78b32130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 shutdown_connections 2024-09-10T06:23:53.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.047+0000 7fb8b66f19c0 1 -- 172.21.15.117:0/544777845 wait complete. 2024-09-10T06:23:53.064 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.064 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T06:23:53.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T06:23:53.065 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T06:23:53.137 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:53.137 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:53.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.131+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670bc079c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556355156c60 0x556355159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670bc079c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563550089c0 con 0x556355159590 2024-09-10T06:23:53.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670bc079c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5563550586d0 con 0x556355156c60 2024-09-10T06:23:53.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556355156c60 0x556355159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x556355156c60 0x556355159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56598/0 (socket says 172.21.15.117:56598) 2024-09-10T06:23:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f6708f0c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x556355159590 0x55635515b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45846/0 (socket says 172.21.15.117:45846) 2024-09-10T06:23:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 -- 172.21.15.117:0/877804310 learned_addr learned my addr 172.21.15.117:0/877804310 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 -- 172.21.15.117:0/877804310 >> v1:172.21.15.84:6789/0 conn(0x556355159590 legacy=0x55635515b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 -- 172.21.15.117:0/877804310 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556354ffcca0 con 0x556355156c60 2024-09-10T06:23:53.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.135+0000 7f670970d640 1 --2- 172.21.15.117:0/877804310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355159050 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00a5c0 tx=0x7f66fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f7ba46c7ef3b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f66fbfff640 1 -- 172.21.15.117:0/877804310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0a6070 con 0x556355156c60 2024-09-10T06:23:53.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f66fbfff640 1 -- 172.21.15.117:0/877804310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0af070 con 0x556355156c60 2024-09-10T06:23:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f66fbfff640 1 -- 172.21.15.117:0/877804310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0aa5c0 con 0x556355156c60 2024-09-10T06:23:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 -- 172.21.15.117:0/877804310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 msgr2=0x556355159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 --2- 172.21.15.117:0/877804310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355159050 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00a5c0 tx=0x7f66fc01b340 comp rx=0 tx=0).stop 2024-09-10T06:23:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 -- 172.21.15.117:0/877804310 shutdown_connections 2024-09-10T06:23:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 --2- 172.21.15.117:0/877804310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355159050 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 -- 172.21.15.117:0/877804310 >> 172.21.15.117:0/877804310 conn(0x5563550c9ff0 msgr2=0x5563550ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 -- 172.21.15.117:0/877804310 shutdown_connections 2024-09-10T06:23:53.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.139+0000 7f670bc079c0 1 -- 172.21.15.117:0/877804310 wait complete. 2024-09-10T06:23:53.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55635505c680 con 0x556355156c60 2024-09-10T06:23:53.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56600/0 (socket says 172.21.15.117:56600) 2024-09-10T06:23:53.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670970d640 1 -- 172.21.15.117:0/347164171 learned_addr learned my addr 172.21.15.117:0/347164171 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670970d640 1 -- 172.21.15.117:0/347164171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556354fd7da0 con 0x556355156c60 2024-09-10T06:23:53.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670970d640 1 --2- 172.21.15.117:0/347164171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0ac040 tx=0x7f66fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f4e5122a272f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f65f7606640 1 -- 172.21.15.117:0/347164171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0aa970 con 0x556355156c60 2024-09-10T06:23:53.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f65f7606640 1 -- 172.21.15.117:0/347164171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0aab10 con 0x556355156c60 2024-09-10T06:23:53.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f65f7606640 1 -- 172.21.15.117:0/347164171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0aae30 con 0x556355156c60 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- 172.21.15.117:0/347164171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 msgr2=0x5563552419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 --2- 172.21.15.117:0/347164171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0ac040 tx=0x7f66fc003030 comp rx=0 tx=0).stop 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- 172.21.15.117:0/347164171 shutdown_connections 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 --2- 172.21.15.117:0/347164171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x5563552419c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- 172.21.15.117:0/347164171 >> 172.21.15.117:0/347164171 conn(0x5563550c9ff0 msgr2=0x55635523d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- 172.21.15.117:0/347164171 shutdown_connections 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- 172.21.15.117:0/347164171 wait complete. 2024-09-10T06:23:53.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.155+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355248ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556354ffea50 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355248ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355248ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56606/0 (socket says 172.21.15.117:56606) 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670970d640 1 -- 172.21.15.117:0/34812095 learned_addr learned my addr 172.21.15.117:0/34812095 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670970d640 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556355249430 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670970d640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355248ed0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f66fc01bbe0 tx=0x7f66fc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 -- 172.21.15.117:0/34812095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0cb020 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 -- 172.21.15.117:0/34812095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0c6650 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563552496c0 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 -- 172.21.15.117:0/34812095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0c6930 con 0x556355156c60 2024-09-10T06:23:53.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635524a020 con 0x556355156c60 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 -- 172.21.15.117:0/34812095 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66fc0ce020 con 0x556355156c60 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65f0039ac0 0x7f65f003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f65f5e03640 1 -- 172.21.15.117:0/34812095 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f66fc0ebb90 con 0x556355156c60 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f6708f0c640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65f0039ac0 0x7f65f003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556355159590 0x55635524fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355250530 con 0x556355159590 2024-09-10T06:23:53.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f6709f0e640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556355159590 0x55635524fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.159+0000 7f6708f0c640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65f0039ac0 0x7f65f003bf80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6700001e90 tx=0x7f67000013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6709f0e640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556355159590 0x55635524fff0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6709f0e640 1 -- 172.21.15.117:0/34812095 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x556355159590 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355250980 con 0x556355159590 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6709f0e640 1 -- 172.21.15.117:0/34812095 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f670400a4d0 con 0x556355159590 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355252790 0x556355254b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355255270 con 0x556355252790 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355252790 0x556355254b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355252790 0x556355254b80 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 -- 172.21.15.117:0/34812095 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66fc0bd910 con 0x556355252790 2024-09-10T06:23:53.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355251630 con 0x556355159590 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6709f0e640 1 -- 172.21.15.117:0/34812095 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f670400a4d0 con 0x556355159590 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563552566d0 0x556355258ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355259200 con 0x5563552566d0 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6708f0c640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563552566d0 0x556355258ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6708f0c640 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563552566d0 0x556355258ac0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f6708f0c640 1 -- 172.21.15.117:0/34812095 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f670000f6e0 con 0x5563552566d0 2024-09-10T06:23:53.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670bc079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556355069450 con 0x556355266d00 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56612/0 (socket says 172.21.15.117:56612) 2024-09-10T06:23:53.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.163+0000 7f670970d640 1 -- 172.21.15.117:0/3752831746 learned_addr learned my addr 172.21.15.117:0/3752831746 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670970d640 1 -- 172.21.15.117:0/3752831746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556355267760 con 0x556355266d00 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670970d640 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0a4050 tx=0x7f66fc0cffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 -- 172.21.15.117:0/3752831746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0eb390 con 0x556355266d00 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 -- 172.21.15.117:0/3752831746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0eb530 con 0x556355266d00 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 -- 172.21.15.117:0/3752831746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0eb810 con 0x556355266d00 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556355267fc0 con 0x556355266d00 2024-09-10T06:23:53.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556355267fc0 con 0x556355266d00 2024-09-10T06:23:53.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 -- 172.21.15.117:0/3752831746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66fc0bc7b0 con 0x556355266d00 2024-09-10T06:23:53.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 0x7f65e003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f65eeffd640 1 -- 172.21.15.117:0/3752831746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f66fc0e3050 con 0x556355266d00 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f6708f0c640 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 0x7f65e003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f6708f0c640 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 0x7f65e003bf80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55635524a340 tx=0x7f670000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.167+0000 7f670bc079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556355242130 con 0x556355273230 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56620/0 (socket says 172.21.15.117:56620) 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 -- 172.21.15.117:0/3560610770 learned_addr learned my addr 172.21.15.117:0/3560610770 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 -- 172.21.15.117:0/3560610770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556355273be0 con 0x556355273230 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- 172.21.15.117:0/3560610770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0b2010 tx=0x7f66fc0e6ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5d2b64ac255205 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65ecff9640 1 -- 172.21.15.117:0/3560610770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc104020 con 0x556355273230 2024-09-10T06:23:53.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65ecff9640 1 -- 172.21.15.117:0/3560610770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0c5ae0 con 0x556355273230 2024-09-10T06:23:53.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65ecff9640 1 -- 172.21.15.117:0/3560610770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0d05e0 con 0x556355273230 2024-09-10T06:23:53.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/3560610770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 msgr2=0x556355273610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3560610770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0b2010 tx=0x7f66fc0e6ee0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/3560610770 shutdown_connections 2024-09-10T06:23:53.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3560610770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x556355273610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/3560610770 >> 172.21.15.117:0/3560610770 conn(0x55635526f660 msgr2=0x55635526d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/3560610770 shutdown_connections 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/3560610770 wait complete. 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 Processor -- start 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- start start 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563552740c0 con 0x556355273230 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56630/0 (socket says 172.21.15.117:56630) 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 learned_addr learned my addr 172.21.15.117:0/4267630247 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635527ab30 con 0x556355273230 2024-09-10T06:23:53.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670970d640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0dd670 tx=0x7f66fc0f0ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65deffd640 1 -- 172.21.15.117:0/4267630247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0d0400 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55635527ab30 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65deffd640 1 -- 172.21.15.117:0/4267630247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc0b3e30 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f65deffd640 1 -- 172.21.15.117:0/4267630247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66fc0bcaa0 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.171+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635527ab30 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f65deffd640 1 -- 172.21.15.117:0/4267630247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66fc107020 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f65deffd640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65d4039a70 0x7f65d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f65deffd640 1 -- 172.21.15.117:0/4267630247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f66fc114bd0 con 0x556355273230 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6708f0c640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65d4039a70 0x7f65d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563552855d0 0x556355287a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552881b0 con 0x5563552855d0 2024-09-10T06:23:53.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563552855d0 0x556355287a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6708f0c640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65d4039a70 0x7f65d403bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x556355259600 tx=0x7f6700010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563552855d0 0x556355287a60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 realm 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552885c0 con 0x5563552855d0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355288e90 con 0x5563552855d0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355289d60 0x55635528c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635528c890 con 0x556355289d60 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670970d640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355289d60 0x55635528c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.175+0000 7f670970d640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355289d60 0x55635528c150 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670bc079c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670bc079c0 20 searching for the correct realm 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55635528e830 0x556355290cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563552913a0 con 0x55635528e830 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6708f0c640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55635528e830 0x556355290cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6708f0c640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55635528e830 0x556355290cd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563552913a0 con 0x556355289d60 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670970d640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f66fc109040 0x7f66fc0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563552913a0 con 0x7f66fc109040 2024-09-10T06:23:53.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f66fc109040 0x7f66fc0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f66fc109040 0x7f66fc0ca170 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.179+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x556355289d60 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x556355289d60 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.183+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x556355289d60 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.187+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x556355289d60 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x55635528e830 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x7f66fc109040 2024-09-10T06:23:53.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x5563552855d0 2024-09-10T06:23:53.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556355289230 con 0x556355289d60 2024-09-10T06:23:53.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:53.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:53.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635528d150 con 0x5563552855d0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635528d540 con 0x5563552855d0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635528d540 con 0x55635528e830 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 zone default found 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 4 Realm: () 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 zonegroup default 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355291820 con 0x7f66fc109040 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556355293210 con 0x55635528e830 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.191+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552935b0 con 0x55635528e830 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552926b0 con 0x556355289d60 2024-09-10T06:23:53.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885118884512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355292310 con 0x556355289d60 2024-09-10T06:23:53.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552944b0 con 0x5563552855d0 2024-09-10T06:23:53.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885118884512] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885118889984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552948d0 con 0x5563552855d0 2024-09-10T06:23:53.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.195+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355295180 con 0x55635528e830 2024-09-10T06:23:53.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885118889984] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885118891312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355295570 con 0x55635528e830 2024-09-10T06:23:53.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355295f30 con 0x556355289d60 2024-09-10T06:23:53.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885118898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355296ba0 con 0x556355289d60 2024-09-10T06:23:53.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.199+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297560 con 0x5563552855d0 2024-09-10T06:23:53.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885118891312] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885118898896] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885118892432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297560 con 0x5563552855d0 2024-09-10T06:23:53.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297db0 con 0x7f66fc109040 2024-09-10T06:23:53.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885118892432] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885118902720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297b30 con 0x7f66fc109040 2024-09-10T06:23:53.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.203+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552985f0 con 0x7f66fc109040 2024-09-10T06:23:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.207+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885118902720] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.207+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.207+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885118906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552985b0 con 0x7f66fc109040 2024-09-10T06:23:53.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.207+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355298fb0 con 0x7f66fc109040 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885118909120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552993d0 con 0x7f66fc109040 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=0 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=1 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=2 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=3 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=4 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=5 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885118906560] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=6 2024-09-10T06:23:53.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885118909120] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 add_watcher() i=7 2024-09-10T06:23:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552975e0 con 0x5563552855d0 2024-09-10T06:23:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885118903776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355299950 con 0x5563552855d0 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885118903776] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f65bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.211+0000 7f670bc079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 5 note: GC not initialized 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f65be7e4640 20 reqs_thread_entry: start 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 20 Filter name: none 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f652ffff640 20 reqs_thread_entry: start 2024-09-10T06:23:53.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c00a0 con 0x5563552855d0 2024-09-10T06:23:53.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c00a0 con 0x556355289d60 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c00a0 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0060 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0590 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0590 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0590 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0590 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0520 con 0x55635528e830 2024-09-10T06:23:53.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0520 con 0x55635528e830 2024-09-10T06:23:53.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.215+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c0520 con 0x7f66fc109040 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1b50 con 0x5563552855d0 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1b50 con 0x556355289d60 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1b50 con 0x55635528e830 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1b50 con 0x7f66fc109040 2024-09-10T06:23:53.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x7f66fc109040 2024-09-10T06:23:53.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.219+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x7f66fc109040 2024-09-10T06:23:53.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x5563552855d0 2024-09-10T06:23:53.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x7f66fc109040 2024-09-10T06:23:53.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x556355289d60 2024-09-10T06:23:53.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x7f66fc109040 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x5563552855d0 2024-09-10T06:23:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.223+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563552c1ab0 con 0x7f66fc109040 2024-09-10T06:23:53.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f65bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885118903776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355299d90 con 0x5563552855d0 2024-09-10T06:23:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93885118903776] v32'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.227+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885118884512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552c04d0 con 0x556355289d60 2024-09-10T06:23:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93885118884512] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670bc079c0 20 remove_watcher() i=0 2024-09-10T06:23:53.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670bc079c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885118889984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552c04d0 con 0x5563552855d0 2024-09-10T06:23:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93885118889984] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670bc079c0 20 remove_watcher() i=1 2024-09-10T06:23:53.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.231+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885118891312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552c04d0 con 0x55635528e830 2024-09-10T06:23:53.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f6708f0c640 1 -- 172.21.15.117:0/4267630247 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93885118891312] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6700037040 con 0x55635528e830 2024-09-10T06:23:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f670bc079c0 20 remove_watcher() i=2 2024-09-10T06:23:53.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885118898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552c04d0 con 0x556355289d60 2024-09-10T06:23:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f670970d640 1 -- 172.21.15.117:0/4267630247 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93885118898896] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66fc119020 con 0x556355289d60 2024-09-10T06:23:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f670bc079c0 20 remove_watcher() i=3 2024-09-10T06:23:53.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.235+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885118892432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552c04d0 con 0x5563552855d0 2024-09-10T06:23:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93885118892432] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x5563552855d0 2024-09-10T06:23:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f670bc079c0 20 remove_watcher() i=4 2024-09-10T06:23:53.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885118902720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563552949e0 con 0x7f66fc109040 2024-09-10T06:23:53.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93885118902720] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f670bc079c0 20 remove_watcher() i=5 2024-09-10T06:23:53.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.239+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885118906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297670 con 0x7f66fc109040 2024-09-10T06:23:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93885118906560] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 20 remove_watcher() i=6 2024-09-10T06:23:53.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885118909120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556355297670 con 0x7f66fc109040 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93885118909120] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f670400a4d0 con 0x7f66fc109040 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 20 remove_watcher() i=7 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f66fc109040 msgr2=0x7f66fc0ca170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f66fc109040 0x7f66fc0ca170 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563552855d0 msgr2=0x556355287a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563552855d0 0x556355287a60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355289d60 msgr2=0x55635528c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355289d60 0x55635528c150 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55635528e830 msgr2=0x556355290cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55635528e830 0x556355290cd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65d4039a70 msgr2=0x7f65d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65d4039a70 0x7f65d403bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x556355259600 tx=0x7f6700010000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 msgr2=0x55635527a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f6709f0e640 1 -- 172.21.15.117:0/4267630247 reap_dead start 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0dd670 tx=0x7f66fc0f0ec0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 shutdown_connections 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 --2- 172.21.15.117:0/4267630247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355273230 0x55635527a5d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 >> 172.21.15.117:0/4267630247 conn(0x55635526f660 msgr2=0x55635526d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 shutdown_connections 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.243+0000 7f670bc079c0 1 -- 172.21.15.117:0/4267630247 wait complete. 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 msgr2=0x7f65e003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 0x7f65e003bf80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55635524a340 tx=0x7f670000f000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 msgr2=0x556355267120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0a4050 tx=0x7f66fc0cffa0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 shutdown_connections 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65e0039ac0 0x7f65e003bf80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/3752831746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355266d00 0x556355267120 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 >> 172.21.15.117:0/3752831746 conn(0x55635525c6b0 msgr2=0x55635525ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 shutdown_connections 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/3752831746 wait complete. 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556355159590 msgr2=0x55635524fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x556355159590 0x55635524fff0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355252790 msgr2=0x556355254b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x556355252790 0x556355254b80 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563552566d0 msgr2=0x556355258ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563552566d0 0x556355258ac0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65f0039ac0 msgr2=0x7f65f003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f65f0039ac0 0x7f65f003bf80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6700001e90 tx=0x7f67000013f0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 msgr2=0x556355248ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 --2- 172.21.15.117:0/34812095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556355156c60 0x556355248ed0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f66fc01bbe0 tx=0x7f66fc0180e0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f6709f0e640 1 -- 172.21.15.117:0/34812095 reap_dead start 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 shutdown_connections 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 >> 172.21.15.117:0/34812095 conn(0x5563550c9ff0 msgr2=0x55635523c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 shutdown_connections 2024-09-10T06:23:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.247+0000 7f670bc079c0 1 -- 172.21.15.117:0/34812095 wait complete. 2024-09-10T06:23:53.262 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.262 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.263 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T06:23:53.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T06:23:53.263 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T06:23:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:53.342 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:53.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b04a489c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5639ea4e7b50 0x5639ea57bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b04a489c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639ea4279c0 con 0x5639ea4e7770 2024-09-10T06:23:53.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b04a489c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5639ea4776d0 con 0x5639ea4e7b50 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b0254e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5639ea4e7770 0x5639ea5785a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45854/0 (socket says 172.21.15.117:45854) 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b0254e640 1 -- 172.21.15.117:0/2274345952 learned_addr learned my addr 172.21.15.117:0/2274345952 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/2274345952 >> v2:172.21.15.84:3300/0 conn(0x5639ea4e7b50 0x5639ea57bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b0154c640 1 -- 172.21.15.117:0/2274345952 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457593362 0 0) 0x5639ea4279c0 con 0x5639ea4e7770 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b0154c640 1 -- 172.21.15.117:0/2274345952 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aec001e20 con 0x5639ea4e7770 2024-09-10T06:23:53.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b01d4d640 1 -- 172.21.15.117:0/2274345952 >> v1:172.21.15.84:6789/0 conn(0x5639ea4e7770 legacy=0x5639ea5785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.339+0000 7f9b01d4d640 1 -- 172.21.15.117:0/2274345952 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea41bca0 con 0x5639ea4e7b50 2024-09-10T06:23:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/2274345952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7b50 0x5639ea57bcd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9af800a480 tx=0x7f9af801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b810f1a7e0a519e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b0154c640 1 -- 172.21.15.117:0/2274345952 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9af80b0070 con 0x5639ea4e7b50 2024-09-10T06:23:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b0154c640 1 -- 172.21.15.117:0/2274345952 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af80ab540 con 0x5639ea4e7b50 2024-09-10T06:23:53.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b0154c640 1 -- 172.21.15.117:0/2274345952 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9af80ab820 con 0x5639ea4e7b50 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2274345952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7b50 msgr2=0x5639ea57bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2274345952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7b50 0x5639ea57bcd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9af800a480 tx=0x7f9af801b280 comp rx=0 tx=0).stop 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2274345952 shutdown_connections 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2274345952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7b50 0x5639ea57bcd0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2274345952 >> 172.21.15.117:0/2274345952 conn(0x5639ea56de90 msgr2=0x5639ea5702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2274345952 shutdown_connections 2024-09-10T06:23:53.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.343+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2274345952 wait complete. 2024-09-10T06:23:53.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639ea47b680 con 0x5639ea4e7770 2024-09-10T06:23:53.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56644/0 (socket says 172.21.15.117:56644) 2024-09-10T06:23:53.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b0254e640 1 -- 172.21.15.117:0/618209761 learned_addr learned my addr 172.21.15.117:0/618209761 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b0254e640 1 -- 172.21.15.117:0/618209761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea3f6da0 con 0x5639ea4e7770 2024-09-10T06:23:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b0254e640 1 --2- 172.21.15.117:0/618209761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0016a0 tx=0x7f9afc001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8f13b36e72535f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f99f0608640 1 -- 172.21.15.117:0/618209761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc004530 con 0x5639ea4e7770 2024-09-10T06:23:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f99f0608640 1 -- 172.21.15.117:0/618209761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0046d0 con 0x5639ea4e7770 2024-09-10T06:23:53.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f99f0608640 1 -- 172.21.15.117:0/618209761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc0049f0 con 0x5639ea4e7770 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- 172.21.15.117:0/618209761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 msgr2=0x5639ea660850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/618209761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0016a0 tx=0x7f9afc001b60 comp rx=0 tx=0).stop 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- 172.21.15.117:0/618209761 shutdown_connections 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/618209761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea660850 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- 172.21.15.117:0/618209761 >> 172.21.15.117:0/618209761 conn(0x5639ea56de90 msgr2=0x5639ea65c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- 172.21.15.117:0/618209761 shutdown_connections 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 -- 172.21.15.117:0/618209761 wait complete. 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.359+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea667ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639ea41da50 con 0x5639ea4e7770 2024-09-10T06:23:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea667ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea667ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56652/0 (socket says 172.21.15.117:56652) 2024-09-10T06:23:53.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b0254e640 1 -- 172.21.15.117:0/4056412287 learned_addr learned my addr 172.21.15.117:0/4056412287 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b0254e640 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea668430 con 0x5639ea4e7770 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b0254e640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea667ed0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9afc001ba0 tx=0x7f9afc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 -- 172.21.15.117:0/4056412287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc013760 con 0x5639ea4e7770 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639ea6686c0 con 0x5639ea4e7770 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 -- 172.21.15.117:0/4056412287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc013900 con 0x5639ea4e7770 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 -- 172.21.15.117:0/4056412287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc013c00 con 0x5639ea4e7770 2024-09-10T06:23:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ea669070 con 0x5639ea4e7770 2024-09-10T06:23:53.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 -- 172.21.15.117:0/4056412287 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9afc010070 con 0x5639ea4e7770 2024-09-10T06:23:53.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99e8039a70 0x7f99e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f99eee05640 1 -- 172.21.15.117:0/4056412287 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9afc018070 con 0x5639ea4e7770 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99e8039a70 0x7f99e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea4e7b50 0x5639ea66f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea66f580 con 0x5639ea4e7b50 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.363+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea4e7b50 0x5639ea66f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99e8039a70 0x7f99e803bf30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea4e7b50 0x5639ea66f040 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b02d4f640 1 -- 172.21.15.117:0/4056412287 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea4e7b50 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6694a0 con 0x5639ea4e7b50 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b02d4f640 1 -- 172.21.15.117:0/4056412287 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea4e7b50 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea671870 0x5639ea673c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea674330 con 0x5639ea671870 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b0254e640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea671870 0x5639ea673c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b0254e640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea671870 0x5639ea673c60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b0254e640 1 -- 172.21.15.117:0/4056412287 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9afc01b030 con 0x5639ea671870 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6706e0 con 0x5639ea4e7b50 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b02d4f640 1 -- 172.21.15.117:0/4056412287 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea4e7b50 2024-09-10T06:23:53.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea675770 0x5639ea677b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6782d0 con 0x5639ea675770 2024-09-10T06:23:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea675770 0x5639ea677b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea675770 0x5639ea677b60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b01d4d640 1 -- 172.21.15.117:0/4056412287 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9af80b3040 con 0x5639ea675770 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.367+0000 7f9b04a489c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639ea488450 con 0x5639ea685d10 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56658/0 (socket says 172.21.15.117:56658) 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 -- 172.21.15.117:0/2211229587 learned_addr learned my addr 172.21.15.117:0/2211229587 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 -- 172.21.15.117:0/2211229587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea686770 con 0x5639ea685d10 2024-09-10T06:23:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9afc04e9d0 tx=0x7f9afc043f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 -- 172.21.15.117:0/2211229587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc038070 con 0x5639ea685d10 2024-09-10T06:23:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 -- 172.21.15.117:0/2211229587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc041b10 con 0x5639ea685d10 2024-09-10T06:23:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639ea686fd0 con 0x5639ea685d10 2024-09-10T06:23:53.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 -- 172.21.15.117:0/2211229587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc041e30 con 0x5639ea685d10 2024-09-10T06:23:53.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ea687540 con 0x5639ea685d10 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 -- 172.21.15.117:0/2211229587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9afc029d10 con 0x5639ea685d10 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 0x7f99dc03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f99e7fff640 1 -- 172.21.15.117:0/2211229587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9afc04ee00 con 0x5639ea685d10 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 0x7f99dc03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b04a489c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639ea661080 con 0x5639ea692430 2024-09-10T06:23:53.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 0x7f99dc03bee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9af801b2c0 tx=0x7f9af8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56674/0 (socket says 172.21.15.117:56674) 2024-09-10T06:23:53.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.371+0000 7f9b0254e640 1 -- 172.21.15.117:0/2192826934 learned_addr learned my addr 172.21.15.117:0/2192826934 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 -- 172.21.15.117:0/2192826934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea692de0 con 0x5639ea692430 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 --2- 172.21.15.117:0/2192826934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9afc011ff0 tx=0x7f9afc01d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739a64056be80a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99e5ffb640 1 -- 172.21.15.117:0/2192826934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc0432d0 con 0x5639ea692430 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99e5ffb640 1 -- 172.21.15.117:0/2192826934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc047840 con 0x5639ea692430 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99e5ffb640 1 -- 172.21.15.117:0/2192826934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc01da10 con 0x5639ea692430 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2192826934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 msgr2=0x5639ea692810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2192826934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9afc011ff0 tx=0x7f9afc01d410 comp rx=0 tx=0).stop 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2192826934 shutdown_connections 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2192826934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea692810 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2192826934 >> 172.21.15.117:0/2192826934 conn(0x5639ea68e860 msgr2=0x5639ea68caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2192826934 shutdown_connections 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2192826934 wait complete. 2024-09-10T06:23:53.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 Processor -- start 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- start start 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea699770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639ea6932c0 con 0x5639ea692430 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea699770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea699770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56684/0 (socket says 172.21.15.117:56684) 2024-09-10T06:23:53.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 learned_addr learned my addr 172.21.15.117:0/1538029720 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ea699cd0 con 0x5639ea692430 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b0254e640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea699770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9afc010bf0 tx=0x7f9afc036f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99d3fff640 1 -- 172.21.15.117:0/1538029720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc06c070 con 0x5639ea692430 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639ea699cd0 con 0x5639ea692430 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99d3fff640 1 -- 172.21.15.117:0/1538029720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc047840 con 0x5639ea692430 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f99d3fff640 1 -- 172.21.15.117:0/1538029720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9afc0450d0 con 0x5639ea692430 2024-09-10T06:23:53.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.375+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ea69a300 con 0x5639ea692430 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f99d3fff640 1 -- 172.21.15.117:0/1538029720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9afc06f070 con 0x5639ea692430 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f99d3fff640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99cc039a70 0x7f99cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f99d3fff640 1 -- 172.21.15.117:0/1538029720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9afc058030 con 0x5639ea692430 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99cc039a70 0x7f99cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea6a48d0 0x5639ea6a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a74b0 con 0x5639ea6a48d0 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea6a48d0 0x5639ea6a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99cc039a70 0x7f99cc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ae040 tx=0x7f9af80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea6a48d0 0x5639ea6a6d60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 realm 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a7910 con 0x5639ea6a48d0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a81e0 con 0x5639ea6a48d0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea6a9070 0x5639ea6ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6abba0 con 0x5639ea6a9070 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b0254e640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea6a9070 0x5639ea6ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.379+0000 7f9b0254e640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea6a9070 0x5639ea6ab460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b04a489c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b04a489c0 20 searching for the correct realm 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea6adb40 0x5639ea6affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b06b0 con 0x5639ea6adb40 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea6adb40 0x5639ea6affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b01d4d640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea6adb40 0x5639ea6affe0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b06b0 con 0x5639ea6a9070 2024-09-10T06:23:53.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b0254e640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9afc071060 0x7f9afc033900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b06b0 con 0x7f9afc071060 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9afc071060 0x7f9afc033900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9afc071060 0x7f9afc033900 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af40083f0 con 0x7f9afc071060 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af40083f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.383+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a9070 2024-09-10T06:23:53.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a9070 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.387+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a9070 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.391+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a9070 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6adb40 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x7f9afc071060 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a48d0 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6a8580 con 0x5639ea6a9070 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:53.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6ac460 con 0x5639ea6a48d0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6ac850 con 0x5639ea6a48d0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6ac850 con 0x5639ea6adb40 2024-09-10T06:23:53.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 zone default found 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 4 Realm: () 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 zonegroup default 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.395+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b0b30 con 0x7f9afc071060 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b2520 con 0x5639ea6adb40 2024-09-10T06:23:53.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b28c0 con 0x5639ea6adb40 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b19c0 con 0x5639ea6a9070 2024-09-10T06:23:53.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94806746013104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b3160 con 0x5639ea6a9070 2024-09-10T06:23:53.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b39b0 con 0x5639ea6a48d0 2024-09-10T06:23:53.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.399+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94806746013104] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94806746016944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b39f0 con 0x5639ea6a48d0 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b4500 con 0x5639ea6adb40 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94806746016944] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94806746021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b48f0 con 0x5639ea6adb40 2024-09-10T06:23:53.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b52b0 con 0x5639ea6a9070 2024-09-10T06:23:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.403+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94806746025744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b5980 con 0x5639ea6a9070 2024-09-10T06:23:53.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b64a0 con 0x5639ea6a48d0 2024-09-10T06:23:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94806746021808] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94806746025744] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94806746029936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6460 con 0x5639ea6a48d0 2024-09-10T06:23:53.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.407+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6d40 con 0x7f9afc071060 2024-09-10T06:23:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94806746029936] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94806746019072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6460 con 0x7f9afc071060 2024-09-10T06:23:53.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b7240 con 0x7f9afc071060 2024-09-10T06:23:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94806746033392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b76b0 con 0x7f9afc071060 2024-09-10T06:23:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b8190 con 0x7f9afc071060 2024-09-10T06:23:53.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.411+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94806746019072] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94806746033392] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94806746037408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b7200 con 0x7f9afc071060 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=0 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=1 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=2 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=3 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=4 2024-09-10T06:23:53.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=5 2024-09-10T06:23:53.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=6 2024-09-10T06:23:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94806746037408] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 20 add_watcher() i=7 2024-09-10T06:23:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6bb290 con 0x5639ea6a48d0 2024-09-10T06:23:53.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.415+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94806746032192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b8710 con 0x5639ea6a48d0 2024-09-10T06:23:53.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94806746032192] v32'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f99b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 5 note: GC not initialized 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f99337fe640 20 reqs_thread_entry: start 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 Filter name: none 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f99317fa640 20 reqs_thread_entry: start 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6de170 con 0x5639ea6a48d0 2024-09-10T06:23:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6df6c0 con 0x7f9afc071060 2024-09-10T06:23:53.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.419+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f99b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94806746032192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6dda90 con 0x5639ea6a48d0 2024-09-10T06:23:53.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94806746032192] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94806746013104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6840 con 0x5639ea6a9070 2024-09-10T06:23:53.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94806746013104] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b04a489c0 20 remove_watcher() i=0 2024-09-10T06:23:53.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b04a489c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.423+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94806746016944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6840 con 0x5639ea6a48d0 2024-09-10T06:23:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94806746016944] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b04a489c0 20 remove_watcher() i=1 2024-09-10T06:23:53.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94806746021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b2cb0 con 0x5639ea6adb40 2024-09-10T06:23:53.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b01d4d640 1 -- 172.21.15.117:0/1538029720 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94806746021808] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af80c9030 con 0x5639ea6adb40 2024-09-10T06:23:53.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b04a489c0 20 remove_watcher() i=2 2024-09-10T06:23:53.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.427+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94806746025744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6840 con 0x5639ea6a9070 2024-09-10T06:23:53.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b0254e640 1 -- 172.21.15.117:0/1538029720 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94806746025744] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9afc06e030 con 0x5639ea6a9070 2024-09-10T06:23:53.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b04a489c0 20 remove_watcher() i=3 2024-09-10T06:23:53.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94806746029936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b3fb0 con 0x5639ea6a48d0 2024-09-10T06:23:53.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94806746029936] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x5639ea6a48d0 2024-09-10T06:23:53.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b04a489c0 20 remove_watcher() i=4 2024-09-10T06:23:53.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.431+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94806746019072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b2cb0 con 0x7f9afc071060 2024-09-10T06:23:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94806746019072] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b04a489c0 20 remove_watcher() i=5 2024-09-10T06:23:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94806746033392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b4f10 con 0x7f9afc071060 2024-09-10T06:23:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94806746033392] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b04a489c0 20 remove_watcher() i=6 2024-09-10T06:23:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.435+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94806746037408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5639ea6b6840 con 0x7f9afc071060 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94806746037408] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9af4026040 con 0x7f9afc071060 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 20 remove_watcher() i=7 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9afc071060 msgr2=0x7f9afc033900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9afc071060 0x7f9afc033900 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea6a48d0 msgr2=0x5639ea6a6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea6a48d0 0x5639ea6a6d60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea6a9070 msgr2=0x5639ea6ab460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea6a9070 0x5639ea6ab460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea6adb40 msgr2=0x5639ea6affe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea6adb40 0x5639ea6affe0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99cc039a70 msgr2=0x7f99cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99cc039a70 0x7f99cc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ae040 tx=0x7f9af80b9040 comp rx=0 tx=0).stop 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 msgr2=0x5639ea699770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/1538029720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea692430 0x5639ea699770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9afc010bf0 tx=0x7f9afc036f60 comp rx=0 tx=0).stop 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b02d4f640 1 -- 172.21.15.117:0/1538029720 reap_dead start 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 shutdown_connections 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 >> 172.21.15.117:0/1538029720 conn(0x5639ea68e860 msgr2=0x5639ea68ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 shutdown_connections 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/1538029720 wait complete. 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 msgr2=0x7f99dc03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 0x7f99dc03bee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9af801b2c0 tx=0x7f9af8005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 msgr2=0x5639ea686130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9afc04e9d0 tx=0x7f9afc043f00 comp rx=0 tx=0).stop 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 shutdown_connections 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99dc039a20 0x7f99dc03bee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/2211229587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea685d10 0x5639ea686130 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 >> 172.21.15.117:0/2211229587 conn(0x5639ea67b6c0 msgr2=0x5639ea67baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 shutdown_connections 2024-09-10T06:23:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/2211229587 wait complete. 2024-09-10T06:23:53.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea4e7b50 msgr2=0x5639ea66f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5639ea4e7b50 0x5639ea66f040 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea671870 msgr2=0x5639ea673c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5639ea671870 0x5639ea673c60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea675770 msgr2=0x5639ea677b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5639ea675770 0x5639ea677b60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99e8039a70 msgr2=0x7f99e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f99e8039a70 0x7f99e803bf30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af80a5040 comp rx=0 tx=0).stop 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 msgr2=0x5639ea667ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 --2- 172.21.15.117:0/4056412287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639ea4e7770 0x5639ea667ed0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9afc001ba0 tx=0x7f9afc004470 comp rx=0 tx=0).stop 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b02d4f640 1 -- 172.21.15.117:0/4056412287 reap_dead start 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 shutdown_connections 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 >> 172.21.15.117:0/4056412287 conn(0x5639ea56de90 msgr2=0x5639ea65af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 shutdown_connections 2024-09-10T06:23:53.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.439+0000 7f9b04a489c0 1 -- 172.21.15.117:0/4056412287 wait complete. 2024-09-10T06:23:53.456 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.456 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.456 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T06:23:53.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T06:23:53.457 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-10T06:23:53.531 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fd4a99c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55de32def560 0x55de32df1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fd4a99c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de32ca09c0 con 0x55de32deb370 2024-09-10T06:23:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fd4a99c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55de32cf06d0 con 0x55de32def560 2024-09-10T06:23:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fa7ae640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55de32def560 0x55de32df1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fa7ae640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55de32def560 0x55de32df1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56688/0 (socket says 172.21.15.117:56688) 2024-09-10T06:23:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fa7ae640 1 -- 172.21.15.117:0/978152696 learned_addr learned my addr 172.21.15.117:0/978152696 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fafaf640 1 --1- 172.21.15.117:0/978152696 >> v1:172.21.15.84:6789/0 conn(0x55de32deb370 0x55de32deb750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45856/0 (socket says 172.21.15.117:45856) 2024-09-10T06:23:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fa7ae640 1 -- 172.21.15.117:0/978152696 >> v1:172.21.15.84:6789/0 conn(0x55de32deb370 legacy=0x55de32deb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.527+0000 7f11fa7ae640 1 -- 172.21.15.117:0/978152696 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32c94ca0 con 0x55de32def560 2024-09-10T06:23:53.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/978152696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32def560 0x55de32df1950 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f11f000a4e0 tx=0x7f11f001b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3866bb84e2523 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11f9fad640 1 -- 172.21.15.117:0/978152696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f00aa540 con 0x55de32def560 2024-09-10T06:23:53.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11f9fad640 1 -- 172.21.15.117:0/978152696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00aa6e0 con 0x55de32def560 2024-09-10T06:23:53.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11f9fad640 1 -- 172.21.15.117:0/978152696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f00aaa40 con 0x55de32def560 2024-09-10T06:23:53.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/978152696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32def560 msgr2=0x55de32df1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/978152696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32def560 0x55de32df1950 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f11f000a4e0 tx=0x7f11f001b120 comp rx=0 tx=0).stop 2024-09-10T06:23:53.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/978152696 shutdown_connections 2024-09-10T06:23:53.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/978152696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32def560 0x55de32df1950 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/978152696 >> 172.21.15.117:0/978152696 conn(0x55de32de6e90 msgr2=0x55de32de92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/978152696 shutdown_connections 2024-09-10T06:23:53.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.531+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/978152696 wait complete. 2024-09-10T06:23:53.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de32cf4680 con 0x55de32deb370 2024-09-10T06:23:53.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56704/0 (socket says 172.21.15.117:56704) 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fafaf640 1 -- 172.21.15.117:0/2708868235 learned_addr learned my addr 172.21.15.117:0/2708868235 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fafaf640 1 -- 172.21.15.117:0/2708868235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32c6fda0 con 0x55de32deb370 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fafaf640 1 --2- 172.21.15.117:0/2708868235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d530 tx=0x7f11ec008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd663fb012299095 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f10e8e09640 1 -- 172.21.15.117:0/2708868235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec00b890 con 0x55de32deb370 2024-09-10T06:23:53.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f10e8e09640 1 -- 172.21.15.117:0/2708868235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec00ba50 con 0x55de32deb370 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f10e8e09640 1 -- 172.21.15.117:0/2708868235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec00bd70 con 0x55de32deb370 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2708868235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 msgr2=0x55de32ed5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2708868235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d530 tx=0x7f11ec008f90 comp rx=0 tx=0).stop 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2708868235 shutdown_connections 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2708868235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32ed5640 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2708868235 >> 172.21.15.117:0/2708868235 conn(0x55de32de6e90 msgr2=0x55de32ed12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.547+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2708868235 shutdown_connections 2024-09-10T06:23:53.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2708868235 wait complete. 2024-09-10T06:23:53.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32edcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de32c96a50 con 0x55de32deb370 2024-09-10T06:23:53.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32edcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32edcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56716/0 (socket says 172.21.15.117:56716) 2024-09-10T06:23:53.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fafaf640 1 -- 172.21.15.117:0/2888705128 learned_addr learned my addr 172.21.15.117:0/2888705128 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fafaf640 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32edd240 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fafaf640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32edcce0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55de32ed6630 tx=0x7f11ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 -- 172.21.15.117:0/2888705128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec026020 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de32edd4d0 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 -- 172.21.15.117:0/2888705128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec0227c0 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de32eddf00 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 -- 172.21.15.117:0/2888705128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec022b20 con 0x55de32deb370 2024-09-10T06:23:53.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 -- 172.21.15.117:0/2888705128 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f11ec029020 con 0x55de32deb370 2024-09-10T06:23:53.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10e0039ac0 0x7f10e003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f10e7606640 1 -- 172.21.15.117:0/2888705128 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f11ec052dc0 con 0x55de32deb370 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10e0039ac0 0x7f10e003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32def560 0x55de32ee3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.551+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32ee4390 con 0x55de32def560 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32def560 0x55de32ee3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10e0039ac0 0x7f10e003bf80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ab000 tx=0x7f11f00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32def560 0x55de32ee3e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fb7b0640 1 -- 172.21.15.117:0/2888705128 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32def560 2024-09-10T06:23:53.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32ede190 con 0x55de32def560 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fb7b0640 1 -- 172.21.15.117:0/2888705128 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32def560 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32ee6600 0x55de32ee89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32ee90c0 con 0x55de32ee6600 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32ee6600 0x55de32ee89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32ee6600 0x55de32ee89f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 -- 172.21.15.117:0/2888705128 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f11ec01f040 con 0x55de32ee6600 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32ee54a0 con 0x55de32def560 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fb7b0640 1 -- 172.21.15.117:0/2888705128 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32def560 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32eea500 0x55de32eec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32eed080 con 0x55de32eea500 2024-09-10T06:23:53.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32eea500 0x55de32eec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32eea500 0x55de32eec8f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fa7ae640 1 -- 172.21.15.117:0/2888705128 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f11f00bc040 con 0x55de32eea500 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fd4a99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de32d01450 con 0x55de32efab40 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56718/0 (socket says 172.21.15.117:56718) 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.555+0000 7f11fafaf640 1 -- 172.21.15.117:0/1363233072 learned_addr learned my addr 172.21.15.117:0/1363233072 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 -- 172.21.15.117:0/1363233072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32efb5a0 con 0x55de32efab40 2024-09-10T06:23:53.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f11ec008880 tx=0x7f11ec02aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 -- 172.21.15.117:0/1363233072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec016560 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de32efbe00 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 -- 172.21.15.117:0/1363233072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec016720 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 -- 172.21.15.117:0/1363233072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec041060 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de32efc370 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 -- 172.21.15.117:0/1363233072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f11ec04a070 con 0x55de32efab40 2024-09-10T06:23:53.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 0x7f10d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f10e4e01640 1 -- 172.21.15.117:0/1363233072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f11ec03dba0 con 0x55de32efab40 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 0x7f10d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 0x7f10d403bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11f001b160 tx=0x7f11f0005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fd4a99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de32ed5e70 con 0x55de32f0b620 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56728/0 (socket says 172.21.15.117:56728) 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 -- 172.21.15.117:0/2328461307 learned_addr learned my addr 172.21.15.117:0/2328461307 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.559+0000 7f11fafaf640 1 -- 172.21.15.117:0/2328461307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32f0c010 con 0x55de32f0b620 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 --2- 172.21.15.117:0/2328461307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00b3a0 tx=0x7f11ec0498c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4fa438a4101b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10de7fc640 1 -- 172.21.15.117:0/2328461307 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec05f020 con 0x55de32f0b620 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10de7fc640 1 -- 172.21.15.117:0/2328461307 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec0499d0 con 0x55de32f0b620 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10de7fc640 1 -- 172.21.15.117:0/2328461307 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec034d70 con 0x55de32f0b620 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2328461307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 msgr2=0x55de32f0ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2328461307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00b3a0 tx=0x7f11ec0498c0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2328461307 shutdown_connections 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2328461307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f0ba20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2328461307 >> 172.21.15.117:0/2328461307 conn(0x55de32f03640 msgr2=0x55de32f01880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2328461307 shutdown_connections 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2328461307 wait complete. 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 Processor -- start 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- start start 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de32f0c4b0 con 0x55de32f0b620 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56734/0 (socket says 172.21.15.117:56734) 2024-09-10T06:23:53.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 learned_addr learned my addr 172.21.15.117:0/3828414953 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de32f12eb0 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fafaf640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f11ec049900 tx=0x7f11ec01bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10dcff9640 1 -- 172.21.15.117:0/3828414953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec074070 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de32f12eb0 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de32f13480 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10dcff9640 1 -- 172.21.15.117:0/3828414953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec0499d0 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.563+0000 7f10dcff9640 1 -- 172.21.15.117:0/3828414953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11ec02fde0 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f10dcff9640 1 -- 172.21.15.117:0/3828414953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f11ec077070 con 0x55de32f0b620 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f10dcff9640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10c4039a70 0x7f10c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f10dcff9640 1 -- 172.21.15.117:0/3828414953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f11ec06b030 con 0x55de32f0b620 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10c4039a70 0x7f10c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32f1db70 0x55de32f20000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f20750 con 0x55de32f1db70 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32f1db70 0x55de32f20000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10c4039a70 0x7f10c403bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f11f0018d50 tx=0x7f11f00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32f1db70 0x55de32f20000 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32f1db70 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 realm 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f20b60 con 0x55de32f1db70 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32f1db70 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:53.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f21430 con 0x55de32f1db70 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32f1db70 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32f1db70 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32f22300 0x55de32f246f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f24e30 con 0x55de32f22300 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fafaf640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32f22300 0x55de32f246f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fafaf640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32f22300 0x55de32f246f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 20 searching for the correct realm 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32f26dd0 0x55de32f29270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f29940 con 0x55de32f26dd0 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32f26dd0 0x55de32f29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32f26dd0 0x55de32f29270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.567+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f29940 con 0x55de32f22300 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fafaf640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f11ec079060 0x7f11ec0217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f29940 con 0x7f11ec079060 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f11ec079060 0x7f11ec0217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f11ec079060 0x7f11ec0217d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f40083f0 con 0x7f11ec079060 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f40083f0 con 0x55de32f1db70 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f22300 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.571+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f22300 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.575+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f22300 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f22300 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f26dd0 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.579+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x7f11ec079060 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f1db70 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55de32f217d0 con 0x55de32f22300 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f256f0 con 0x55de32f1db70 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f25ae0 con 0x55de32f1db70 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f25ae0 con 0x55de32f26dd0 2024-09-10T06:23:53.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 zone default found 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 4 Realm: () 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 zonegroup default 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f29dc0 con 0x7f11ec079060 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2b7b0 con 0x55de32f26dd0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2bb50 con 0x55de32f26dd0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2ac50 con 0x55de32f22300 2024-09-10T06:23:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412825866304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2c3f0 con 0x55de32f22300 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.583+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2cc40 con 0x55de32f1db70 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.587+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412825866304] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.587+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.587+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412825870144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2cc40 con 0x55de32f1db70 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.587+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2d670 con 0x55de32f26dd0 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.587+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412825870144] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412825872272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2cbb0 con 0x55de32f26dd0 2024-09-10T06:23:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2e450 con 0x55de32f22300 2024-09-10T06:23:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412825878336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2ecf0 con 0x55de32f22300 2024-09-10T06:23:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2f6f0 con 0x55de32f1db70 2024-09-10T06:23:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412825872272] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412825878336] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412825877136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2e840 con 0x55de32f1db70 2024-09-10T06:23:53.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.591+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2ff90 con 0x7f11ec079060 2024-09-10T06:23:53.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.595+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412825877136] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.595+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.595+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412825883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2fcb0 con 0x7f11ec079060 2024-09-10T06:23:53.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.595+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f30500 con 0x7f11ec079060 2024-09-10T06:23:53.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.595+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412825883136] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412825884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f302c0 con 0x7f11ec079060 2024-09-10T06:23:53.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f30de0 con 0x7f11ec079060 2024-09-10T06:23:53.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412825884944] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412825888944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f30da0 con 0x7f11ec079060 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=0 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=1 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=2 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=3 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=4 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=5 2024-09-10T06:23:53.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.599+0000 7f11fd4a99c0 20 add_watcher() i=6 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412825888944] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 add_watcher() i=7 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f34200 con 0x55de32f1db70 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412825886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f316c0 con 0x55de32f1db70 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412825886000] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f10b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 5 note: GC not initialized 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f102bfff640 20 reqs_thread_entry: start 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 Filter name: none 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f1029ffb640 20 reqs_thread_entry: start 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f57390 con 0x55de32f1db70 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.603+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55de32f588e0 con 0x7f11ec079060 2024-09-10T06:23:53.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f10b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412825886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f56cb0 con 0x55de32f1db70 2024-09-10T06:23:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94412825886000] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412825866304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f56cb0 con 0x55de32f22300 2024-09-10T06:23:53.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94412825866304] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fd4a99c0 20 remove_watcher() i=0 2024-09-10T06:23:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fd4a99c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.607+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412825870144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2b040 con 0x55de32f1db70 2024-09-10T06:23:53.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94412825870144] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fd4a99c0 20 remove_watcher() i=1 2024-09-10T06:23:53.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412825872272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2b040 con 0x55de32f26dd0 2024-09-10T06:23:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fa7ae640 1 -- 172.21.15.117:0/3828414953 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94412825872272] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f00ca070 con 0x55de32f26dd0 2024-09-10T06:23:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fd4a99c0 20 remove_watcher() i=2 2024-09-10T06:23:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.611+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412825878336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2c790 con 0x55de32f22300 2024-09-10T06:23:53.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fafaf640 1 -- 172.21.15.117:0/3828414953 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94412825878336] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11ec076030 con 0x55de32f22300 2024-09-10T06:23:53.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fd4a99c0 20 remove_watcher() i=3 2024-09-10T06:23:53.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412825877136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2df40 con 0x55de32f1db70 2024-09-10T06:23:53.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94412825877136] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x55de32f1db70 2024-09-10T06:23:53.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fd4a99c0 20 remove_watcher() i=4 2024-09-10T06:23:53.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.615+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412825883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2c790 con 0x7f11ec079060 2024-09-10T06:23:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94412825883136] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fd4a99c0 20 remove_watcher() i=5 2024-09-10T06:23:53.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412825884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2da90 con 0x7f11ec079060 2024-09-10T06:23:53.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94412825884944] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fd4a99c0 20 remove_watcher() i=6 2024-09-10T06:23:53.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.619+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412825888944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55de32f2fdc0 con 0x7f11ec079060 2024-09-10T06:23:53.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94412825888944] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11f4026040 con 0x7f11ec079060 2024-09-10T06:23:53.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 20 remove_watcher() i=7 2024-09-10T06:23:53.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f11ec079060 msgr2=0x7f11ec0217d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f11ec079060 0x7f11ec0217d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32f1db70 msgr2=0x55de32f20000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32f1db70 0x55de32f20000 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32f22300 msgr2=0x55de32f246f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32f22300 0x55de32f246f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32f26dd0 msgr2=0x55de32f29270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32f26dd0 0x55de32f29270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10c4039a70 msgr2=0x7f10c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10c4039a70 0x7f10c403bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f11f0018d50 tx=0x7f11f00a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 msgr2=0x55de32f12950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fb7b0640 1 -- 172.21.15.117:0/3828414953 reap_dead start 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f11ec049900 tx=0x7f11ec01bf40 comp rx=0 tx=0).stop 2024-09-10T06:23:53.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 shutdown_connections 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/3828414953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32f0b620 0x55de32f12950 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 >> 172.21.15.117:0/3828414953 conn(0x55de32f03640 msgr2=0x55de32f01850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 shutdown_connections 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/3828414953 wait complete. 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 msgr2=0x7f10d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 0x7f10d403bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11f001b160 tx=0x7f11f0005e50 comp rx=0 tx=0).stop 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 msgr2=0x55de32efaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f11ec008880 tx=0x7f11ec02aed0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 shutdown_connections 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10d4039a70 0x7f10d403bf30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/1363233072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32efab40 0x55de32efaf60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 >> 172.21.15.117:0/1363233072 conn(0x55de32ef04f0 msgr2=0x55de32ef08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 shutdown_connections 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/1363233072 wait complete. 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32def560 msgr2=0x55de32ee3e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55de32def560 0x55de32ee3e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32ee6600 msgr2=0x55de32ee89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55de32ee6600 0x55de32ee89f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32eea500 msgr2=0x55de32eec8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55de32eea500 0x55de32eec8f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10e0039ac0 msgr2=0x7f10e003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f10e0039ac0 0x7f10e003bf80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ab000 tx=0x7f11f00a5000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 msgr2=0x55de32edcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 --2- 172.21.15.117:0/2888705128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de32deb370 0x55de32edcce0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55de32ed6630 tx=0x7f11ec000bd0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fb7b0640 1 -- 172.21.15.117:0/2888705128 reap_dead start 2024-09-10T06:23:53.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 shutdown_connections 2024-09-10T06:23:53.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 >> 172.21.15.117:0/2888705128 conn(0x55de32de6e90 msgr2=0x55de32ecfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 shutdown_connections 2024-09-10T06:23:53.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.623+0000 7f11fd4a99c0 1 -- 172.21.15.117:0/2888705128 wait complete. 2024-09-10T06:23:53.638 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.639 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T06:23:53.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T06:23:53.639 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-10T06:23:53.710 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:53.710 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:53.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ec24289c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f3ad002060 0x55f3ad002440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ec24289c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3acf3f9c0 con 0x55f3ad000a60 2024-09-10T06:23:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ec24289c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55f3acf8f6d0 con 0x55f3ad002060 2024-09-10T06:23:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ebff2e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f3ad002060 0x55f3ad002440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ebff2e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f3ad002060 0x55f3ad002440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56750/0 (socket says 172.21.15.117:56750) 2024-09-10T06:23:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ebff2e640 1 -- 172.21.15.117:0/1722120438 learned_addr learned my addr 172.21.15.117:0/1722120438 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ebff2e640 1 -- 172.21.15.117:0/1722120438 >> v1:172.21.15.84:6789/0 conn(0x55f3ad000a60 legacy=0x55f3ad000e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.707+0000 7f8ebff2e640 1 -- 172.21.15.117:0/1722120438 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3acf33ca0 con 0x55f3ad002060 2024-09-10T06:23:53.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/1722120438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad002440 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000a5c0 tx=0x7f8eb001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1363ff6b469c2d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ebef2c640 1 -- 172.21.15.117:0/1722120438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00a6070 con 0x55f3ad002060 2024-09-10T06:23:53.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ebef2c640 1 -- 172.21.15.117:0/1722120438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00af070 con 0x55f3ad002060 2024-09-10T06:23:53.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ebef2c640 1 -- 172.21.15.117:0/1722120438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00aa5c0 con 0x55f3ad002060 2024-09-10T06:23:53.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 -- 172.21.15.117:0/1722120438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 msgr2=0x55f3ad002440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/1722120438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad002440 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000a5c0 tx=0x7f8eb001b340 comp rx=0 tx=0).stop 2024-09-10T06:23:53.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 -- 172.21.15.117:0/1722120438 shutdown_connections 2024-09-10T06:23:53.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/1722120438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad002440 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 -- 172.21.15.117:0/1722120438 >> 172.21.15.117:0/1722120438 conn(0x55f3ad087040 msgr2=0x55f3ad089460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 -- 172.21.15.117:0/1722120438 shutdown_connections 2024-09-10T06:23:53.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.711+0000 7f8ec24289c0 1 -- 172.21.15.117:0/1722120438 wait complete. 2024-09-10T06:23:53.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ec24289c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ec24289c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3acf93680 con 0x55f3ad000a60 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56756/0 (socket says 172.21.15.117:56756) 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ebff2e640 1 -- 172.21.15.117:0/2462789602 learned_addr learned my addr 172.21.15.117:0/2462789602 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ebff2e640 1 -- 172.21.15.117:0/2462789602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3acf0eda0 con 0x55f3ad000a60 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/2462789602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00ac040 tx=0x7f8eb0002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de686e0d3a842d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8dade0b640 1 -- 172.21.15.117:0/2462789602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00aa970 con 0x55f3ad000a60 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8dade0b640 1 -- 172.21.15.117:0/2462789602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00aab10 con 0x55f3ad000a60 2024-09-10T06:23:53.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.723+0000 7f8dade0b640 1 -- 172.21.15.117:0/2462789602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00aae30 con 0x55f3ad000a60 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2462789602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 msgr2=0x55f3ad178d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/2462789602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00ac040 tx=0x7f8eb0002fc0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2462789602 shutdown_connections 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/2462789602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad000a60 0x55f3ad178d30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2462789602 >> 172.21.15.117:0/2462789602 conn(0x55f3ad087040 msgr2=0x55f3ad1749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2462789602 shutdown_connections 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2462789602 wait complete. 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad1804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3acf35a50 con 0x55f3ad002060 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad1804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad1804d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56764/0 (socket says 172.21.15.117:56764) 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ebff2e640 1 -- 172.21.15.117:0/3262932337 learned_addr learned my addr 172.21.15.117:0/3262932337 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ebff2e640 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ad180a30 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad1804d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8eb001b170 tx=0x55f3ad0019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8da7fff640 1 -- 172.21.15.117:0/3262932337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00cb020 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3ad180cc0 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8da7fff640 1 -- 172.21.15.117:0/3262932337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00abe50 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8da7fff640 1 -- 172.21.15.117:0/3262932337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00c6590 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.727+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ad181580 con 0x55f3ad002060 2024-09-10T06:23:53.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8da7fff640 1 -- 172.21.15.117:0/3262932337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8eb00ce020 con 0x55f3ad002060 2024-09-10T06:23:53.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8da7fff640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8da8039a70 0x7f8da803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8da7fff640 1 -- 172.21.15.117:0/3262932337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8eb00eb5f0 con 0x55f3ad002060 2024-09-10T06:23:53.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8da8039a70 0x7f8da803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad185540 0x55f3ad187930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad187e70 con 0x55f3ad185540 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec072f640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad185540 0x55f3ad187930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8da8039a70 0x7f8da803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4001e60 tx=0x7f8eb40013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec072f640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad185540 0x55f3ad187930 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec072f640 1 -- 172.21.15.117:0/3262932337 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad185540 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1819a0 con 0x55f3ad185540 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec072f640 1 -- 172.21.15.117:0/3262932337 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad185540 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad18a110 0x55f3ad18c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad18cc40 con 0x55f3ad18a110 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad18a110 0x55f3ad18c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad18a110 0x55f3ad18c500 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebff2e640 1 -- 172.21.15.117:0/3262932337 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8eb00bd770 con 0x55f3ad18a110 2024-09-10T06:23:53.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad188f80 con 0x55f3ad185540 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec072f640 1 -- 172.21.15.117:0/3262932337 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad185540 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad18e080 0x55f3ad190470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad190b60 con 0x55f3ad18e080 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad18e080 0x55f3ad190470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad18e080 0x55f3ad190470 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ebf72d640 1 -- 172.21.15.117:0/3262932337 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8eb400d040 con 0x55f3ad18e080 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.731+0000 7f8ec24289c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3acfa0450 con 0x55f3ad19e660 2024-09-10T06:23:53.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56772/0 (socket says 172.21.15.117:56772) 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 -- 172.21.15.117:0/3243216755 learned_addr learned my addr 172.21.15.117:0/3243216755 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 -- 172.21.15.117:0/3243216755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ad19f0c0 con 0x55f3ad19e660 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00e9af0 tx=0x7f8eb00eb3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 -- 172.21.15.117:0/3243216755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00c8280 con 0x55f3ad19e660 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 -- 172.21.15.117:0/3243216755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00c8420 con 0x55f3ad19e660 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3ad19f920 con 0x55f3ad19e660 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 -- 172.21.15.117:0/3243216755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00c6b50 con 0x55f3ad19e660 2024-09-10T06:23:53.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ad19f920 con 0x55f3ad19e660 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 -- 172.21.15.117:0/3243216755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8eb00c6cf0 con 0x55f3ad19e660 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 0x7f8d9803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8da57fa640 1 -- 172.21.15.117:0/3243216755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8eb00ed0c0 con 0x55f3ad19e660 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 0x7f8d9803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 0x7f8d9803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55f3ad181d40 tx=0x7f8eb4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ec24289c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3ad1794a0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.735+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56784/0 (socket says 172.21.15.117:56784) 2024-09-10T06:23:53.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 -- 172.21.15.117:0/2191335238 learned_addr learned my addr 172.21.15.117:0/2191335238 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 -- 172.21.15.117:0/2191335238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ad1ac5b0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/2191335238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00a4050 tx=0x7f8eb00d14d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf498e13ef20133 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9effd640 1 -- 172.21.15.117:0/2191335238 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb0103020 con 0x55f3ad1abbc0 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9effd640 1 -- 172.21.15.117:0/2191335238 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00e8670 con 0x55f3ad1abbc0 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9effd640 1 -- 172.21.15.117:0/2191335238 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00ae2d0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2191335238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 msgr2=0x55f3ad1abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/2191335238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00a4050 tx=0x7f8eb00d14d0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2191335238 shutdown_connections 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/2191335238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1abfc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2191335238 >> 172.21.15.117:0/2191335238 conn(0x55f3ad1a6fe0 msgr2=0x55f3ad1a5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2191335238 shutdown_connections 2024-09-10T06:23:53.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/2191335238 wait complete. 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 Processor -- start 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- start start 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3ad1aa990 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56794/0 (socket says 172.21.15.117:56794) 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 learned_addr learned my addr 172.21.15.117:0/566565642 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ad1b23f0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00a4050 tx=0x7f8eb00b3cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9d7fa640 1 -- 172.21.15.117:0/566565642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb0112020 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3ad1b23f0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ad1b23f0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9d7fa640 1 -- 172.21.15.117:0/566565642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb00ebbe0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.739+0000 7f8d9d7fa640 1 -- 172.21.15.117:0/566565642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eb00d1810 con 0x55f3ad1abbc0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8d9d7fa640 1 -- 172.21.15.117:0/566565642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8eb0115070 con 0x55f3ad1abbc0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8d9d7fa640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d88039a70 0x7f8d8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8d9d7fa640 1 -- 172.21.15.117:0/566565642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8eb0118bf0 con 0x55f3ad1abbc0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d88039a70 0x7f8d8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad1bd010 0x55f3ad1bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1bfbf0 con 0x55f3ad1bd010 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad1bd010 0x55f3ad1bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d88039a70 0x7f8d8803bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55f3ad190f60 tx=0x7f8eb4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad1bd010 0x55f3ad1bf4a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 realm 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0000 con 0x55f3ad1bd010 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c08d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad1c1760 0x55f3ad1c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c4290 con 0x55f3ad1c1760 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad1c1760 0x55f3ad1c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad1c1760 0x55f3ad1c3b50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 20 searching for the correct realm 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad1c6230 0x55f3ad1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c8da0 con 0x55f3ad1c6230 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad1c6230 0x55f3ad1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad1c6230 0x55f3ad1c86d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.743+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c8da0 con 0x55f3ad1c1760 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebff2e640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8eb0117060 0x7f8eb00d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c8da0 con 0x7f8eb0117060 2024-09-10T06:23:53.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8eb0117060 0x7f8eb00d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8eb0117060 0x7f8eb00d19b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c1760 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.747+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c1760 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.751+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c1760 2024-09-10T06:23:53.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c1760 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c6230 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x7f8eb0117060 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1bd010 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c0c70 con 0x55f3ad1c1760 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.755+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c4b50 con 0x55f3ad1bd010 2024-09-10T06:23:53.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c4f40 con 0x55f3ad1bd010 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c4f40 con 0x55f3ad1c6230 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 zone default found 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 4 Realm: () 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 zonegroup default 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1c9220 con 0x7f8eb0117060 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cac10 con 0x55f3ad1c6230 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cafb0 con 0x55f3ad1c6230 2024-09-10T06:23:53.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1ca0b0 con 0x55f3ad1c1760 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505069749408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cb890 con 0x55f3ad1c1760 2024-09-10T06:23:53.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cc0e0 con 0x55f3ad1bd010 2024-09-10T06:23:53.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.759+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94505069749408] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505069753312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cc0e0 con 0x55f3ad1bd010 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1ccbc0 con 0x55f3ad1c6230 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94505069753312] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505069755440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cc050 con 0x55f3ad1c6230 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.763+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cd970 con 0x55f3ad1c1760 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505069761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1ce210 con 0x55f3ad1c1760 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cec10 con 0x55f3ad1bd010 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94505069755440] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94505069761632] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505069763936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1ce720 con 0x55f3ad1bd010 2024-09-10T06:23:53.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cf4b0 con 0x7f8eb0117060 2024-09-10T06:23:53.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.767+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94505069763936] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505069760432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cf3f0 con 0x7f8eb0117060 2024-09-10T06:23:53.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cfdb0 con 0x7f8eb0117060 2024-09-10T06:23:53.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94505069760432] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505069771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d01d0 con 0x7f8eb0117060 2024-09-10T06:23:53.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.771+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cef80 con 0x7f8eb0117060 2024-09-10T06:23:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94505069771008] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505069772064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d0140 con 0x7f8eb0117060 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=0 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=1 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=2 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=3 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=4 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=5 2024-09-10T06:23:53.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=6 2024-09-10T06:23:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94505069772064] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 20 add_watcher() i=7 2024-09-10T06:23:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.775+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d3bc0 con 0x55f3ad1bd010 2024-09-10T06:23:53.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505069774560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d1020 con 0x55f3ad1bd010 2024-09-10T06:23:53.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94505069774560] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 5 note: GC not initialized 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8d74fe1640 20 reqs_thread_entry: start 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 Filter name: none 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8cee7fc640 20 reqs_thread_entry: start 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1f6d20 con 0x55f3ad1bd010 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:53.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1f8270 con 0x7f8eb0117060 2024-09-10T06:23:53.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.779+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505069774560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1f6640 con 0x55f3ad1bd010 2024-09-10T06:23:53.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94505069774560] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505069749408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d06e0 con 0x55f3ad1c1760 2024-09-10T06:23:53.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94505069749408] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec24289c0 20 remove_watcher() i=0 2024-09-10T06:23:53.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec24289c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.783+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505069753312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d06e0 con 0x55f3ad1bd010 2024-09-10T06:23:53.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94505069753312] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 20 remove_watcher() i=1 2024-09-10T06:23:53.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505069755440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cb3e0 con 0x55f3ad1c6230 2024-09-10T06:23:53.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ebf72d640 1 -- 172.21.15.117:0/566565642 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94505069755440] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb4036040 con 0x55f3ad1c6230 2024-09-10T06:23:53.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 20 remove_watcher() i=2 2024-09-10T06:23:53.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505069761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d06e0 con 0x55f3ad1c1760 2024-09-10T06:23:53.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ebff2e640 1 -- 172.21.15.117:0/566565642 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94505069761632] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb0114030 con 0x55f3ad1c1760 2024-09-10T06:23:53.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 20 remove_watcher() i=3 2024-09-10T06:23:53.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.787+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505069763936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cbc30 con 0x55f3ad1bd010 2024-09-10T06:23:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94505069763936] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x55f3ad1bd010 2024-09-10T06:23:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec24289c0 20 remove_watcher() i=4 2024-09-10T06:23:53.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505069760432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1d06e0 con 0x7f8eb0117060 2024-09-10T06:23:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94505069760432] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec24289c0 20 remove_watcher() i=5 2024-09-10T06:23:53.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.791+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505069771008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cdd60 con 0x7f8eb0117060 2024-09-10T06:23:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94505069771008] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 20 remove_watcher() i=6 2024-09-10T06:23:53.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505069772064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f3ad1cbc30 con 0x7f8eb0117060 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94505069772064] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb800a4d0 con 0x7f8eb0117060 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 20 remove_watcher() i=7 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8eb0117060 msgr2=0x7f8eb00d19b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8eb0117060 0x7f8eb00d19b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad1bd010 msgr2=0x55f3ad1bf4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad1bd010 0x55f3ad1bf4a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad1c1760 msgr2=0x55f3ad1c3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad1c1760 0x55f3ad1c3b50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad1c6230 msgr2=0x55f3ad1c86d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad1c6230 0x55f3ad1c86d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d88039a70 msgr2=0x7f8d8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d88039a70 0x7f8d8803bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55f3ad190f60 tx=0x7f8eb4011000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 msgr2=0x55f3ad1b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec072f640 1 -- 172.21.15.117:0/566565642 reap_dead start 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00a4050 tx=0x7f8eb00b3cd0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 shutdown_connections 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/566565642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad1abbc0 0x55f3ad1b1e90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 >> 172.21.15.117:0/566565642 conn(0x55f3ad1a6fe0 msgr2=0x55f3ad1a51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 shutdown_connections 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.795+0000 7f8ec24289c0 1 -- 172.21.15.117:0/566565642 wait complete. 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 msgr2=0x7f8d9803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 0x7f8d9803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55f3ad181d40 tx=0x7f8eb4006000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 msgr2=0x55f3ad19ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00e9af0 tx=0x7f8eb00eb3a0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 shutdown_connections 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d98039ac0 0x7f8d9803bf80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3243216755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad19e660 0x55f3ad19ea80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 >> 172.21.15.117:0/3243216755 conn(0x55f3ad194010 msgr2=0x55f3ad1943f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 shutdown_connections 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3243216755 wait complete. 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad185540 msgr2=0x55f3ad187930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f3ad185540 0x55f3ad187930 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad18a110 msgr2=0x55f3ad18c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f3ad18a110 0x55f3ad18c500 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad18e080 msgr2=0x55f3ad190470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f3ad18e080 0x55f3ad190470 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8da8039a70 msgr2=0x7f8da803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8da8039a70 0x7f8da803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4001e60 tx=0x7f8eb40013e0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 msgr2=0x55f3ad1804d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 --2- 172.21.15.117:0/3262932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3ad002060 0x55f3ad1804d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8eb001b170 tx=0x55f3ad0019a0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec072f640 1 -- 172.21.15.117:0/3262932337 reap_dead start 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 shutdown_connections 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 >> 172.21.15.117:0/3262932337 conn(0x55f3ad087040 msgr2=0x55f3ad173460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 shutdown_connections 2024-09-10T06:23:53.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.799+0000 7f8ec24289c0 1 -- 172.21.15.117:0/3262932337 wait complete. 2024-09-10T06:23:53.812 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.812 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T06:23:53.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T06:23:53.813 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-10T06:23:53.892 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:53.892 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:53.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4ef9a69c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60b6316c0 0x55e60b633ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4ef9a69c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e60b4e19c0 con 0x55e60b62d520 2024-09-10T06:23:53.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4ef9a69c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55e60b5316d0 con 0x55e60b6316c0 2024-09-10T06:23:53.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4eccab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60b6316c0 0x55e60b633ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4eccab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e60b6316c0 0x55e60b633ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56806/0 (socket says 172.21.15.117:56806) 2024-09-10T06:23:53.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4eccab640 1 -- 172.21.15.117:0/3812573908 learned_addr learned my addr 172.21.15.117:0/3812573908 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4eccab640 1 -- 172.21.15.117:0/3812573908 >> v1:172.21.15.84:6789/0 conn(0x55e60b62d520 legacy=0x55e60b62d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.887+0000 7fd4eccab640 1 -- 172.21.15.117:0/3812573908 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b4d5ca0 con 0x55e60b6316c0 2024-09-10T06:23:53.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3812573908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b6316c0 0x55e60b633ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800a5c0 tx=0x7fd4d801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea41dab1e9f60fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4e7fff640 1 -- 172.21.15.117:0/3812573908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d80a9590 con 0x55e60b6316c0 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4e7fff640 1 -- 172.21.15.117:0/3812573908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d80ae070 con 0x55e60b6316c0 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4e7fff640 1 -- 172.21.15.117:0/3812573908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d80a9880 con 0x55e60b6316c0 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3812573908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b6316c0 msgr2=0x55e60b633ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3812573908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b6316c0 0x55e60b633ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800a5c0 tx=0x7fd4d801b3d0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3812573908 shutdown_connections 2024-09-10T06:23:53.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3812573908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b6316c0 0x55e60b633ab0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3812573908 >> 172.21.15.117:0/3812573908 conn(0x55e60b629040 msgr2=0x55e60b62b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3812573908 shutdown_connections 2024-09-10T06:23:53.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.891+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3812573908 wait complete. 2024-09-10T06:23:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.903+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.903+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.903+0000 7fd4ef9a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.903+0000 7fd4ef9a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60b535680 con 0x55e60b62d520 2024-09-10T06:23:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56810/0 (socket says 172.21.15.117:56810) 2024-09-10T06:23:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/550776405 learned_addr learned my addr 172.21.15.117:0/550776405 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/550776405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b4b0da0 con 0x55e60b62d520 2024-09-10T06:23:53.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/550776405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001680 tx=0x7fd4e8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7203682ab383806 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd3db606640 1 -- 172.21.15.117:0/550776405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e8016070 con 0x55e60b62d520 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd3db606640 1 -- 172.21.15.117:0/550776405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e800f660 con 0x55e60b62d520 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd3db606640 1 -- 172.21.15.117:0/550776405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e800f980 con 0x55e60b62d520 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/550776405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 msgr2=0x55e60b7188a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/550776405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001680 tx=0x7fd4e8001b40 comp rx=0 tx=0).stop 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/550776405 shutdown_connections 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/550776405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b7188a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/550776405 >> 172.21.15.117:0/550776405 conn(0x55e60b629040 msgr2=0x55e60b714540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/550776405 shutdown_connections 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/550776405 wait complete. 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b71fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ef9a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60b4d7a50 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b71fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b71fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56812/0 (socket says 172.21.15.117:56812) 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/2961321109 learned_addr learned my addr 172.21.15.117:0/2961321109 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b720400 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b71fea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001b80 tx=0x7fd4e8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.907+0000 7fd3d9e03640 1 -- 172.21.15.117:0/2961321109 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e8016040 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e60b720690 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd3d9e03640 1 -- 172.21.15.117:0/2961321109 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8006160 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd3d9e03640 1 -- 172.21.15.117:0/2961321109 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e80114c0 con 0x55e60b62d520 2024-09-10T06:23:53.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e60b721040 con 0x55e60b62d520 2024-09-10T06:23:53.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd3d9e03640 1 -- 172.21.15.117:0/2961321109 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4e8011730 con 0x55e60b62d520 2024-09-10T06:23:53.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd3d9e03640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3d4039a70 0x7fd3d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd3d9e03640 1 -- 172.21.15.117:0/2961321109 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd4e8050130 con 0x55e60b62d520 2024-09-10T06:23:53.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4eccab640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3d4039a70 0x7fd3d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b6316c0 0x55e60b727010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b727550 con 0x55e60b6316c0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4edcad640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b6316c0 0x55e60b727010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4eccab640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3d4039a70 0x7fd3d403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80ad000 tx=0x7fd4d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4edcad640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b6316c0 0x55e60b727010 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4edcad640 1 -- 172.21.15.117:0/2961321109 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b6316c0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b721390 con 0x55e60b6316c0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4edcad640 1 -- 172.21.15.117:0/2961321109 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b6316c0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b729840 0x55e60b72bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b72c300 con 0x55e60b729840 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b729840 0x55e60b72bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b729840 0x55e60b72bc30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/2961321109 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4e8023020 con 0x55e60b729840 2024-09-10T06:23:53.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7286b0 con 0x55e60b6316c0 2024-09-10T06:23:53.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4edcad640 1 -- 172.21.15.117:0/2961321109 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b6316c0 2024-09-10T06:23:53.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b72d760 0x55e60b72fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.911+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b730250 con 0x55e60b72d760 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4eccab640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b72d760 0x55e60b72fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4eccab640 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b72d760 0x55e60b72fb50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4eccab640 1 -- 172.21.15.117:0/2961321109 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b72d760 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60b542450 con 0x55e60b73dd10 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56818/0 (socket says 172.21.15.117:56818) 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3053898164 learned_addr learned my addr 172.21.15.117:0/3053898164 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3053898164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b73e770 con 0x55e60b73dd10 2024-09-10T06:23:53.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd4e804e570 tx=0x7fd4e8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd3d2ffd640 1 -- 172.21.15.117:0/3053898164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e80254d0 con 0x55e60b73dd10 2024-09-10T06:23:53.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e60b73efd0 con 0x55e60b73dd10 2024-09-10T06:23:53.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd3d2ffd640 1 -- 172.21.15.117:0/3053898164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8048b50 con 0x55e60b73dd10 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd3d2ffd640 1 -- 172.21.15.117:0/3053898164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e801cab0 con 0x55e60b73dd10 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e60b73efd0 con 0x55e60b73dd10 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.915+0000 7fd3d2ffd640 1 -- 172.21.15.117:0/3053898164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4e801cc50 con 0x55e60b73dd10 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd3d2ffd640 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 0x7fd3c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd3d2ffd640 1 -- 172.21.15.117:0/3053898164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd4e8047050 con 0x55e60b73dd10 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 0x7fd3c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 0x7fd3c403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55e60b7279a0 tx=0x7fd4d8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60b7190d0 con 0x55e60b74b370 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56822/0 (socket says 172.21.15.117:56822) 2024-09-10T06:23:53.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3921220513 learned_addr learned my addr 172.21.15.117:0/3921220513 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3921220513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b74bd20 con 0x55e60b74b370 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3921220513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8048f20 tx=0x7fd4e8038c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41763dce6df68be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd3d0ff9640 1 -- 172.21.15.117:0/3921220513 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e8038580 con 0x55e60b74b370 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd3d0ff9640 1 -- 172.21.15.117:0/3921220513 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8038920 con 0x55e60b74b370 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd3d0ff9640 1 -- 172.21.15.117:0/3921220513 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e803a060 con 0x55e60b74b370 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3921220513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 msgr2=0x55e60b74b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3921220513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8048f20 tx=0x7fd4e8038c40 comp rx=0 tx=0).stop 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3921220513 shutdown_connections 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3921220513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b74b750 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3921220513 >> 172.21.15.117:0/3921220513 conn(0x55e60b746730 msgr2=0x55e60b744970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3921220513 shutdown_connections 2024-09-10T06:23:53.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3921220513 wait complete. 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 Processor -- start 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- start start 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ef9a69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e60b74a0e0 con 0x55e60b74b370 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56836/0 (socket says 172.21.15.117:56836) 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 learned_addr learned my addr 172.21.15.117:0/3938272899 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.919+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60b751b60 con 0x55e60b74b370 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8048f20 tx=0x7fd4e803b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 -- 172.21.15.117:0/3938272899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e804d4b0 con 0x55e60b74b370 2024-09-10T06:23:53.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e60b751b60 con 0x55e60b74b370 2024-09-10T06:23:53.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 -- 172.21.15.117:0/3938272899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8038920 con 0x55e60b74b370 2024-09-10T06:23:53.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 -- 172.21.15.117:0/3938272899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4e80393f0 con 0x55e60b74b370 2024-09-10T06:23:53.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e60b751b60 con 0x55e60b74b370 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 -- 172.21.15.117:0/3938272899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4e801c520 con 0x55e60b74b370 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3b8039a70 0x7fd3b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd3c2ffd640 1 -- 172.21.15.117:0/3938272899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd4e8063070 con 0x55e60b74b370 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3b8039a70 0x7fd3b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b75c650 0x55e60b75eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b75f230 con 0x55e60b75c650 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b75c650 0x55e60b75eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3b8039a70 0x7fd3b803bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55e60b730650 tx=0x7fd4d80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b75c650 0x55e60b75eae0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b75c650 2024-09-10T06:23:53.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 realm 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b75f640 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b75ff10 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b75c650 2024-09-10T06:23:53.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b760de0 0x55e60b7631d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b763910 con 0x55e60b760de0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.923+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b760de0 0x55e60b7631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b760de0 0x55e60b7631d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ef9a69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ef9a69c0 20 searching for the correct realm 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b7658b0 0x55e60b767d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b768420 con 0x55e60b7658b0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b7658b0 0x55e60b767d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4eccab640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b7658b0 0x55e60b767d50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b768420 con 0x55e60b760de0 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ed4ac640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd4e806a160 0x7fd4e80642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b768420 con 0x7fd4e806a160 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd4e806a160 0x7fd4e80642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:53.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd4e806a160 0x7fd4e80642d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e00083f0 con 0x7fd4e806a160 2024-09-10T06:23:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e00083f0 con 0x55e60b75c650 2024-09-10T06:23:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.927+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b760de0 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b760de0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.931+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b760de0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b760de0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.935+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b7658b0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x7fd4e806a160 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b75c650 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7602b0 con 0x55e60b760de0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7641d0 con 0x55e60b75c650 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7645c0 con 0x55e60b75c650 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7645c0 con 0x55e60b7658b0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 zone default found 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 4 Realm: () 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 zonegroup default 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b7688a0 con 0x7fd4e806a160 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76a290 con 0x55e60b7658b0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76a630 con 0x55e60b7658b0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 started sync module instance, tier type = 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.939+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b769730 con 0x55e60b760de0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446523161376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b769390 con 0x55e60b760de0 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b4f0 con 0x55e60b75c650 2024-09-10T06:23:53.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446523161376] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446523166784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b910 con 0x55e60b75c650 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.943+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76c160 con 0x55e60b7658b0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446523169344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76ca30 con 0x55e60b7658b0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76d450 con 0x55e60b760de0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446523166784] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446523167840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76dd20 con 0x55e60b760de0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76e570 con 0x55e60b75c650 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446523169344] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.947+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446523167840] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446523177072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76e140 con 0x55e60b75c650 2024-09-10T06:23:53.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76ee10 con 0x7fd4e806a160 2024-09-10T06:23:53.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446523177072] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446523178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76e0b0 con 0x7fd4e806a160 2024-09-10T06:23:53.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.951+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76f2c0 con 0x7fd4e806a160 2024-09-10T06:23:53.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446523178128] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446523181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76f2c0 con 0x7fd4e806a160 2024-09-10T06:23:53.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fcc0 con 0x7fd4e806a160 2024-09-10T06:23:53.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446523181040] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446523185104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fea0 con 0x7fd4e806a160 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=0 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=1 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=2 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=3 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=4 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=5 2024-09-10T06:23:53.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.955+0000 7fd4ef9a69c0 20 add_watcher() i=6 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446523185104] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 add_watcher() i=7 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b773270 con 0x55e60b75c650 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446523186576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b770660 con 0x55e60b75c650 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446523186576] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd3a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 5 note: GC not initialized 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd3a27e4640 20 reqs_thread_entry: start 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:53.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 Filter name: none 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd313fff640 20 reqs_thread_entry: start 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b796330 con 0x55e60b75c650 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.959+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e60b797880 con 0x7fd4e806a160 2024-09-10T06:23:53.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd3a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:53.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446523186576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b795c50 con 0x55e60b75c650 2024-09-10T06:23:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94446523186576] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446523161376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fd90 con 0x55e60b760de0 2024-09-10T06:23:53.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94446523161376] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ef9a69c0 20 remove_watcher() i=0 2024-09-10T06:23:53.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ef9a69c0 2 removed watcher, disabling cache 2024-09-10T06:23:53.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.963+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446523166784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fd90 con 0x55e60b75c650 2024-09-10T06:23:53.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.967+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94446523166784] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.967+0000 7fd4ef9a69c0 20 remove_watcher() i=1 2024-09-10T06:23:53.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.967+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446523169344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b040 con 0x55e60b7658b0 2024-09-10T06:23:53.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4eccab640 1 -- 172.21.15.117:0/3938272899 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94446523169344] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4d80a9a70 con 0x55e60b7658b0 2024-09-10T06:23:53.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 20 remove_watcher() i=2 2024-09-10T06:23:53.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446523167840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fd90 con 0x55e60b760de0 2024-09-10T06:23:53.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ed4ac640 1 -- 172.21.15.117:0/3938272899 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94446523167840] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e806d020 con 0x55e60b760de0 2024-09-10T06:23:53.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 20 remove_watcher() i=3 2024-09-10T06:23:53.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446523177072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76fd90 con 0x55e60b75c650 2024-09-10T06:23:53.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94446523177072] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x55e60b75c650 2024-09-10T06:23:53.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 20 remove_watcher() i=4 2024-09-10T06:23:53.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.971+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446523178128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b4f0 con 0x7fd4e806a160 2024-09-10T06:23:53.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94446523178128] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4ef9a69c0 20 remove_watcher() i=5 2024-09-10T06:23:53.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446523181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b4f0 con 0x7fd4e806a160 2024-09-10T06:23:53.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94446523181040] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4ef9a69c0 20 remove_watcher() i=6 2024-09-10T06:23:53.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.975+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446523185104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e60b76b4f0 con 0x7fd4e806a160 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94446523185104] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4e0026040 con 0x7fd4e806a160 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 20 remove_watcher() i=7 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd4e806a160 msgr2=0x7fd4e80642d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd4e806a160 0x7fd4e80642d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b75c650 msgr2=0x55e60b75eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b75c650 0x55e60b75eae0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b760de0 msgr2=0x55e60b7631d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b760de0 0x55e60b7631d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b7658b0 msgr2=0x55e60b767d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b7658b0 0x55e60b767d50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3b8039a70 msgr2=0x7fd3b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3b8039a70 0x7fd3b803bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55e60b730650 tx=0x7fd4d80c1040 comp rx=0 tx=0).stop 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4edcad640 1 -- 172.21.15.117:0/3938272899 reap_dead start 2024-09-10T06:23:53.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 msgr2=0x55e60b751600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8048f20 tx=0x7fd4e803b2c0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 shutdown_connections 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3938272899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b74b370 0x55e60b751600 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 >> 172.21.15.117:0/3938272899 conn(0x55e60b746730 msgr2=0x55e60b744940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 shutdown_connections 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3938272899 wait complete. 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 msgr2=0x7fd3c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 0x7fd3c403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55e60b7279a0 tx=0x7fd4d8005ad0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 msgr2=0x55e60b73e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd4e804e570 tx=0x7fd4e8005740 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 shutdown_connections 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3c4039a70 0x7fd3c403bf30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/3053898164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b73dd10 0x55e60b73e130 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 >> 172.21.15.117:0/3053898164 conn(0x55e60b7336c0 msgr2=0x55e60b733aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 shutdown_connections 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/3053898164 wait complete. 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b6316c0 msgr2=0x55e60b727010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e60b6316c0 0x55e60b727010 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b729840 msgr2=0x55e60b72bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e60b729840 0x55e60b72bc30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b72d760 msgr2=0x55e60b72fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55e60b72d760 0x55e60b72fb50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3d4039a70 msgr2=0x7fd3d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd3d4039a70 0x7fd3d403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80ad000 tx=0x7fd4d80a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 msgr2=0x55e60b71fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 --2- 172.21.15.117:0/2961321109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e60b62d520 0x55e60b71fea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8001b80 tx=0x7fd4e8000f50 comp rx=0 tx=0).stop 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4edcad640 1 -- 172.21.15.117:0/2961321109 reap_dead start 2024-09-10T06:23:53.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 shutdown_connections 2024-09-10T06:23:53.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 >> 172.21.15.117:0/2961321109 conn(0x55e60b629040 msgr2=0x55e60b712fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:53.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 shutdown_connections 2024-09-10T06:23:53.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:53.979+0000 7fd4ef9a69c0 1 -- 172.21.15.117:0/2961321109 wait complete. 2024-09-10T06:23:53.994 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:53.994 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:53.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T06:23:53.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T06:23:53.995 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-10T06:23:54.073 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.067+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29e97d9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c36b70e370 0x55c36b70e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29e97d9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c36b5c39c0 con 0x55c36b711550 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29e97d9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c36b6136d0 con 0x55c36b70e370 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29c483640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c36b70e370 0x55c36b70e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29bc82640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55c36b711550 0x55c36b713940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45890/0 (socket says 172.21.15.117:45890) 2024-09-10T06:23:54.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29bc82640 1 -- 172.21.15.117:0/1850115213 learned_addr learned my addr 172.21.15.117:0/1850115213 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:54.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29c483640 1 -- 172.21.15.117:0/1850115213 >> v1:172.21.15.84:6789/0 conn(0x55c36b711550 legacy=0x55c36b713940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29c483640 1 -- 172.21.15.117:0/1850115213 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b5b7ca0 con 0x55c36b70e370 2024-09-10T06:23:54.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29c483640 1 --2- 172.21.15.117:0/1850115213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b70e750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc29400a420 tx=0x7fc29401d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25243d34c7cc3812 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29b481640 1 -- 172.21.15.117:0/1850115213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940b1070 con 0x55c36b70e370 2024-09-10T06:23:54.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29b481640 1 -- 172.21.15.117:0/1850115213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940ac530 con 0x55c36b70e370 2024-09-10T06:23:54.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.071+0000 7fc29b481640 1 -- 172.21.15.117:0/1850115213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940ac850 con 0x55c36b70e370 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/1850115213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 msgr2=0x55c36b70e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/1850115213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b70e750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc29400a420 tx=0x7fc29401d1e0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/1850115213 shutdown_connections 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/1850115213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b70e750 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/1850115213 >> 172.21.15.117:0/1850115213 conn(0x55c36b709e90 msgr2=0x55c36b70c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/1850115213 shutdown_connections 2024-09-10T06:23:54.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.075+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/1850115213 wait complete. 2024-09-10T06:23:54.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36b617680 con 0x55c36b70e370 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56852/0 (socket says 172.21.15.117:56852) 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29c483640 1 -- 172.21.15.117:0/2802764628 learned_addr learned my addr 172.21.15.117:0/2802764628 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29c483640 1 -- 172.21.15.117:0/2802764628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b592da0 con 0x55c36b70e370 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29c483640 1 --2- 172.21.15.117:0/2802764628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc2940af040 tx=0x7fc2940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32deb6b4ac0d48f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc18a60c640 1 -- 172.21.15.117:0/2802764628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940bc070 con 0x55c36b70e370 2024-09-10T06:23:54.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc18a60c640 1 -- 172.21.15.117:0/2802764628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940ac6e0 con 0x55c36b70e370 2024-09-10T06:23:54.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc18a60c640 1 -- 172.21.15.117:0/2802764628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940b1040 con 0x55c36b70e370 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2802764628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 msgr2=0x55c36b7fcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2802764628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc2940af040 tx=0x7fc2940033b0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2802764628 shutdown_connections 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2802764628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b7fcaf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2802764628 >> 172.21.15.117:0/2802764628 conn(0x55c36b709e90 msgr2=0x55c36b7f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2802764628 shutdown_connections 2024-09-10T06:23:54.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.087+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2802764628 wait complete. 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b804130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36b5b9a50 con 0x55c36b70e370 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b804130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b804130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56860/0 (socket says 172.21.15.117:56860) 2024-09-10T06:23:54.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29c483640 1 -- 172.21.15.117:0/2669645409 learned_addr learned my addr 172.21.15.117:0/2669645409 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29c483640 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b804690 con 0x55c36b70e370 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29c483640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b804130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ac500 tx=0x7fc294019f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 -- 172.21.15.117:0/2669645409 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940bc040 con 0x55c36b70e370 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c36b804920 con 0x55c36b70e370 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 -- 172.21.15.117:0/2669645409 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940b7560 con 0x55c36b70e370 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 -- 172.21.15.117:0/2669645409 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940b1040 con 0x55c36b70e370 2024-09-10T06:23:54.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36b8052d0 con 0x55c36b70e370 2024-09-10T06:23:54.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 -- 172.21.15.117:0/2669645409 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc2940b78f0 con 0x55c36b70e370 2024-09-10T06:23:54.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc184039a70 0x7fc18403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc188e09640 1 -- 172.21.15.117:0/2669645409 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc2940ea800 con 0x55c36b70e370 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc184039a70 0x7fc18403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b711550 0x55c36b80b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b80b7e0 con 0x55c36b711550 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29cc84640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b711550 0x55c36b80b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.091+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc184039a70 0x7fc18403bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc284004180 tx=0x7fc284001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29cc84640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b711550 0x55c36b80b2a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29cc84640 1 -- 172.21.15.117:0/2669645409 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b711550 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b80bc50 con 0x55c36b711550 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29cc84640 1 -- 172.21.15.117:0/2669645409 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b711550 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b80da60 0x55c36b80fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b810520 con 0x55c36b80da60 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b80da60 0x55c36b80fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b80da60 0x55c36b80fe50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 -- 172.21.15.117:0/2669645409 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2940cf070 con 0x55c36b80da60 2024-09-10T06:23:54.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b80c900 con 0x55c36b711550 2024-09-10T06:23:54.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29cc84640 1 -- 172.21.15.117:0/2669645409 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b711550 2024-09-10T06:23:54.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b811960 0x55c36b813d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8144e0 con 0x55c36b811960 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b811960 0x55c36b813d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b811960 0x55c36b813d50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29bc82640 1 -- 172.21.15.117:0/2669645409 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b811960 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29e97d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36b624450 con 0x55c36b821fe0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56870/0 (socket says 172.21.15.117:56870) 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 -- 172.21.15.117:0/2367123375 learned_addr learned my addr 172.21.15.117:0/2367123375 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.095+0000 7fc29c483640 1 -- 172.21.15.117:0/2367123375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b822a40 con 0x55c36b821fe0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc2940e8c10 tx=0x7fc2940c84b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 -- 172.21.15.117:0/2367123375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940e0070 con 0x55c36b821fe0 2024-09-10T06:23:54.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 -- 172.21.15.117:0/2367123375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940e1ab0 con 0x55c36b821fe0 2024-09-10T06:23:54.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c36b8232a0 con 0x55c36b821fe0 2024-09-10T06:23:54.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 -- 172.21.15.117:0/2367123375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940e1d90 con 0x55c36b821fe0 2024-09-10T06:23:54.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36b823810 con 0x55c36b821fe0 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 -- 172.21.15.117:0/2367123375 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc2940eab20 con 0x55c36b821fe0 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 0x7fc17403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc181ffb640 1 -- 172.21.15.117:0/2367123375 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc2940d8070 con 0x55c36b821fe0 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 0x7fc17403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29bc82640 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 0x7fc17403bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c010 tx=0x7fc28400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29e97d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36b7fd280 con 0x55c36b82f660 2024-09-10T06:23:54.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56872/0 (socket says 172.21.15.117:56872) 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 -- 172.21.15.117:0/2688822745 learned_addr learned my addr 172.21.15.117:0/2688822745 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 -- 172.21.15.117:0/2688822745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b830050 con 0x55c36b82f660 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc29c483640 1 --2- 172.21.15.117:0/2688822745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc2940f0000 tx=0x7fc2940b8340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5040e8ec6a2ddbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc17b7fe640 1 -- 172.21.15.117:0/2688822745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940bf590 con 0x55c36b82f660 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc17b7fe640 1 -- 172.21.15.117:0/2688822745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940d29c0 con 0x55c36b82f660 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.099+0000 7fc17b7fe640 1 -- 172.21.15.117:0/2688822745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940ca080 con 0x55c36b82f660 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2688822745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 msgr2=0x55c36b82fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2688822745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc2940f0000 tx=0x7fc2940b8340 comp rx=0 tx=0).stop 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2688822745 shutdown_connections 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2688822745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b82fa60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2688822745 >> 172.21.15.117:0/2688822745 conn(0x55c36b82aa80 msgr2=0x55c36b828cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2688822745 shutdown_connections 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2688822745 wait complete. 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 Processor -- start 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- start start 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c36b82e430 con 0x55c36b82f660 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29c483640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56876/0 (socket says 172.21.15.117:56876) 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 learned_addr learned my addr 172.21.15.117:0/314292466 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c36b835e90 con 0x55c36b82f660 2024-09-10T06:23:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29c483640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc2940c0770 tx=0x7fc2940bfd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 -- 172.21.15.117:0/314292466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940bf590 con 0x55c36b82f660 2024-09-10T06:23:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c36b835e90 con 0x55c36b82f660 2024-09-10T06:23:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 -- 172.21.15.117:0/314292466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940d29c0 con 0x55c36b82f660 2024-09-10T06:23:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 -- 172.21.15.117:0/314292466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2940eae10 con 0x55c36b82f660 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36b835e90 con 0x55c36b82f660 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 -- 172.21.15.117:0/314292466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc29410f030 con 0x55c36b82f660 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16c039a20 0x7fc16c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.103+0000 7fc179ffb640 1 -- 172.21.15.117:0/314292466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc29410d070 con 0x55c36b82f660 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16c039a20 0x7fc16c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b840b00 0x55c36b842f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8436e0 con 0x55c36b840b00 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b840b00 0x55c36b842f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16c039a20 0x7fc16c03bee0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55c36b80cca0 tx=0x7fc284010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b840b00 0x55c36b842f90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b840b00 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 realm 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b843af0 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8443c0 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b840b00 2024-09-10T06:23:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b845250 0x55c36b847640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b847d80 con 0x55c36b845250 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b845250 0x55c36b847640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b845250 0x55c36b847640 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 20 searching for the correct realm 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b849d20 0x55c36b84c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84c890 con 0x55c36b849d20 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b849d20 0x55c36b84c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b849d20 0x55c36b84c1c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84c890 con 0x55c36b845250 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc2940f4b60 0x7fc2940db910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84c890 con 0x7fc2940f4b60 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.107+0000 7fc29cc84640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc2940f4b60 0x7fc2940db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc2940f4b60 0x7fc2940db910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c0083f0 con 0x7fc2940f4b60 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c0083f0 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b845250 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b845250 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.111+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b845250 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.115+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b845250 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b849d20 2024-09-10T06:23:54.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x7fc2940f4b60 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b840b00 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c36b844760 con 0x55c36b845250 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b848640 con 0x55c36b840b00 2024-09-10T06:23:54.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b848a30 con 0x55c36b840b00 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b848a30 con 0x55c36b849d20 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 zone default found 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 4 Realm: () 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:54.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 zonegroup default 2024-09-10T06:23:54.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84cd10 con 0x7fc2940f4b60 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.119+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84e700 con 0x55c36b849d20 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84eaa0 con 0x55c36b849d20 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 20 started sync module instance, tier type = 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84dba0 con 0x55c36b845250 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297810854048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84dba0 con 0x55c36b845250 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84f570 con 0x55c36b840b00 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297810854048] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297810858112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84dba0 con 0x55c36b840b00 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.123+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84ffb0 con 0x55c36b849d20 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297810858112] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297810851568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84db10 con 0x55c36b849d20 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b850d00 con 0x55c36b845250 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297810864512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8515d0 con 0x55c36b845250 2024-09-10T06:23:54.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.127+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b851f90 con 0x55c36b840b00 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297810851568] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297810864512] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297810868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8515d0 con 0x55c36b840b00 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b851f00 con 0x7fc2940f4b60 2024-09-10T06:23:54.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297810868960] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297810866464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b8524e0 con 0x7fc2940f4b60 2024-09-10T06:23:54.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.131+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852d30 con 0x7fc2940f4b60 2024-09-10T06:23:54.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.135+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.135+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297810872032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b853170 con 0x7fc2940f4b60 2024-09-10T06:23:54.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.135+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b853c90 con 0x7fc2940f4b60 2024-09-10T06:23:54.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.135+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297810866464] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297810876256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b853c50 con 0x7fc2940f4b60 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=0 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=1 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=2 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=3 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=4 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=5 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297810872032] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=6 2024-09-10T06:23:54.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297810876256] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 add_watcher() i=7 2024-09-10T06:23:54.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:54.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852c00 con 0x55c36b840b00 2024-09-10T06:23:54.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297810870288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852bc0 con 0x55c36b840b00 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297810870288] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc1527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 5 note: GC not initialized 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc1517e2640 20 reqs_thread_entry: start 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.139+0000 7fc29e97d9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 20 Filter name: none 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc0c2ffd640 20 reqs_thread_entry: start 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b879d30 con 0x55c36b840b00 2024-09-10T06:23:54.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:23:54.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c36b87b280 con 0x7fc2940f4b60 2024-09-10T06:23:54.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc1527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297810870288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b879650 con 0x55c36b840b00 2024-09-10T06:23:54.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94297810870288] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.143+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297810854048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852010 con 0x55c36b845250 2024-09-10T06:23:54.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94297810854048] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29e97d9c0 20 remove_watcher() i=0 2024-09-10T06:23:54.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29e97d9c0 2 removed watcher, disabling cache 2024-09-10T06:23:54.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297810858112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852010 con 0x55c36b840b00 2024-09-10T06:23:54.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94297810858112] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29e97d9c0 20 remove_watcher() i=1 2024-09-10T06:23:54.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.147+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297810851568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852010 con 0x55c36b849d20 2024-09-10T06:23:54.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29bc82640 1 -- 172.21.15.117:0/314292466 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94297810851568] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28400e6c0 con 0x55c36b849d20 2024-09-10T06:23:54.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 20 remove_watcher() i=2 2024-09-10T06:23:54.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297810864512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84d6f0 con 0x55c36b845250 2024-09-10T06:23:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29c483640 1 -- 172.21.15.117:0/314292466 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94297810864512] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2940f1070 con 0x55c36b845250 2024-09-10T06:23:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 20 remove_watcher() i=3 2024-09-10T06:23:54.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297810868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852010 con 0x55c36b840b00 2024-09-10T06:23:54.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94297810868960] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x55c36b840b00 2024-09-10T06:23:54.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 20 remove_watcher() i=4 2024-09-10T06:23:54.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.151+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297810866464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b84d6f0 con 0x7fc2940f4b60 2024-09-10T06:23:54.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94297810866464] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29e97d9c0 20 remove_watcher() i=5 2024-09-10T06:23:54.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297810872032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b851ae0 con 0x7fc2940f4b60 2024-09-10T06:23:54.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94297810872032] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29e97d9c0 20 remove_watcher() i=6 2024-09-10T06:23:54.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.155+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297810876256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c36b852010 con 0x7fc2940f4b60 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94297810876256] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc28c026040 con 0x7fc2940f4b60 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 20 remove_watcher() i=7 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc2940f4b60 msgr2=0x7fc2940db910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc2940f4b60 0x7fc2940db910 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b840b00 msgr2=0x55c36b842f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b840b00 0x55c36b842f90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b845250 msgr2=0x55c36b847640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b845250 0x55c36b847640 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b849d20 msgr2=0x55c36b84c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b849d20 0x55c36b84c1c0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16c039a20 msgr2=0x7fc16c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16c039a20 0x7fc16c03bee0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55c36b80cca0 tx=0x7fc284010000 comp rx=0 tx=0).stop 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 msgr2=0x55c36b835930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29cc84640 1 -- 172.21.15.117:0/314292466 reap_dead start 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc2940c0770 tx=0x7fc2940bfd80 comp rx=0 tx=0).stop 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 shutdown_connections 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/314292466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b82f660 0x55c36b835930 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 >> 172.21.15.117:0/314292466 conn(0x55c36b82aa80 msgr2=0x55c36b828c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 shutdown_connections 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/314292466 wait complete. 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 msgr2=0x7fc17403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 0x7fc17403bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc28400c010 tx=0x7fc28400f000 comp rx=0 tx=0).stop 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 msgr2=0x55c36b822400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc2940e8c10 tx=0x7fc2940c84b0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 shutdown_connections 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc174039ac0 0x7fc17403bf80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2367123375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b821fe0 0x55c36b822400 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 >> 172.21.15.117:0/2367123375 conn(0x55c36b817990 msgr2=0x55c36b817d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 shutdown_connections 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2367123375 wait complete. 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b711550 msgr2=0x55c36b80b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c36b711550 0x55c36b80b2a0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b80da60 msgr2=0x55c36b80fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c36b80da60 0x55c36b80fe50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b811960 msgr2=0x55c36b813d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c36b811960 0x55c36b813d50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc184039a70 msgr2=0x7fc18403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc184039a70 0x7fc18403bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc284004180 tx=0x7fc284001340 comp rx=0 tx=0).stop 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 msgr2=0x55c36b804130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 --2- 172.21.15.117:0/2669645409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c36b70e370 0x55c36b804130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ac500 tx=0x7fc294019f80 comp rx=0 tx=0).stop 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29cc84640 1 -- 172.21.15.117:0/2669645409 reap_dead start 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 shutdown_connections 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 >> 172.21.15.117:0/2669645409 conn(0x55c36b709e90 msgr2=0x55c36b7f2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 shutdown_connections 2024-09-10T06:23:54.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.159+0000 7fc29e97d9c0 1 -- 172.21.15.117:0/2669645409 wait complete. 2024-09-10T06:23:54.174 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T06:00:00.000000Z","epoch":1725948000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T06:23:54.174 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:23:54.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T06:23:54.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T06:23:54.175 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-10T06:23:54.257 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:54.257 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:54.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.251+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.251+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.251+0000 7f742fc239c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5588d40713a0 0x5588d4104d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.251+0000 7f742fc239c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588d3fb09c0 con 0x5588d4070fc0 2024-09-10T06:23:54.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.251+0000 7f742fc239c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5588d40006d0 con 0x5588d40713a0 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742d729640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5588d4070fc0 0x5588d4101620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45904/0 (socket says 172.21.15.117:45904) 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742d729640 1 -- 172.21.15.117:0/2448449603 learned_addr learned my addr 172.21.15.117:0/2448449603 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742cf28640 1 --2- 172.21.15.117:0/2448449603 >> v2:172.21.15.84:3300/0 conn(0x5588d40713a0 0x5588d4104d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f7427fff640 1 -- 172.21.15.117:0/2448449603 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92986860 0 0) 0x5588d3fb09c0 con 0x5588d4070fc0 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f7427fff640 1 -- 172.21.15.117:0/2448449603 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c001e20 con 0x5588d4070fc0 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742cf28640 1 -- 172.21.15.117:0/2448449603 >> v1:172.21.15.84:6789/0 conn(0x5588d4070fc0 legacy=0x5588d4101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742cf28640 1 -- 172.21.15.117:0/2448449603 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d3fa4ca0 con 0x5588d40713a0 2024-09-10T06:23:54.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742cf28640 1 --2- 172.21.15.117:0/2448449603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d40713a0 0x5588d4104d50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f741800a480 tx=0x7f741801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed32a6257bd0605 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f7427fff640 1 -- 172.21.15.117:0/2448449603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180b0070 con 0x5588d40713a0 2024-09-10T06:23:54.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f7427fff640 1 -- 172.21.15.117:0/2448449603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180ab540 con 0x5588d40713a0 2024-09-10T06:23:54.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f7427fff640 1 -- 172.21.15.117:0/2448449603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180ab820 con 0x5588d40713a0 2024-09-10T06:23:54.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 -- 172.21.15.117:0/2448449603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d40713a0 msgr2=0x5588d4104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2448449603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d40713a0 0x5588d4104d50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f741800a480 tx=0x7f741801b280 comp rx=0 tx=0).stop 2024-09-10T06:23:54.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 -- 172.21.15.117:0/2448449603 shutdown_connections 2024-09-10T06:23:54.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2448449603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d40713a0 0x5588d4104d50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 -- 172.21.15.117:0/2448449603 >> 172.21.15.117:0/2448449603 conn(0x5588d40f6f10 msgr2=0x5588d40f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 -- 172.21.15.117:0/2448449603 shutdown_connections 2024-09-10T06:23:54.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.255+0000 7f742fc239c0 1 -- 172.21.15.117:0/2448449603 wait complete. 2024-09-10T06:23:54.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588d4004680 con 0x5588d4070fc0 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56898/0 (socket says 172.21.15.117:56898) 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 -- 172.21.15.117:0/2022336717 learned_addr learned my addr 172.21.15.117:0/2022336717 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 -- 172.21.15.117:0/2022336717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d3f7fda0 con 0x5588d4070fc0 2024-09-10T06:23:54.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 --2- 172.21.15.117:0/2022336717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7420001e40 tx=0x7f742000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e730f926e3aab98e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f731b606640 1 -- 172.21.15.117:0/2022336717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7420012020 con 0x5588d4070fc0 2024-09-10T06:23:54.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f731b606640 1 -- 172.21.15.117:0/2022336717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742000e690 con 0x5588d4070fc0 2024-09-10T06:23:54.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f731b606640 1 -- 172.21.15.117:0/2022336717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742000e9b0 con 0x5588d4070fc0 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- 172.21.15.117:0/2022336717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 msgr2=0x5588d41e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2022336717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7420001e40 tx=0x7f742000b790 comp rx=0 tx=0).stop 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- 172.21.15.117:0/2022336717 shutdown_connections 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2022336717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41e9990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- 172.21.15.117:0/2022336717 >> 172.21.15.117:0/2022336717 conn(0x5588d40f6f10 msgr2=0x5588d41e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- 172.21.15.117:0/2022336717 shutdown_connections 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- 172.21.15.117:0/2022336717 wait complete. 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742fc239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588d3fa6a50 con 0x5588d4070fc0 2024-09-10T06:23:54.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56914/0 (socket says 172.21.15.117:56914) 2024-09-10T06:23:54.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 -- 172.21.15.117:0/695724982 learned_addr learned my addr 172.21.15.117:0/695724982 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.271+0000 7f742d729640 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d41f14f0 con 0x5588d4070fc0 2024-09-10T06:23:54.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742d729640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41f0f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7420004180 tx=0x7f74200040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 -- 172.21.15.117:0/695724982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7420012030 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d41f1780 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 -- 172.21.15.117:0/695724982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742001a7a0 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 -- 172.21.15.117:0/695724982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742001a950 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d41f2130 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 -- 172.21.15.117:0/695724982 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7420015020 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7314039a70 0x7f731403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f7319e03640 1 -- 172.21.15.117:0/695724982 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7420020070 con 0x5588d4070fc0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742cf28640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7314039a70 0x7f731403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d40713a0 0x5588d41f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d41f8640 con 0x5588d40713a0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742df2a640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d40713a0 0x5588d41f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742cf28640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7314039a70 0x7f731403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f74180ad000 tx=0x7f74180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742df2a640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d40713a0 0x5588d41f8100 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742df2a640 1 -- 172.21.15.117:0/695724982 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d40713a0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d41f89e0 con 0x5588d40713a0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742df2a640 1 -- 172.21.15.117:0/695724982 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d40713a0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d41fa7d0 0x5588d41fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d41fd300 con 0x5588d41fa7d0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742d729640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d41fa7d0 0x5588d41fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742d729640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d41fa7d0 0x5588d41fcbc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742d729640 1 -- 172.21.15.117:0/695724982 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7420008030 con 0x5588d41fa7d0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.275+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d41f9640 con 0x5588d40713a0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742df2a640 1 -- 172.21.15.117:0/695724982 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d40713a0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d41fe740 0x5588d4200b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4201220 con 0x5588d41fe740 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742cf28640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d41fe740 0x5588d4200b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742cf28640 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d41fe740 0x5588d4200b30 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742cf28640 1 -- 172.21.15.117:0/695724982 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74180b3040 con 0x5588d41fe740 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588d4011450 con 0x5588d420ed20 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56928/0 (socket says 172.21.15.117:56928) 2024-09-10T06:23:54.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742d729640 1 -- 172.21.15.117:0/1346881281 learned_addr learned my addr 172.21.15.117:0/1346881281 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742d729640 1 -- 172.21.15.117:0/1346881281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d420f780 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742d729640 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f742000ebe0 tx=0x7f7420040b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f7312ffd640 1 -- 172.21.15.117:0/1346881281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742001aaf0 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f7312ffd640 1 -- 172.21.15.117:0/1346881281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742001ac90 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d420ffe0 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f7312ffd640 1 -- 172.21.15.117:0/1346881281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742000dae0 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.279+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d420ffe0 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7312ffd640 1 -- 172.21.15.117:0/1346881281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7420009070 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7312ffd640 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 0x7f730403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7312ffd640 1 -- 172.21.15.117:0/1346881281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7420005050 con 0x5588d420ed20 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742cf28640 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 0x7f730403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742cf28640 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 0x7f730403bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5588d41f3110 tx=0x7f7418005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588d41ea1c0 con 0x5588d421c320 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56930/0 (socket says 172.21.15.117:56930) 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 -- 172.21.15.117:0/1669139060 learned_addr learned my addr 172.21.15.117:0/1669139060 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 -- 172.21.15.117:0/1669139060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d421cd10 con 0x5588d421c320 2024-09-10T06:23:54.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 --2- 172.21.15.117:0/1669139060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7420019fd0 tx=0x7f7420017940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04ccea723f5e2e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7310ff9640 1 -- 172.21.15.117:0/1669139060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7420054070 con 0x5588d421c320 2024-09-10T06:23:54.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7310ff9640 1 -- 172.21.15.117:0/1669139060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742004d690 con 0x5588d421c320 2024-09-10T06:23:54.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f7310ff9640 1 -- 172.21.15.117:0/1669139060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742002ed20 con 0x5588d421c320 2024-09-10T06:23:54.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- 172.21.15.117:0/1669139060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 msgr2=0x5588d421c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1669139060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7420019fd0 tx=0x7f7420017940 comp rx=0 tx=0).stop 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- 172.21.15.117:0/1669139060 shutdown_connections 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1669139060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d421c720 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- 172.21.15.117:0/1669139060 >> 172.21.15.117:0/1669139060 conn(0x5588d4217740 msgr2=0x5588d4215980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- 172.21.15.117:0/1669139060 shutdown_connections 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- 172.21.15.117:0/1669139060 wait complete. 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 Processor -- start 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- start start 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742fc239c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588d421b0f0 con 0x5588d421c320 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56944/0 (socket says 172.21.15.117:56944) 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 learned_addr learned my addr 172.21.15.117:0/2412857454 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.283+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d4222bd0 con 0x5588d421c320 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742d729640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7420019fd0 tx=0x7f74200408a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 -- 172.21.15.117:0/2412857454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742003f3e0 con 0x5588d421c320 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d4222bd0 con 0x5588d421c320 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 -- 172.21.15.117:0/2412857454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742000dc80 con 0x5588d421c320 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d4223040 con 0x5588d421c320 2024-09-10T06:23:54.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 -- 172.21.15.117:0/2412857454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742000de30 con 0x5588d421c320 2024-09-10T06:23:54.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 -- 172.21.15.117:0/2412857454 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7420068070 con 0x5588d421c320 2024-09-10T06:23:54.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72f8039a20 0x7f72f803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f7302ffd640 1 -- 172.21.15.117:0/2412857454 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f742006cbd0 con 0x5588d421c320 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742cf28640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72f8039a20 0x7f72f803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d422d700 0x5588d422fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d42302e0 con 0x5588d422d700 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d422d700 0x5588d422fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d422d700 0x5588d422fb90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742cf28640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72f8039a20 0x7f72f803bee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7418018eb0 tx=0x7f74180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 realm 2024-09-10T06:23:54.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d42306f0 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4230fc0 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d42320c0 0x5588d42344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4234ac0 con 0x5588d42320c0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742d729640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d42320c0 0x5588d42344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.287+0000 7f742d729640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d42320c0 0x5588d42344b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7420071020 con 0x5588d42320c0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742fc239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742fc239c0 20 searching for the correct realm 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d42369a0 0x5588d4238dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4239450 con 0x5588d42369a0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742cf28640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d42369a0 0x5588d4238dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742cf28640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d42369a0 0x5588d4238dd0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4239450 con 0x5588d42320c0 2024-09-10T06:23:54.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7420071020 con 0x5588d42320c0 2024-09-10T06:23:54.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742d729640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f742005d020 0x7f742006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4239450 con 0x7f742005d020 2024-09-10T06:23:54.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f742005d020 0x7f742006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f742005d020 0x7f742006c3f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.291+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42320c0 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7420071020 con 0x5588d42320c0 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42320c0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7420071020 con 0x5588d42320c0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.295+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42320c0 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7420071020 con 0x5588d42320c0 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42320c0 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42369a0 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.299+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x7f742005d020 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d422d700 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588d4231360 con 0x5588d42320c0 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4235310 con 0x5588d422d700 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4235700 con 0x5588d422d700 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4235700 con 0x5588d42369a0 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 zone default found 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 4 Realm: () 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:54.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 zonegroup default 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d42398d0 con 0x7f742005d020 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d423b3c0 con 0x5588d42369a0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d423b820 con 0x5588d42369a0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 started sync module instance, tier type = 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423a760 con 0x5588d42320c0 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94046163020624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423a3c0 con 0x5588d42320c0 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.303+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423c750 con 0x5588d422d700 2024-09-10T06:23:54.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.307+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94046163020624] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.307+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.307+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94046163026592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423cb70 con 0x5588d422d700 2024-09-10T06:23:54.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.307+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423d400 con 0x5588d42369a0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94046163026592] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94046163027920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423d820 con 0x5588d42369a0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423e1e0 con 0x5588d42320c0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94046163033664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423e8b0 con 0x5588d42320c0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423f3b0 con 0x5588d422d700 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94046163027920] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.311+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94046163033664] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94046163037856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423f370 con 0x5588d422d700 2024-09-10T06:23:54.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423f7d0 con 0x7f742005d020 2024-09-10T06:23:54.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94046163037856] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94046163034880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423ccf0 con 0x7f742005d020 2024-09-10T06:23:54.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.315+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42400d0 con 0x7f742005d020 2024-09-10T06:23:54.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94046163041216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d4240540 con 0x7f742005d020 2024-09-10T06:23:54.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d4241040 con 0x7f742005d020 2024-09-10T06:23:54.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94046163034880] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94046163041216] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94046163045168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d4240090 con 0x7f742005d020 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=0 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=1 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=2 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=3 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=4 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=5 2024-09-10T06:23:54.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.319+0000 7f742fc239c0 20 add_watcher() i=6 2024-09-10T06:23:54.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94046163045168] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 20 add_watcher() i=7 2024-09-10T06:23:54.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:54.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4244140 con 0x5588d422d700 2024-09-10T06:23:54.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94046163039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42415c0 con 0x5588d422d700 2024-09-10T06:23:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94046163039360] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f72e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 5 note: GC not initialized 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f72e2fe5640 20 reqs_thread_entry: start 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.323+0000 7f742fc239c0 20 Filter name: none 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f72e0fe1640 20 reqs_thread_entry: start 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4267620 con 0x7f742005d020 2024-09-10T06:23:54.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4265cc0 con 0x5588d422d700 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T06:23:54.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T06:23:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d4266830 con 0x7f742005d020 2024-09-10T06:23:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T06:23:54.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.327+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94046163198736 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d426b310 con 0x7f742005d020 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== watch-notify(notify (1) cookie 94046163045168 notify 137438953501 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5588d426ac10 con 0x7f742005d020 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f7310ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94046163045168 notifier 4722 bl.length()=556 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f7310ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T06:23:54.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f7310ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T06:23:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f7310ff9640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f72f0003eb0 con 0x7f742005d020 2024-09-10T06:23:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(65 notify.7 [notify cookie 94046163198736 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== watch-notify(notify_complete (2) cookie 94046163198736 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5588d42660e0 con 0x7f742005d020 2024-09-10T06:23:54.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d4266310 con 0x5588d422d700 2024-09-10T06:23:54.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742fc239c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T06:23:54.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742fc239c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T06:23:54.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742fc239c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T06:23:54.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.331+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94046163217888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588d4266310 con 0x7f742005d020 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== watch-notify(notify (1) cookie 94046163034880 notify 137438953502 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5588d42660e0 con 0x7f742005d020 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f7303fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94046163034880 notifier 4722 bl.length()=177 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f7303fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f7303fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f7303fff640 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7254003410 con 0x7f742005d020 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(68 notify.5 [notify cookie 94046163217888 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== watch-notify(notify_complete (2) cookie 94046163217888 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7428018db0 con 0x7f742005d020 2024-09-10T06:23:54.340 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T06:23:54.332526Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:23:54.332512Z","tags":[],"group_ids":[]} 2024-09-10T06:23:54.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f72e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94046163039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42652c0 con 0x5588d422d700 2024-09-10T06:23:54.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94046163039360] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.335+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94046163020624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42652c0 con 0x5588d42320c0 2024-09-10T06:23:54.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94046163020624] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742fc239c0 20 remove_watcher() i=0 2024-09-10T06:23:54.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742fc239c0 2 removed watcher, disabling cache 2024-09-10T06:23:54.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94046163026592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423ab50 con 0x5588d422d700 2024-09-10T06:23:54.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94046163026592] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742fc239c0 20 remove_watcher() i=1 2024-09-10T06:23:54.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.339+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94046163027920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42652c0 con 0x5588d42369a0 2024-09-10T06:23:54.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742cf28640 1 -- 172.21.15.117:0/2412857454 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94046163027920] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d9070 con 0x5588d42369a0 2024-09-10T06:23:54.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 20 remove_watcher() i=2 2024-09-10T06:23:54.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94046163033664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423c2a0 con 0x5588d42320c0 2024-09-10T06:23:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742d729640 1 -- 172.21.15.117:0/2412857454 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94046163033664] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420088040 con 0x5588d42320c0 2024-09-10T06:23:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 20 remove_watcher() i=3 2024-09-10T06:23:54.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94046163037856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423ab50 con 0x5588d422d700 2024-09-10T06:23:54.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94046163037856] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x5588d422d700 2024-09-10T06:23:54.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 20 remove_watcher() i=4 2024-09-10T06:23:54.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.343+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94046163034880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423c7d0 con 0x7f742005d020 2024-09-10T06:23:54.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94046163034880] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742fc239c0 20 remove_watcher() i=5 2024-09-10T06:23:54.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94046163041216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d42652c0 con 0x7f742005d020 2024-09-10T06:23:54.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94046163041216] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742fc239c0 20 remove_watcher() i=6 2024-09-10T06:23:54.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.347+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94046163045168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588d423de40 con 0x7f742005d020 2024-09-10T06:23:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94046163045168] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f742800a4d0 con 0x7f742005d020 2024-09-10T06:23:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 20 remove_watcher() i=7 2024-09-10T06:23:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f742005d020 msgr2=0x7f742006c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f742005d020 0x7f742006c3f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d422d700 msgr2=0x5588d422fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d422d700 0x5588d422fb90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d42320c0 msgr2=0x5588d42344b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d42320c0 0x5588d42344b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d42369a0 msgr2=0x5588d4238dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d42369a0 0x5588d4238dd0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72f8039a20 msgr2=0x7f72f803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f72f8039a20 0x7f72f803bee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7418018eb0 tx=0x7f74180a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 msgr2=0x5588d4222670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742df2a640 1 -- 172.21.15.117:0/2412857454 reap_dead start 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7420019fd0 tx=0x7f74200408a0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 shutdown_connections 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/2412857454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d421c320 0x5588d4222670 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 >> 172.21.15.117:0/2412857454 conn(0x5588d4217740 msgr2=0x5588d4215950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 shutdown_connections 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/2412857454 wait complete. 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 msgr2=0x7f730403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 0x7f730403bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5588d41f3110 tx=0x7f7418005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 msgr2=0x5588d420f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f742000ebe0 tx=0x7f7420040b00 comp rx=0 tx=0).stop 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 shutdown_connections 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7304039a70 0x7f730403bf30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/1346881281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d420ed20 0x5588d420f140 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 >> 172.21.15.117:0/1346881281 conn(0x5588d42046d0 msgr2=0x5588d4204ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 shutdown_connections 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/1346881281 wait complete. 2024-09-10T06:23:54.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d40713a0 msgr2=0x5588d41f8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5588d40713a0 0x5588d41f8100 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d41fa7d0 msgr2=0x5588d41fcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5588d41fa7d0 0x5588d41fcbc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d41fe740 msgr2=0x5588d4200b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5588d41fe740 0x5588d4200b30 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7314039a70 msgr2=0x7f731403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7314039a70 0x7f731403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f74180ad000 tx=0x7f74180a5040 comp rx=0 tx=0).stop 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 msgr2=0x5588d41f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 --2- 172.21.15.117:0/695724982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588d4070fc0 0x5588d41f0f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7420004180 tx=0x7f74200040f0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742df2a640 1 -- 172.21.15.117:0/695724982 reap_dead start 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 shutdown_connections 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 >> 172.21.15.117:0/695724982 conn(0x5588d40f6f10 msgr2=0x5588d41e40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 shutdown_connections 2024-09-10T06:23:54.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.351+0000 7f742fc239c0 1 -- 172.21.15.117:0/695724982 wait complete. 2024-09-10T06:23:54.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T06:23:54.332526Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:23:54.332512Z', 'tags': [], 'group_ids': []} 2024-09-10T06:23:54.385 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:54.391 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-10T06:23:54.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T06:23:54.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T06:23:54.391 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-10T06:23:54.439 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:54.439 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:54.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcefbc69c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5582fc77c640 0x5582fc77ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcefbc69c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582fc62c9c0 con 0x5582fc7784f0 2024-09-10T06:23:54.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcefbc69c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5582fc67c6d0 con 0x5582fc77c640 2024-09-10T06:23:54.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcececb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5582fc77c640 0x5582fc77ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbced6cc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5582fc7784f0 0x5582fc7788d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:45918/0 (socket says 172.21.15.117:45918) 2024-09-10T06:23:54.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbced6cc640 1 -- 172.21.15.117:0/2036139888 learned_addr learned my addr 172.21.15.117:0/2036139888 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:54.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcececb640 1 -- 172.21.15.117:0/2036139888 >> v1:172.21.15.84:6789/0 conn(0x5582fc7784f0 legacy=0x5582fc7788d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.435+0000 7fbcececb640 1 -- 172.21.15.117:0/2036139888 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc620ca0 con 0x5582fc77c640 2024-09-10T06:23:54.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcececb640 1 --2- 172.21.15.117:0/2036139888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc77c640 0x5582fc77ea30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbce800a420 tx=0x7fbce801b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb04a1c80e36769 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbce7fff640 1 -- 172.21.15.117:0/2036139888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce80af070 con 0x5582fc77c640 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbce7fff640 1 -- 172.21.15.117:0/2036139888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce80aa530 con 0x5582fc77c640 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbce7fff640 1 -- 172.21.15.117:0/2036139888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce80aa850 con 0x5582fc77c640 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2036139888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc77c640 msgr2=0x5582fc77ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2036139888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc77c640 0x5582fc77ea30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbce800a420 tx=0x7fbce801b060 comp rx=0 tx=0).stop 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2036139888 shutdown_connections 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2036139888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc77c640 0x5582fc77ea30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2036139888 >> 172.21.15.117:0/2036139888 conn(0x5582fc774010 msgr2=0x5582fc776430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2036139888 shutdown_connections 2024-09-10T06:23:54.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.439+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2036139888 wait complete. 2024-09-10T06:23:54.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.451+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.451+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.451+0000 7fbcefbc69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.451+0000 7fbcefbc69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5582fc680680 con 0x5582fc7784f0 2024-09-10T06:23:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56962/0 (socket says 172.21.15.117:56962) 2024-09-10T06:23:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 -- 172.21.15.117:0/2808262368 learned_addr learned my addr 172.21.15.117:0/2808262368 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 -- 172.21.15.117:0/2808262368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc5fbda0 con 0x5582fc7784f0 2024-09-10T06:23:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- 172.21.15.117:0/2808262368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8001e00 tx=0x7fbcd800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5263135483c1581 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbdb606640 1 -- 172.21.15.117:0/2808262368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd8012020 con 0x5582fc7784f0 2024-09-10T06:23:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbdb606640 1 -- 172.21.15.117:0/2808262368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd800e690 con 0x5582fc7784f0 2024-09-10T06:23:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbdb606640 1 -- 172.21.15.117:0/2808262368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd800ea10 con 0x5582fc7784f0 2024-09-10T06:23:54.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2808262368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 msgr2=0x5582fc8637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2808262368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8001e00 tx=0x7fbcd800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2808262368 shutdown_connections 2024-09-10T06:23:54.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2808262368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc8637e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2808262368 >> 172.21.15.117:0/2808262368 conn(0x5582fc774010 msgr2=0x5582fc85f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2808262368 shutdown_connections 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2808262368 wait complete. 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc86ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5582fc622a50 con 0x5582fc7784f0 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc86ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc86ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56976/0 (socket says 172.21.15.117:56976) 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 -- 172.21.15.117:0/1819337490 learned_addr learned my addr 172.21.15.117:0/1819337490 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc86b3e0 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbced6cc640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc86ae80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x5582fc8647d0 tx=0x7fbcd8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbd9e03640 1 -- 172.21.15.117:0/1819337490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd8012030 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fc86b670 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbd9e03640 1 -- 172.21.15.117:0/1819337490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd801a750 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbbd9e03640 1 -- 172.21.15.117:0/1819337490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd801aa30 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.455+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fc86c020 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbbd9e03640 1 -- 172.21.15.117:0/1819337490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbcd8015020 con 0x5582fc7784f0 2024-09-10T06:23:54.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbbd9e03640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbd4039a70 0x7fbbd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbbd9e03640 1 -- 172.21.15.117:0/1819337490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbcd8020030 con 0x5582fc7784f0 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcececb640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbd4039a70 0x7fbbd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc77c640 0x5582fc871ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc872530 con 0x5582fc77c640 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcedecd640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc77c640 0x5582fc871ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcececb640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbd4039a70 0x7fbbd403bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ac000 tx=0x7fbce80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcedecd640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc77c640 0x5582fc871ff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcedecd640 1 -- 172.21.15.117:0/1819337490 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc77c640 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8728f0 con 0x5582fc77c640 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcedecd640 1 -- 172.21.15.117:0/1819337490 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc77c640 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc874700 0x5582fc876af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8771c0 con 0x5582fc874700 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbced6cc640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc874700 0x5582fc876af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbced6cc640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc874700 0x5582fc876af0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbced6cc640 1 -- 172.21.15.117:0/1819337490 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcd8008030 con 0x5582fc874700 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc873570 con 0x5582fc77c640 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcedecd640 1 -- 172.21.15.117:0/1819337490 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc77c640 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc878600 0x5582fc87a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc87b160 con 0x5582fc878600 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.459+0000 7fbcececb640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc878600 0x5582fc87a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcececb640 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc878600 0x5582fc87a9f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcececb640 1 -- 172.21.15.117:0/1819337490 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbce80b2070 con 0x5582fc878600 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5582fc68d450 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56980/0 (socket says 172.21.15.117:56980) 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbced6cc640 1 -- 172.21.15.117:0/3821062991 learned_addr learned my addr 172.21.15.117:0/3821062991 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbced6cc640 1 -- 172.21.15.117:0/3821062991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc889690 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbced6cc640 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbcd804ebf0 tx=0x7fbcd8018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 -- 172.21.15.117:0/3821062991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd800d5a0 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 -- 172.21.15.117:0/3821062991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd800d740 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fc889ef0 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 -- 172.21.15.117:0/3821062991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd800dae0 con 0x5582fc888c30 2024-09-10T06:23:54.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fc88a460 con 0x5582fc888c30 2024-09-10T06:23:54.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 -- 172.21.15.117:0/3821062991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbcd804d040 con 0x5582fc888c30 2024-09-10T06:23:54.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 0x7fbbc403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbbd2ffd640 1 -- 172.21.15.117:0/3821062991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbcd804a040 con 0x5582fc888c30 2024-09-10T06:23:54.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.463+0000 7fbcececb640 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 0x7fbbc403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcececb640 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 0x7fbbc403bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ad040 tx=0x7fbce8005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5582fc864030 con 0x5582fc6ed240 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56988/0 (socket says 172.21.15.117:56988) 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 -- 172.21.15.117:0/2475694520 learned_addr learned my addr 172.21.15.117:0/2475694520 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 -- 172.21.15.117:0/2475694520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc6edb80 con 0x5582fc6ed240 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- 172.21.15.117:0/2475694520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8050f70 tx=0x7fbcd80249f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6e948701fac423 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/2475694520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd8061070 con 0x5582fc6ed240 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/2475694520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd8047b90 con 0x5582fc6ed240 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/2475694520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd800c900 con 0x5582fc6ed240 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2475694520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 msgr2=0x5582fc6ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2475694520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8050f70 tx=0x7fbcd80249f0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2475694520 shutdown_connections 2024-09-10T06:23:54.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/2475694520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc6ed640 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2475694520 >> 172.21.15.117:0/2475694520 conn(0x5582fc8916f0 msgr2=0x5582fc88f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2475694520 shutdown_connections 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/2475694520 wait complete. 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 Processor -- start 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- start start 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5582fc6edf90 con 0x5582fc6ed240 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:56998/0 (socket says 172.21.15.117:56998) 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 learned_addr learned my addr 172.21.15.117:0/4048060183 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:54.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582fc89ee70 con 0x5582fc6ed240 2024-09-10T06:23:54.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbced6cc640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbcd804da10 tx=0x7fbcd8023f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbbc2ffd640 1 -- 172.21.15.117:0/4048060183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd806b020 con 0x5582fc6ed240 2024-09-10T06:23:54.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.467+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582fc89ee70 con 0x5582fc6ed240 2024-09-10T06:23:54.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbbc2ffd640 1 -- 172.21.15.117:0/4048060183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd8062040 con 0x5582fc6ed240 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbbc2ffd640 1 -- 172.21.15.117:0/4048060183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd8061070 con 0x5582fc6ed240 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582fc89f440 con 0x5582fc6ed240 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbbc2ffd640 1 -- 172.21.15.117:0/4048060183 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbcd806e020 con 0x5582fc6ed240 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbbc2ffd640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbb8039a70 0x7fbbb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbbc2ffd640 1 -- 172.21.15.117:0/4048060183 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbcd8005050 con 0x5582fc6ed240 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcececb640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbb8039a70 0x7fbbb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc8a9ae0 0x5582fc8abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ac6c0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc8a9ae0 0x5582fc8abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcececb640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbb8039a70 0x7fbbb803bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbce80aafd0 tx=0x7fbce80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc8a9ae0 0x5582fc8abf70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 realm 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8acad0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad3a0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc8ae4a0 0x5582fc8b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b0ee0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbced6cc640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc8ae4a0 0x5582fc8b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbced6cc640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc8ae4a0 0x5582fc8b0890 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 20 searching for the correct realm 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc8b2dc0 0x5582fc8b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.471+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b5870 con 0x5582fc8b2dc0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcececb640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc8b2dc0 0x5582fc8b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcececb640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc8b2dc0 0x5582fc8b51f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b5870 con 0x5582fc8ae4a0 2024-09-10T06:23:54.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbced6cc640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbcd807b040 0x7fbcd80762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:54.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b5870 con 0x7fbcd807b040 2024-09-10T06:23:54.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbcd807b040 0x7fbcd80762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbcd807b040 0x7fbcd80762b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce00083f0 con 0x7fbcd807b040 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce00083f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.475+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.479+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8b2dc0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.483+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x7fbcd807b040 2024-09-10T06:23:54.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ad740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b1730 con 0x5582fc8a9ae0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b1b20 con 0x5582fc8a9ae0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b1b20 con 0x5582fc8b2dc0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 zone default found 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 4 Realm: () 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 zonegroup default 2024-09-10T06:23:54.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b5cf0 con 0x7fbcd807b040 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b77e0 con 0x5582fc8b2dc0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b7bd0 con 0x5582fc8b2dc0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 started sync module instance, tier type = 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b6b80 con 0x5582fc8ae4a0 2024-09-10T06:23:54.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.487+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021071105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b84b0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.491+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b8d00 con 0x5582fc8a9ae0 2024-09-10T06:23:54.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.491+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021071105952] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.491+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.491+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021071110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b8d40 con 0x5582fc8a9ae0 2024-09-10T06:23:54.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.491+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b9830 con 0x5582fc8b2dc0 2024-09-10T06:23:54.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021071110144] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021071115008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8b9c20 con 0x5582fc8b2dc0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ba5e0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021071118912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bacd0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bb7f0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021071115008] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021071118912] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021071123136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bb7b0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.495+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bc090 con 0x7fbcd807b040 2024-09-10T06:23:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021071124400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bc080 con 0x7fbcd807b040 2024-09-10T06:23:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bca80 con 0x7fbcd807b040 2024-09-10T06:23:54.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021071123136] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021071124400] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021071112272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bbc10 con 0x7fbcd807b040 2024-09-10T06:23:54.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.499+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bd110 con 0x7fbcd807b040 2024-09-10T06:23:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021071112272] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021071127952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bd110 con 0x7fbcd807b040 2024-09-10T06:23:54.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=0 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=1 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=2 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=3 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=4 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=5 2024-09-10T06:23:54.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=6 2024-09-10T06:23:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021071127952] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 20 add_watcher() i=7 2024-09-10T06:23:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:54.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.503+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8c0440 con 0x5582fc8a9ae0 2024-09-10T06:23:54.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021071130064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8bd6a0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021071130064] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 5 note: GC not initialized 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbba27e4640 20 reqs_thread_entry: start 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 20 Filter name: none 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbb13fff640 20 reqs_thread_entry: start 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.507+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e39d0 con 0x7fbcd807b040 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:54.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e81a0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T06:23:54.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:23:54.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T06:23:54.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.511+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94021071305568 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e8e30 con 0x7fbcd807b040 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== watch-notify(notify (1) cookie 94021071124400 notify 137438953503 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fbce0010040 con 0x7fbcd807b040 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbbd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94021071124400 notifier 4729 bl.length()=382 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(64 notify.5 [notify cookie 94021071305568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbbd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbbd0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:23:54.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbb0003eb0 con 0x7fbcd807b040 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify_complete (2) cookie 94021071305568 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbce000ac20 con 0x7fbcd807b040 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e7b60 con 0x5582fc8a9ae0 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 : miss 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:54.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 8.1d 8:bf9aa310:root::.bucket.meta.myfoo6%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e5f90 con 0x7fbcd807b040 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(67 .bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 2024-09-10T06:23:54.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.515+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 8.1d 8:bf9aa310:root::.bucket.meta.myfoo6%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8eff90 con 0x7fbcd807b040 2024-09-10T06:23:54.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(68 .bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9, ofs0, ns] 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94021071297632 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8eebe0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== watch-notify(notify (1) cookie 94021071105952 notify 137438953494 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5582fc889ef0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbbc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94021071105952 notifier 4729 bl.length()=756 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbbc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbbc3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbbc3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbbc3fff640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbb20003540 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(69 notify.0 [notify cookie 94021071297632 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== watch-notify(notify_complete (2) cookie 94021071297632 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc889690 con 0x5582fc8ae4a0 2024-09-10T06:23:54.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): orig_sources= new_sources= 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): potential sources added=[] removed=[] 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): orig_dests= new_dests= 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): potential dests added=[] removed=[] 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.519+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ee730 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ee730 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(72 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ef740 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94021071297632 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ef740 con 0x5582fc8ae4a0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== watch-notify(notify (1) cookie 94021071118912 notify 137438953495 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5582fc86c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbbd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94021071118912 notifier 4729 bl.length()=316 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbbd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbbd0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbb0003eb0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(74 notify.3 [notify cookie 94021071297632 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== watch-notify(notify_complete (2) cookie 94021071297632 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc86b670 con 0x5582fc8ae4a0 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 2024-09-10T06:23:54.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.523+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 8.1d 8:bf9aa310:root::.bucket.meta.myfoo6%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e5c60 con 0x7fbcd807b040 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v32'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9, ofs0, ns] 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94021071297632 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8ae4a0 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== watch-notify(notify (1) cookie 94021071105952 notify 137438953496 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5582fc86b670 con 0x5582fc8ae4a0 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbbc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94021071105952 notifier 4729 bl.length()=756 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbbc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:23:54.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbbc3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbbc3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(77 notify.0 [notify cookie 94021071297632 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbbc3fff640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbb20003520 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== watch-notify(notify_complete (2) cookie 94021071297632 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc86b3e0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): orig_sources= new_sources= 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): potential sources added=[] removed=[] 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): orig_dests= new_dests= 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 20 handle_bi_update(): bucket=:myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]): potential dests added=[] removed=[] 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:79 4.3f 4:fd9408fc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e5c20 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(79 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:80 4.0 4:00753f2a:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e5c20 con 0x5582fc8b2dc0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(80 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.527+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:81 4.19 4:9b7aa4d7:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8b2dc0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(81 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:82 4.b 4:d3d3f200:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8ae4a0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(82 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:83 4.9 4:921fd45d:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8a9ae0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(83 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 4.19 4:996555dd:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8b2dc0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(84 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 4.2e 4:74665b48:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8b2dc0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(85 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:86 4.3c 4:3e25fad6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8a9ae0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(86 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 4.1f 4:fb828412:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8b2dc0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(87 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:88 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x5582fc8a9ae0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(88 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [call out=381b] v0'0 uv19 ondisk = 0) ==== 194+0+381 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 10 cls_bucket_list_unordered: got thirteen 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:89 4.33 4:cdb31416:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e6a90 con 0x7fbcd807b040 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(89 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 get_obj_state: octx=0x7fbcd80247f0 obj=myfoo6:thirteen state=0x5582fc8ed658 s->prefetch_data=0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:90 3.17 3:e8c9cc8e:::be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8ee730 con 0x5582fc8a9ae0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(90 be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 10 manifest: total_size = 8 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.2608891889714544845 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-10T06:23:54.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 get_obj_state: octx=0x7fbcd80247f0 obj=myfoo6:thirteen state=0x5582fc8ed658 s->prefetch_data=0 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 2024-09-10T06:23:54.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.531+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:91 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f3660 con 0x5582fc8a9ae0 2024-09-10T06:23:54.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(91 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [stat,call,call] v32'20 uv20 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:92 3.17 3:e8c9cc8e:::be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f1af0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(92 be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:93 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f2ed0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:1 objects processed in :myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9]). Next marker thirteen 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f2ed0 con 0x5582fc8ae4a0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'6 uv6 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T06:23:54.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.535+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94021071351504 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e87e0 con 0x7fbcd807b040 2024-09-10T06:23:54.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== watch-notify(notify (1) cookie 94021071124400 notify 137438953504 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5582fc8efae0 con 0x7fbcd807b040 2024-09-10T06:23:54.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94021071124400 notifier 4729 bl.length()=556 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbb0003eb0 con 0x7fbcd807b040 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(95 notify.5 [notify cookie 94021071351504 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(93 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [stat,call,call] v32'21 uv21 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== watch-notify(notify_complete (2) cookie 94021071351504 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc8ed2a0 con 0x7fbcd807b040 2024-09-10T06:23:54.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e87e0 con 0x5582fc8a9ae0 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcefbc69c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcefbc69c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94021071300064 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f2a20 con 0x7fbcd807b040 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== watch-notify(notify (1) cookie 94021071124400 notify 137438953505 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5582fc8ed2a0 con 0x7fbcd807b040 2024-09-10T06:23:54.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94021071124400 notifier 4729 bl.length()=177 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbbd0ff9640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbb0003eb0 con 0x7fbcd807b040 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.539+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(98 notify.5 [notify cookie 94021071300064 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== watch-notify(notify_complete (2) cookie 94021071300064 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc8e6380 con 0x7fbcd807b040 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcefbc69c0 10 removing user index: bar 2024-09-10T06:23:54.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8e87e0 con 0x7fbcd807b040 2024-09-10T06:23:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(100 bar [delete] v32'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcefbc69c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-10T06:23:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcefbc69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T06:23:54.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94021071300064 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8f2a20 con 0x7fbcd807b040 2024-09-10T06:23:54.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== watch-notify(notify (1) cookie 94021071127952 notify 137438953506 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5582fc8e6380 con 0x7fbcd807b040 2024-09-10T06:23:54.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbbc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94021071127952 notifier 4729 bl.length()=152 2024-09-10T06:23:54.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbbc3fff640 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbb20003520 con 0x7fbcd807b040 2024-09-10T06:23:54.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.543+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(101 notify.7 [notify cookie 94021071300064 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== watch-notify(notify_complete (2) cookie 94021071300064 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5582fc8e7cc0 con 0x7fbcd807b040 2024-09-10T06:23:54.551 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T06:23:54.332526Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:23:54.332512Z","tags":[],"group_ids":[]} 2024-09-10T06:23:54.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:54.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021071130064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8a9ae0 2024-09-10T06:23:54.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94021071130064] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021071105952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8ae4a0 2024-09-10T06:23:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.547+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94021071105952] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 20 remove_watcher() i=0 2024-09-10T06:23:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 2 removed watcher, disabling cache 2024-09-10T06:23:54.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021071110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8a9ae0 2024-09-10T06:23:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94021071110144] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 20 remove_watcher() i=1 2024-09-10T06:23:54.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021071115008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8b2dc0 2024-09-10T06:23:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcececb640 1 -- 172.21.15.117:0/4048060183 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94021071115008] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce80c9070 con 0x5582fc8b2dc0 2024-09-10T06:23:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 20 remove_watcher() i=2 2024-09-10T06:23:54.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.551+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021071118912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8ae4a0 2024-09-10T06:23:54.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbced6cc640 1 -- 172.21.15.117:0/4048060183 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94021071118912] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd803c020 con 0x5582fc8ae4a0 2024-09-10T06:23:54.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbcefbc69c0 20 remove_watcher() i=3 2024-09-10T06:23:54.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021071123136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x5582fc8a9ae0 2024-09-10T06:23:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94021071123136] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x5582fc8a9ae0 2024-09-10T06:23:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbcefbc69c0 20 remove_watcher() i=4 2024-09-10T06:23:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.555+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021071124400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x7fbcd807b040 2024-09-10T06:23:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94021071124400] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcefbc69c0 20 remove_watcher() i=5 2024-09-10T06:23:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021071112272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x7fbcd807b040 2024-09-10T06:23:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94021071112272] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcefbc69c0 20 remove_watcher() i=6 2024-09-10T06:23:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.559+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021071127952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582fc8d4390 con 0x7fbcd807b040 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94021071127952] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbce0026040 con 0x7fbcd807b040 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 20 remove_watcher() i=7 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbcd807b040 msgr2=0x7fbcd80762b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbcd807b040 0x7fbcd80762b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc8a9ae0 msgr2=0x5582fc8abf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc8a9ae0 0x5582fc8abf70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc8ae4a0 msgr2=0x5582fc8b0890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc8ae4a0 0x5582fc8b0890 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc8b2dc0 msgr2=0x5582fc8b51f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc8b2dc0 0x5582fc8b51f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbb8039a70 msgr2=0x7fbbb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbb8039a70 0x7fbbb803bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbce80aafd0 tx=0x7fbce80a7000 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 msgr2=0x5582fc89e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbcd804da10 tx=0x7fbcd8023f00 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcedecd640 1 -- 172.21.15.117:0/4048060183 reap_dead start 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 shutdown_connections 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/4048060183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc6ed240 0x5582fc89e910 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 >> 172.21.15.117:0/4048060183 conn(0x5582fc8916f0 msgr2=0x5582fc88f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 shutdown_connections 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/4048060183 wait complete. 2024-09-10T06:23:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 msgr2=0x7fbbc403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 0x7fbbc403bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ad040 tx=0x7fbce8005d90 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 msgr2=0x5582fc889050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbcd804ebf0 tx=0x7fbcd8018f80 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 shutdown_connections 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbc4039a70 0x7fbbc403bf30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/3821062991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc888c30 0x5582fc889050 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 >> 172.21.15.117:0/3821062991 conn(0x5582fc87e5e0 msgr2=0x5582fc87e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 shutdown_connections 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/3821062991 wait complete. 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc77c640 msgr2=0x5582fc871ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5582fc77c640 0x5582fc871ff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc874700 msgr2=0x5582fc876af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5582fc874700 0x5582fc876af0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc878600 msgr2=0x5582fc87a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5582fc878600 0x5582fc87a9f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbd4039a70 msgr2=0x7fbbd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbbd4039a70 0x7fbbd403bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbce80ac000 tx=0x7fbce80a5000 comp rx=0 tx=0).stop 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 msgr2=0x5582fc86ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 --2- 172.21.15.117:0/1819337490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582fc7784f0 0x5582fc86ae80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x5582fc8647d0 tx=0x7fbcd8000bd0 comp rx=0 tx=0).stop 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcedecd640 1 -- 172.21.15.117:0/1819337490 reap_dead start 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 shutdown_connections 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 >> 172.21.15.117:0/1819337490 conn(0x5582fc774010 msgr2=0x5582fc85df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 shutdown_connections 2024-09-10T06:23:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:54.563+0000 7fbcefbc69c0 1 -- 172.21.15.117:0/1819337490 wait complete. 2024-09-10T06:23:54.578 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T06:23:54.332526Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:23:54.332512Z', 'tags': [], 'group_ids': []} 2024-09-10T06:23:59.588 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:59.588 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T06:23:59.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T06:23:59.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T06:23:59.589 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-10T06:23:59.638 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:59.638 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:59.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb470a0e9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fdb4fb9590 0x55fdb4fbb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb470a0e9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fdb4e6a9c0 con 0x55fdb4fb53a0 2024-09-10T06:23:59.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb470a0e9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55fdb4eba6d0 con 0x55fdb4fb9590 2024-09-10T06:23:59.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46dd13640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fdb4fb9590 0x55fdb4fbb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46e514640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55fdb4fb53a0 0x55fdb4fb5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:49092/0 (socket says 172.21.15.117:49092) 2024-09-10T06:23:59.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46dd13640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55fdb4fb9590 0x55fdb4fbb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52898/0 (socket says 172.21.15.117:52898) 2024-09-10T06:23:59.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46e514640 1 -- 172.21.15.117:0/4146374463 learned_addr learned my addr 172.21.15.117:0/4146374463 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:59.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46dd13640 1 -- 172.21.15.117:0/4146374463 >> v1:172.21.15.84:6789/0 conn(0x55fdb4fb53a0 legacy=0x55fdb4fb5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.635+0000 7fb46dd13640 1 -- 172.21.15.117:0/4146374463 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb4e5eca0 con 0x55fdb4fb9590 2024-09-10T06:23:59.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb46dd13640 1 --2- 172.21.15.117:0/4146374463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb9590 0x55fdb4fbb980 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb46400a420 tx=0x7fb46401b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6c6b37c835b881 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb46d512640 1 -- 172.21.15.117:0/4146374463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4640af070 con 0x55fdb4fb9590 2024-09-10T06:23:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb46d512640 1 -- 172.21.15.117:0/4146374463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4640aa530 con 0x55fdb4fb9590 2024-09-10T06:23:59.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb46d512640 1 -- 172.21.15.117:0/4146374463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4640aa850 con 0x55fdb4fb9590 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/4146374463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb9590 msgr2=0x55fdb4fbb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/4146374463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb9590 0x55fdb4fbb980 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb46400a420 tx=0x7fb46401b060 comp rx=0 tx=0).stop 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/4146374463 shutdown_connections 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/4146374463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb9590 0x55fdb4fbb980 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/4146374463 >> 172.21.15.117:0/4146374463 conn(0x55fdb4fb0ec0 msgr2=0x55fdb4fb32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/4146374463 shutdown_connections 2024-09-10T06:23:59.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.639+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/4146374463 wait complete. 2024-09-10T06:23:59.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4ebe680 con 0x55fdb4fb53a0 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52910/0 (socket says 172.21.15.117:52910) 2024-09-10T06:23:59.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb46e514640 1 -- 172.21.15.117:0/2124095436 learned_addr learned my addr 172.21.15.117:0/2124095436 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb46e514640 1 -- 172.21.15.117:0/2124095436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb4e39da0 con 0x55fdb4fb53a0 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb46e514640 1 --2- 172.21.15.117:0/2124095436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb460001e00 tx=0x7fb46000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8cd196f9f73763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb35c608640 1 -- 172.21.15.117:0/2124095436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb460012020 con 0x55fdb4fb53a0 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb35c608640 1 -- 172.21.15.117:0/2124095436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46000e690 con 0x55fdb4fb53a0 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb35c608640 1 -- 172.21.15.117:0/2124095436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb46000ea10 con 0x55fdb4fb53a0 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/2124095436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 msgr2=0x55fdb4f2a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/2124095436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb460001e00 tx=0x7fb46000b6d0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/2124095436 shutdown_connections 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/2124095436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb4f2a290 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/2124095436 >> 172.21.15.117:0/2124095436 conn(0x55fdb4fb0ec0 msgr2=0x55fdb509c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/2124095436 shutdown_connections 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/2124095436 wait complete. 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.655+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb50ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4e60a50 con 0x55fdb4fb53a0 2024-09-10T06:23:59.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb50ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb50ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52918/0 (socket says 172.21.15.117:52918) 2024-09-10T06:23:59.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46e514640 1 -- 172.21.15.117:0/5459613 learned_addr learned my addr 172.21.15.117:0/5459613 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46e514640 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb50ab720 con 0x55fdb4fb53a0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46e514640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb50ab1c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55fdb50a06c0 tx=0x7fb460000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 -- 172.21.15.117:0/5459613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb460012030 con 0x55fdb4fb53a0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdb50ab9b0 con 0x55fdb4fb53a0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 -- 172.21.15.117:0/5459613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb460001460 con 0x55fdb4fb53a0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 -- 172.21.15.117:0/5459613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb46001a7a0 con 0x55fdb4fb53a0 2024-09-10T06:23:59.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb50ac360 con 0x55fdb4fb53a0 2024-09-10T06:23:59.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 -- 172.21.15.117:0/5459613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb460015020 con 0x55fdb4fb53a0 2024-09-10T06:23:59.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb354039a70 0x7fb35403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb35ae05640 1 -- 172.21.15.117:0/5459613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb460020030 con 0x55fdb4fb53a0 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46dd13640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb354039a70 0x7fb35403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb4fb9590 0x55fdb50b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50b2870 con 0x55fdb4fb9590 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46ed15640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb4fb9590 0x55fdb50b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.659+0000 7fb46dd13640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb354039a70 0x7fb35403bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ac000 tx=0x7fb4640a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46ed15640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb4fb9590 0x55fdb50b2330 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46ed15640 1 -- 172.21.15.117:0/5459613 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb4fb9590 2024-09-10T06:23:59.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ac6d0 con 0x55fdb4fb9590 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46ed15640 1 -- 172.21.15.117:0/5459613 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb4fb9590 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50b4b60 0x55fdb50b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50b7640 con 0x55fdb50b4b60 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50b4b60 0x55fdb50b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50b4b60 0x55fdb50b6f50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 -- 172.21.15.117:0/5459613 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50b4b60 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50b3a00 con 0x55fdb4fb9590 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46ed15640 1 -- 172.21.15.117:0/5459613 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb4fb9590 2024-09-10T06:23:59.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50b8aa0 0x55fdb50bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50bb5d0 con 0x55fdb50b8aa0 2024-09-10T06:23:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46dd13640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50b8aa0 0x55fdb50bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46dd13640 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50b8aa0 0x55fdb50bae90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46dd13640 1 -- 172.21.15.117:0/5459613 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4640b2070 con 0x55fdb50b8aa0 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb470a0e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4ecb450 con 0x55fdb50c9090 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52930/0 (socket says 172.21.15.117:52930) 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.663+0000 7fb46e514640 1 -- 172.21.15.117:0/1689392338 learned_addr learned my addr 172.21.15.117:0/1689392338 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46e514640 1 -- 172.21.15.117:0/1689392338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb50c9af0 con 0x55fdb50c9090 2024-09-10T06:23:59.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46e514640 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb46004e9d0 tx=0x7fb460016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 -- 172.21.15.117:0/1689392338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb460018430 con 0x55fdb50c9090 2024-09-10T06:23:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 -- 172.21.15.117:0/1689392338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb460047500 con 0x55fdb50c9090 2024-09-10T06:23:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdb50c9af0 con 0x55fdb50c9090 2024-09-10T06:23:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 -- 172.21.15.117:0/1689392338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb46004d220 con 0x55fdb50c9090 2024-09-10T06:23:59.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb50c9af0 con 0x55fdb50c9090 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 -- 172.21.15.117:0/1689392338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb460009070 con 0x55fdb50c9090 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 0x7fb34803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb353fff640 1 -- 172.21.15.117:0/1689392338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb460005050 con 0x55fdb50c9090 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46dd13640 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 0x7fb34803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46dd13640 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 0x7fb34803bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55fdb50b2d00 tx=0x7fb464005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb470a0e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4f2aae0 con 0x55fdb50d6450 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52944/0 (socket says 172.21.15.117:52944) 2024-09-10T06:23:59.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.667+0000 7fb46e514640 1 -- 172.21.15.117:0/3489536814 learned_addr learned my addr 172.21.15.117:0/3489536814 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 -- 172.21.15.117:0/3489536814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb50d6e20 con 0x55fdb50d6450 2024-09-10T06:23:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 --2- 172.21.15.117:0/3489536814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb460042f90 tx=0x7fb460038f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b2fe66e5ee9790 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb351ffb640 1 -- 172.21.15.117:0/3489536814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb460060070 con 0x55fdb50d6450 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb351ffb640 1 -- 172.21.15.117:0/3489536814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb460047e60 con 0x55fdb50d6450 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb351ffb640 1 -- 172.21.15.117:0/3489536814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4600503b0 con 0x55fdb50d6450 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/3489536814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 msgr2=0x55fdb50d6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/3489536814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb460042f90 tx=0x7fb460038f50 comp rx=0 tx=0).stop 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/3489536814 shutdown_connections 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/3489536814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50d6830 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/3489536814 >> 172.21.15.117:0/3489536814 conn(0x55fdb50d1870 msgr2=0x55fdb50cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/3489536814 shutdown_connections 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/3489536814 wait complete. 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 Processor -- start 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- start start 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fdb50d5220 con 0x55fdb50d6450 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50dc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52956/0 (socket says 172.21.15.117:52956) 2024-09-10T06:23:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 learned_addr learned my addr 172.21.15.117:0/380766282 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb50dcc00 con 0x55fdb50d6450 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb46e514640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50dc6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb46000deb0 tx=0x7fb46002e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb33ffff640 1 -- 172.21.15.117:0/380766282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb46006b020 con 0x55fdb50d6450 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdb50dcc00 con 0x55fdb50d6450 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb33ffff640 1 -- 172.21.15.117:0/380766282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb460061040 con 0x55fdb50d6450 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb33ffff640 1 -- 172.21.15.117:0/380766282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb460060070 con 0x55fdb50d6450 2024-09-10T06:23:59.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.671+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb50dcc00 con 0x55fdb50d6450 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb33ffff640 1 -- 172.21.15.117:0/380766282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb46006e020 con 0x55fdb50d6450 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb33ffff640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb3380399d0 0x7fb33803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb33ffff640 1 -- 172.21.15.117:0/380766282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb460071bb0 con 0x55fdb50d6450 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46dd13640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb3380399d0 0x7fb33803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb50e77e0 0x55fdb50e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ea3c0 con 0x55fdb50e77e0 2024-09-10T06:23:59.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb50e77e0 0x55fdb50e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46dd13640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb3380399d0 0x7fb33803be90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb4640aafd0 tx=0x7fb4640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb50e77e0 0x55fdb50e9c70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb50e77e0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 realm 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ea7d0 con 0x55fdb50e77e0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb50e77e0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb0a0 con 0x55fdb50e77e0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb50e77e0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb50e77e0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50ec1a0 0x55fdb50ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eeb60 con 0x55fdb50ec1a0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46e514640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50ec1a0 0x55fdb50ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.675+0000 7fb46e514640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50ec1a0 0x55fdb50ee590 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb470a0e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb470a0e9c0 20 searching for the correct realm 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50f0ab0 0x55fdb50f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f3560 con 0x55fdb50f0ab0 2024-09-10T06:23:59.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46dd13640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50f0ab0 0x55fdb50f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46dd13640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50f0ab0 0x55fdb50f2ee0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f3560 con 0x55fdb50ec1a0 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46e514640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb460070020 0x7fb4600108f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f3560 con 0x7fb460070020 2024-09-10T06:23:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb460070020 0x7fb4600108f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb460070020 0x7fb4600108f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4680083f0 con 0x7fb460070020 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4680083f0 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.679+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50ec1a0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50ec1a0 2024-09-10T06:23:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.683+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50ec1a0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.687+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50ec1a0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50f0ab0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x7fb460070020 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50e77e0 2024-09-10T06:23:59.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50eb440 con 0x55fdb50ec1a0 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:59.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ef420 con 0x55fdb50e77e0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ef810 con 0x55fdb50e77e0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50ef810 con 0x55fdb50f0ab0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 zone default found 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 4 Realm: () 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 zonegroup default 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f39e0 con 0x7fb460070020 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f54d0 con 0x55fdb50f0ab0 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f5960 con 0x55fdb50f0ab0 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.691+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 20 started sync module instance, tier type = 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:59.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f4870 con 0x55fdb50ec1a0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94548152765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f44d0 con 0x55fdb50ec1a0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f6870 con 0x55fdb50e77e0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94548152765536] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94548152771520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f6c90 con 0x55fdb50e77e0 2024-09-10T06:23:59.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.695+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f7650 con 0x55fdb50f0ab0 2024-09-10T06:23:59.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94548152775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f7ea0 con 0x55fdb50f0ab0 2024-09-10T06:23:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f8860 con 0x55fdb50ec1a0 2024-09-10T06:23:59.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94548152771520] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94548152772576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f9100 con 0x55fdb50ec1a0 2024-09-10T06:23:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.699+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f9950 con 0x55fdb50e77e0 2024-09-10T06:23:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94548152775072] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94548152772576] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94548152781904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f9520 con 0x55fdb50e77e0 2024-09-10T06:23:59.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fa1f0 con 0x7fb460070020 2024-09-10T06:23:59.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.703+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94548152781904] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94548152782960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f9490 con 0x7fb460070020 2024-09-10T06:23:59.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fa6c0 con 0x7fb460070020 2024-09-10T06:23:59.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94548152782960] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94548152785840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fa680 con 0x7fb460070020 2024-09-10T06:23:59.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.707+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fb080 con 0x7fb460070020 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94548152789904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fb4a0 con 0x7fb460070020 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=0 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=1 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=2 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=3 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=4 2024-09-10T06:23:59.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=5 2024-09-10T06:23:59.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94548152785840] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=6 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94548152789904] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 20 add_watcher() i=7 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fa1d0 con 0x55fdb50e77e0 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.711+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94548152790960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50fa1d0 con 0x55fdb50e77e0 2024-09-10T06:23:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94548152790960] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb3257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:59.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 5 note: GC not initialized 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb31f7fe640 20 reqs_thread_entry: start 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 Filter name: none 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb31d7fa640 20 reqs_thread_entry: start 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5121b60 con 0x7fb460070020 2024-09-10T06:23:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5120200 con 0x7fb460070020 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T06:23:59.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.715+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5120dc0 con 0x7fb460070020 2024-09-10T06:23:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb470a0e9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T06:23:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb470a0e9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:23:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb470a0e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T06:23:59.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94548152945232 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5125850 con 0x7fb460070020 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify (1) cookie 94548152782960 notify 137438953507 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55fdb5125150 con 0x7fb460070020 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb351ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94548152782960 notifier 4736 bl.length()=556 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb351ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb351ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(65 notify.5 [notify cookie 94548152945232 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb351ffb640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb334003eb0 con 0x7fb460070020 2024-09-10T06:23:59.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== watch-notify(notify_complete (2) cookie 94548152945232 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdb5120620 con 0x7fb460070020 2024-09-10T06:23:59.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.719+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5120a50 con 0x7fb460070020 2024-09-10T06:23:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb470a0e9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:23:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb470a0e9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:23:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb470a0e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:23:59.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94548152945232 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdb5125c80 con 0x55fdb50f0ab0 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 94548152775072 notify 137438953478 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fb4640bd1f0 con 0x55fdb50f0ab0 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb351ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94548152775072 notifier 4736 bl.length()=177 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb351ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb351ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 notify.2 [notify cookie 94548152945232 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb351ffb640 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb334003eb0 con 0x55fdb50f0ab0 2024-09-10T06:23:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== watch-notify(notify_complete (2) cookie 94548152945232 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdb4e5eca0 con 0x55fdb50f0ab0 2024-09-10T06:23:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.729 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T06:23:59.721476Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:23:59.721463Z","tags":[],"group_ids":[]} 2024-09-10T06:23:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb3257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.723+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94548152790960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50e77e0 2024-09-10T06:23:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94548152790960] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94548152765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50ec1a0 2024-09-10T06:23:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94548152765536] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb470a0e9c0 20 remove_watcher() i=0 2024-09-10T06:23:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb470a0e9c0 2 removed watcher, disabling cache 2024-09-10T06:23:59.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.727+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94548152771520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50e77e0 2024-09-10T06:23:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94548152771520] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 20 remove_watcher() i=1 2024-09-10T06:23:59.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94548152775072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50f0ab0 2024-09-10T06:23:59.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb46dd13640 1 -- 172.21.15.117:0/380766282 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94548152775072] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4640c9070 con 0x55fdb50f0ab0 2024-09-10T06:23:59.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 20 remove_watcher() i=2 2024-09-10T06:23:59.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94548152772576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50ec1a0 2024-09-10T06:23:59.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb46e514640 1 -- 172.21.15.117:0/380766282 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94548152772576] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb460008030 con 0x55fdb50ec1a0 2024-09-10T06:23:59.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 20 remove_watcher() i=3 2024-09-10T06:23:59.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.731+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94548152781904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x55fdb50e77e0 2024-09-10T06:23:59.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.735+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94548152781904] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x55fdb50e77e0 2024-09-10T06:23:59.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.735+0000 7fb470a0e9c0 20 remove_watcher() i=4 2024-09-10T06:23:59.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.735+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94548152782960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb50f6870 con 0x7fb460070020 2024-09-10T06:23:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.735+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94548152782960] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.735+0000 7fb470a0e9c0 20 remove_watcher() i=5 2024-09-10T06:23:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.739+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94548152785840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x7fb460070020 2024-09-10T06:23:59.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.739+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94548152785840] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.739+0000 7fb470a0e9c0 20 remove_watcher() i=6 2024-09-10T06:23:59.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.739+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94548152789904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdb511f850 con 0x7fb460070020 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94548152789904] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb468026040 con 0x7fb460070020 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 20 remove_watcher() i=7 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb460070020 msgr2=0x7fb4600108f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fb460070020 0x7fb4600108f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb50e77e0 msgr2=0x55fdb50e9c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb50e77e0 0x55fdb50e9c70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50ec1a0 msgr2=0x55fdb50ee590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50ec1a0 0x55fdb50ee590 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50f0ab0 msgr2=0x55fdb50f2ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50f0ab0 0x55fdb50f2ee0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb3380399d0 msgr2=0x7fb33803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb3380399d0 0x7fb33803be90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb4640aafd0 tx=0x7fb4640a7000 comp rx=0 tx=0).stop 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 msgr2=0x55fdb50dc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/380766282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50d6450 0x55fdb50dc6a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb46000deb0 tx=0x7fb46002e330 comp rx=0 tx=0).stop 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb46ed15640 1 -- 172.21.15.117:0/380766282 reap_dead start 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 shutdown_connections 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 >> 172.21.15.117:0/380766282 conn(0x55fdb50d1870 msgr2=0x55fdb50cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 shutdown_connections 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/380766282 wait complete. 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 msgr2=0x7fb34803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 0x7fb34803bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55fdb50b2d00 tx=0x7fb464005d90 comp rx=0 tx=0).stop 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 msgr2=0x55fdb50c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb46004e9d0 tx=0x7fb460016b00 comp rx=0 tx=0).stop 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 shutdown_connections 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb348039a70 0x7fb34803bf30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/1689392338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb50c9090 0x55fdb50c94b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 >> 172.21.15.117:0/1689392338 conn(0x55fdb50bea40 msgr2=0x55fdb50bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 shutdown_connections 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/1689392338 wait complete. 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb4fb9590 msgr2=0x55fdb50b2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55fdb4fb9590 0x55fdb50b2330 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50b4b60 msgr2=0x55fdb50b6f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55fdb50b4b60 0x55fdb50b6f50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50b8aa0 msgr2=0x55fdb50bae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55fdb50b8aa0 0x55fdb50bae90 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb354039a70 msgr2=0x7fb35403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb354039a70 0x7fb35403bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ac000 tx=0x7fb4640a5000 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 msgr2=0x55fdb50ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 --2- 172.21.15.117:0/5459613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fdb4fb53a0 0x55fdb50ab1c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55fdb50a06c0 tx=0x7fb460000bd0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb46ed15640 1 -- 172.21.15.117:0/5459613 reap_dead start 2024-09-10T06:23:59.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 shutdown_connections 2024-09-10T06:23:59.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 >> 172.21.15.117:0/5459613 conn(0x55fdb4fb0ec0 msgr2=0x55fdb509af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 shutdown_connections 2024-09-10T06:23:59.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.743+0000 7fb470a0e9c0 1 -- 172.21.15.117:0/5459613 wait complete. 2024-09-10T06:23:59.760 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T06:23:59.721476Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:23:59.721463Z', 'tags': [], 'group_ids': []} 2024-09-10T06:23:59.777 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:59.784 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-10T06:23:59.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T06:23:59.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T06:23:59.784 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-10T06:23:59.818 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:23:59.819 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:23:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc579b229c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557a77211b50 0x557a772a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc579b229c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557a771519c0 con 0x557a77211770 2024-09-10T06:23:59.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc579b229c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x557a771a16d0 con 0x557a77211b50 2024-09-10T06:23:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc56ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x557a77211b50 0x557a772a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc577628640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x557a77211770 0x557a772a25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:49100/0 (socket says 172.21.15.117:49100) 2024-09-10T06:23:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc577628640 1 -- 172.21.15.117:0/3453166467 learned_addr learned my addr 172.21.15.117:0/3453166467 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:23:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc56ffff640 1 -- 172.21.15.117:0/3453166467 >> v1:172.21.15.84:6789/0 conn(0x557a77211770 legacy=0x557a772a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.815+0000 7fc56ffff640 1 -- 172.21.15.117:0/3453166467 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a77145ca0 con 0x557a77211b50 2024-09-10T06:23:59.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc56ffff640 1 --2- 172.21.15.117:0/3453166467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211b50 0x557a772a5cd0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc56000a480 tx=0x7fc56001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1798d4e6871fd7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc576e27640 1 -- 172.21.15.117:0/3453166467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5600b0070 con 0x557a77211b50 2024-09-10T06:23:59.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc576e27640 1 -- 172.21.15.117:0/3453166467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5600ab540 con 0x557a77211b50 2024-09-10T06:23:59.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc576e27640 1 -- 172.21.15.117:0/3453166467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5600ab840 con 0x557a77211b50 2024-09-10T06:23:59.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 -- 172.21.15.117:0/3453166467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211b50 msgr2=0x557a772a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3453166467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211b50 0x557a772a5cd0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc56000a480 tx=0x7fc56001b280 comp rx=0 tx=0).stop 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 -- 172.21.15.117:0/3453166467 shutdown_connections 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3453166467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211b50 0x557a772a5cd0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 -- 172.21.15.117:0/3453166467 >> 172.21.15.117:0/3453166467 conn(0x557a77297e90 msgr2=0x557a7729a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 -- 172.21.15.117:0/3453166467 shutdown_connections 2024-09-10T06:23:59.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.819+0000 7fc579b229c0 1 -- 172.21.15.117:0/3453166467 wait complete. 2024-09-10T06:23:59.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc579b229c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc579b229c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a771a5680 con 0x557a77211770 2024-09-10T06:23:59.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52970/0 (socket says 172.21.15.117:52970) 2024-09-10T06:23:59.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc577628640 1 -- 172.21.15.117:0/4201384364 learned_addr learned my addr 172.21.15.117:0/4201384364 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc577628640 1 -- 172.21.15.117:0/4201384364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a77120da0 con 0x557a77211770 2024-09-10T06:23:59.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc577628640 1 --2- 172.21.15.117:0/4201384364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc568001e00 tx=0x7fc56800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72315731c1e387d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc46560a640 1 -- 172.21.15.117:0/4201384364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568012020 con 0x557a77211770 2024-09-10T06:23:59.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc46560a640 1 -- 172.21.15.117:0/4201384364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56800e690 con 0x557a77211770 2024-09-10T06:23:59.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.835+0000 7fc46560a640 1 -- 172.21.15.117:0/4201384364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56800ea10 con 0x557a77211770 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- 172.21.15.117:0/4201384364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 msgr2=0x557a7738aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 --2- 172.21.15.117:0/4201384364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc568001e00 tx=0x7fc56800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- 172.21.15.117:0/4201384364 shutdown_connections 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 --2- 172.21.15.117:0/4201384364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a7738aa10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- 172.21.15.117:0/4201384364 >> 172.21.15.117:0/4201384364 conn(0x557a77297e90 msgr2=0x557a773866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- 172.21.15.117:0/4201384364 shutdown_connections 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- 172.21.15.117:0/4201384364 wait complete. 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a773920b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc579b229c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a77147a50 con 0x557a77211770 2024-09-10T06:23:59.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a773920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a773920b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52976/0 (socket says 172.21.15.117:52976) 2024-09-10T06:23:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc577628640 1 -- 172.21.15.117:0/3728369856 learned_addr learned my addr 172.21.15.117:0/3728369856 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc577628640 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a77392610 con 0x557a77211770 2024-09-10T06:23:59.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.839+0000 7fc577628640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a773920b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x557a7738ba00 tx=0x7fc568000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc463e07640 1 -- 172.21.15.117:0/3728369856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568012030 con 0x557a77211770 2024-09-10T06:23:59.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc463e07640 1 -- 172.21.15.117:0/3728369856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56801a750 con 0x557a77211770 2024-09-10T06:23:59.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc463e07640 1 -- 172.21.15.117:0/3728369856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56801aa50 con 0x557a77211770 2024-09-10T06:23:59.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a773928a0 con 0x557a77211770 2024-09-10T06:23:59.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a77393250 con 0x557a77211770 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.843+0000 7fc463e07640 1 -- 172.21.15.117:0/3728369856 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc568015020 con 0x557a77211770 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc463e07640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc45c039b10 0x7fc45c03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc463e07640 1 -- 172.21.15.117:0/3728369856 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc568020030 con 0x557a77211770 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc56ffff640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc45c039b10 0x7fc45c03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a77211b50 0x557a77399220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a77399760 con 0x557a77211b50 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577e29640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a77211b50 0x557a77399220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc56ffff640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc45c039b10 0x7fc45c03bfd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5600ad000 tx=0x7fc5600a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577e29640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a77211b50 0x557a77399220 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577e29640 1 -- 172.21.15.117:0/3728369856 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a77211b50 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a77399b80 con 0x557a77211b50 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577e29640 1 -- 172.21.15.117:0/3728369856 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a77211b50 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a7739b990 0x557a7739dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7739e420 con 0x557a7739b990 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577628640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a7739b990 0x557a7739dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577628640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a7739b990 0x557a7739dd80 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577628640 1 -- 172.21.15.117:0/3728369856 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc568008030 con 0x557a7739b990 2024-09-10T06:23:59.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a7739a7d0 con 0x557a77211b50 2024-09-10T06:23:59.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc577e29640 1 -- 172.21.15.117:0/3728369856 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a77211b50 2024-09-10T06:23:59.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a7739f860 0x557a773a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773a23c0 con 0x557a7739f860 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc56ffff640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a7739f860 0x557a773a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc56ffff640 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a7739f860 0x557a773a1c50 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc56ffff640 1 -- 172.21.15.117:0/3728369856 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5600b3040 con 0x557a7739f860 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.847+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a771b2450 con 0x557a773afe80 2024-09-10T06:23:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52986/0 (socket says 172.21.15.117:52986) 2024-09-10T06:23:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc577628640 1 -- 172.21.15.117:0/2082606610 learned_addr learned my addr 172.21.15.117:0/2082606610 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc577628640 1 -- 172.21.15.117:0/2082606610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a773b08e0 con 0x557a773afe80 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc577628640 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc568001400 tx=0x7fc56801aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 -- 172.21.15.117:0/2082606610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56804d6b0 con 0x557a773afe80 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a773b1140 con 0x557a773afe80 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 -- 172.21.15.117:0/2082606610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc568047a40 con 0x557a773afe80 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 -- 172.21.15.117:0/2082606610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568047bf0 con 0x557a773afe80 2024-09-10T06:23:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a773b1140 con 0x557a773afe80 2024-09-10T06:23:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 -- 172.21.15.117:0/2082606610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc568041d10 con 0x557a773afe80 2024-09-10T06:23:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 0x7fc45003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc461602640 1 -- 172.21.15.117:0/2082606610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc568046070 con 0x557a773afe80 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 0x7fc45003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 0x7fc45003bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc560000c10 tx=0x7fc560005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.851+0000 7fc579b229c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a7738b240 con 0x557a773bc3f0 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:52998/0 (socket says 172.21.15.117:52998) 2024-09-10T06:23:59.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 -- 172.21.15.117:0/521618119 learned_addr learned my addr 172.21.15.117:0/521618119 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 -- 172.21.15.117:0/521618119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a773bcda0 con 0x557a773bc3f0 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- 172.21.15.117:0/521618119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc568050fd0 tx=0x7fc56800d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d472df04b15770db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc45affd640 1 -- 172.21.15.117:0/521618119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568061070 con 0x557a773bc3f0 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc45affd640 1 -- 172.21.15.117:0/521618119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56800db80 con 0x557a773bc3f0 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc45affd640 1 -- 172.21.15.117:0/521618119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568041860 con 0x557a773bc3f0 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- 172.21.15.117:0/521618119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 msgr2=0x557a773bc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 --2- 172.21.15.117:0/521618119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc568050fd0 tx=0x7fc56800d7e0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- 172.21.15.117:0/521618119 shutdown_connections 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 --2- 172.21.15.117:0/521618119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773bc7d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- 172.21.15.117:0/521618119 >> 172.21.15.117:0/521618119 conn(0x557a773b8820 msgr2=0x557a773b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- 172.21.15.117:0/521618119 shutdown_connections 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- 172.21.15.117:0/521618119 wait complete. 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 Processor -- start 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- start start 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc579b229c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557a773bd280 con 0x557a773bc3f0 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53008/0 (socket says 172.21.15.117:53008) 2024-09-10T06:23:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 learned_addr learned my addr 172.21.15.117:0/2530224651 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a773c3ca0 con 0x557a773bc3f0 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.855+0000 7fc577628640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc56804d9a0 tx=0x7fc56800a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 -- 172.21.15.117:0/2530224651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56806c030 con 0x557a773bc3f0 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 -- 172.21.15.117:0/2530224651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56800db80 con 0x557a773bc3f0 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a773c3ca0 con 0x557a773bc3f0 2024-09-10T06:23:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 -- 172.21.15.117:0/2530224651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc568061030 con 0x557a773bc3f0 2024-09-10T06:23:59.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a773c4270 con 0x557a773bc3f0 2024-09-10T06:23:59.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 -- 172.21.15.117:0/2530224651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc56806f070 con 0x557a773bc3f0 2024-09-10T06:23:59.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc440039a70 0x7fc44003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc4597fa640 1 -- 172.21.15.117:0/2530224651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc56806d070 con 0x557a773bc3f0 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc440039a70 0x7fc44003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a773ce910 0x557a773d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d14f0 con 0x557a773ce910 2024-09-10T06:23:59.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a773ce910 0x557a773d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a773ce910 0x557a773d0da0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc440039a70 0x7fc44003bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5600abfd0 tx=0x7fc5600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 realm 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d1900 con 0x557a773ce910 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d21d0 con 0x557a773ce910 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a773d32d0 0x557a773d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.859+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d5cd0 con 0x557a773d32d0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a773d32d0 0x557a773d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a773d32d0 0x557a773d56c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc579b229c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc579b229c0 20 searching for the correct realm 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a773d7bb0 0x557a773d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773da660 con 0x557a773d7bb0 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a773d7bb0 0x557a773d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc56ffff640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a773d7bb0 0x557a773d9fe0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773da660 con 0x557a773d32d0 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc568071030 0x7fc568034940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773da660 con 0x7fc568071030 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc568071030 0x7fc568034940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc568071030 0x7fc568034940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.863+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d32d0 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d32d0 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.867+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d32d0 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.871+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d32d0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d7bb0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x7fc568071030 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773ce910 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557a773d2570 con 0x557a773d32d0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d6520 con 0x557a773ce910 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d6910 con 0x557a773ce910 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:23:59.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773d6910 con 0x557a773d7bb0 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 zone default found 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 4 Realm: () 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 zonegroup default 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773daae0 con 0x7fc568071030 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773dc5d0 con 0x557a773d7bb0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773dc9c0 con 0x557a773d7bb0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 started sync module instance, tier type = 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:23:59.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.875+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773db970 con 0x557a773d32d0 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93984474905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773db5d0 con 0x557a773d32d0 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dd920 con 0x557a773ce910 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93984474905952] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93984474911856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773ddd40 con 0x557a773ce910 2024-09-10T06:23:59.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.879+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773de590 con 0x557a773d7bb0 2024-09-10T06:23:59.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93984474911856] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93984474913184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773de9b0 con 0x557a773d7bb0 2024-09-10T06:23:59.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773df370 con 0x557a773d32d0 2024-09-10T06:23:59.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93984474918896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dfc10 con 0x557a773d32d0 2024-09-10T06:23:59.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e05d0 con 0x557a773ce910 2024-09-10T06:23:59.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93984474918896] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.883+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93984474913184] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93984474923296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dfc10 con 0x557a773ce910 2024-09-10T06:23:59.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e0540 con 0x7fc568071030 2024-09-10T06:23:59.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93984474923296] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93984474921072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e09f0 con 0x7fc568071030 2024-09-10T06:23:59.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.887+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e13b0 con 0x7fc568071030 2024-09-10T06:23:59.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93984474926848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e17d0 con 0x7fc568071030 2024-09-10T06:23:59.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e22c0 con 0x7fc568071030 2024-09-10T06:23:59.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93984474921072] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93984474926848] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93984474930576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e1320 con 0x7fc568071030 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=0 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=1 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=2 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=3 2024-09-10T06:23:59.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=4 2024-09-10T06:23:59.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=5 2024-09-10T06:23:59.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.891+0000 7fc579b229c0 20 add_watcher() i=6 2024-09-10T06:23:59.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93984474930576] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 add_watcher() i=7 2024-09-10T06:23:59.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:23:59.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a773e53c0 con 0x557a773ce910 2024-09-10T06:23:59.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93984474924352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773e2840 con 0x557a773ce910 2024-09-10T06:23:59.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93984474924352] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 5 note: GC not initialized 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc42cfe1640 20 reqs_thread_entry: start 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 init_complete bucket index max shards: 11 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 Filter name: none 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc3a67fc640 20 reqs_thread_entry: start 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 rados->read ofs=0 len=0 2024-09-10T06:23:59.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557a77408830 con 0x557a773d32d0 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:23:59.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.895+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a7740cfe0 con 0x7fc568071030 2024-09-10T06:23:59.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.899+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.904 INFO:teuthology.orchestra.run.smithi117.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-10T06:23:59.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.899+0000 7fc42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:23:59.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.899+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93984474924352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a77406560 con 0x557a773ce910 2024-09-10T06:23:59.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.899+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93984474924352] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.899+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93984474905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a77406560 con 0x557a773d32d0 2024-09-10T06:23:59.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.903+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93984474905952] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.903+0000 7fc579b229c0 20 remove_watcher() i=0 2024-09-10T06:23:59.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.903+0000 7fc579b229c0 2 removed watcher, disabling cache 2024-09-10T06:23:59.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.903+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93984474911856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a77406560 con 0x557a773ce910 2024-09-10T06:23:59.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93984474911856] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 20 remove_watcher() i=1 2024-09-10T06:23:59.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93984474913184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dd470 con 0x557a773d7bb0 2024-09-10T06:23:59.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc56ffff640 1 -- 172.21.15.117:0/2530224651 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93984474913184] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5600d9070 con 0x557a773d7bb0 2024-09-10T06:23:59.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 20 remove_watcher() i=2 2024-09-10T06:23:59.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93984474918896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a77406560 con 0x557a773d32d0 2024-09-10T06:23:59.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc577628640 1 -- 172.21.15.117:0/2530224651 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93984474918896] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc568008030 con 0x557a773d32d0 2024-09-10T06:23:59.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 20 remove_watcher() i=3 2024-09-10T06:23:59.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.907+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93984474923296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dd9a0 con 0x557a773ce910 2024-09-10T06:23:59.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93984474923296] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x557a773ce910 2024-09-10T06:23:59.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc579b229c0 20 remove_watcher() i=4 2024-09-10T06:23:59.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93984474921072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dd470 con 0x7fc568071030 2024-09-10T06:23:59.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93984474921072] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc579b229c0 20 remove_watcher() i=5 2024-09-10T06:23:59.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.911+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93984474926848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a77406560 con 0x7fc568071030 2024-09-10T06:23:59.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93984474926848] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 20 remove_watcher() i=6 2024-09-10T06:23:59.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93984474930576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557a773dd9a0 con 0x7fc568071030 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93984474930576] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc57000a4d0 con 0x7fc568071030 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 20 remove_watcher() i=7 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc568071030 msgr2=0x7fc568034940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc568071030 0x7fc568034940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a773ce910 msgr2=0x557a773d0da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a773ce910 0x557a773d0da0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a773d32d0 msgr2=0x557a773d56c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a773d32d0 0x557a773d56c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a773d7bb0 msgr2=0x557a773d9fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a773d7bb0 0x557a773d9fe0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc440039a70 msgr2=0x7fc44003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc440039a70 0x7fc44003bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5600abfd0 tx=0x7fc5600a6000 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 msgr2=0x557a773c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc577e29640 1 -- 172.21.15.117:0/2530224651 reap_dead start 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc56804d9a0 tx=0x7fc56800a350 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 shutdown_connections 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2530224651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773bc3f0 0x557a773c3740 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 >> 172.21.15.117:0/2530224651 conn(0x557a773b8820 msgr2=0x557a773b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 shutdown_connections 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2530224651 wait complete. 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 msgr2=0x7fc45003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 0x7fc45003bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc560000c10 tx=0x7fc560005a10 comp rx=0 tx=0).stop 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 msgr2=0x557a773b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc568001400 tx=0x7fc56801aec0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 shutdown_connections 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc450039a70 0x7fc45003bf30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 --2- 172.21.15.117:0/2082606610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a773afe80 0x557a773b02a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 >> 172.21.15.117:0/2082606610 conn(0x557a773a5830 msgr2=0x557a773a5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 shutdown_connections 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.915+0000 7fc579b229c0 1 -- 172.21.15.117:0/2082606610 wait complete. 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a77211b50 msgr2=0x557a77399220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x557a77211b50 0x557a77399220 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a7739b990 msgr2=0x557a7739dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x557a7739b990 0x557a7739dd80 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a7739f860 msgr2=0x557a773a1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x557a7739f860 0x557a773a1c50 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc45c039b10 msgr2=0x7fc45c03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc45c039b10 0x7fc45c03bfd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5600ad000 tx=0x7fc5600a5040 comp rx=0 tx=0).stop 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 msgr2=0x557a773920b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:23:59.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 --2- 172.21.15.117:0/3728369856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a77211770 0x557a773920b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x557a7738ba00 tx=0x7fc568000bd0 comp rx=0 tx=0).stop 2024-09-10T06:23:59.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc577e29640 1 -- 172.21.15.117:0/3728369856 reap_dead start 2024-09-10T06:23:59.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 shutdown_connections 2024-09-10T06:23:59.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 >> 172.21.15.117:0/3728369856 conn(0x557a77297e90 msgr2=0x557a77385140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:23:59.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 shutdown_connections 2024-09-10T06:23:59.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:23:59.919+0000 7fc579b229c0 1 -- 172.21.15.117:0/3728369856 wait complete. 2024-09-10T06:23:59.931 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T06:23:59.977 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:59.977 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T06:23:59.985 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T06:23:59.985 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-10T06:23:59.986 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T06:23:59.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T06:23:59.986 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-10T06:24:00.019 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:00.019 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:00.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb81ad89c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55744ee61520 0x55744ee61900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb81ad89c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55744ed159c0 con 0x55744ee646b0 2024-09-10T06:24:00.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb81ad89c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55744ed656d0 con 0x55744ee61520 2024-09-10T06:24:00.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb7f5de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55744ee61520 0x55744ee61900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb7eddd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55744ee646b0 0x55744ee66aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:49116/0 (socket says 172.21.15.117:49116) 2024-09-10T06:24:00.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb7eddd640 1 -- 172.21.15.117:0/2693007086 learned_addr learned my addr 172.21.15.117:0/2693007086 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:00.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2693007086 >> v1:172.21.15.84:6789/0 conn(0x55744ee646b0 legacy=0x55744ee66aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.015+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2693007086 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ed09ca0 con 0x55744ee61520 2024-09-10T06:24:00.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/2693007086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ee61900 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000a420 tx=0x7fdb7001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8196f661b790c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb7e5dc640 1 -- 172.21.15.117:0/2693007086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700af070 con 0x55744ee61520 2024-09-10T06:24:00.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb7e5dc640 1 -- 172.21.15.117:0/2693007086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700aa530 con 0x55744ee61520 2024-09-10T06:24:00.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb7e5dc640 1 -- 172.21.15.117:0/2693007086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700aa850 con 0x55744ee61520 2024-09-10T06:24:00.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2693007086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 msgr2=0x55744ee61900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2693007086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ee61900 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000a420 tx=0x7fdb7001afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2693007086 shutdown_connections 2024-09-10T06:24:00.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2693007086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ee61900 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2693007086 >> 172.21.15.117:0/2693007086 conn(0x55744ee5d040 msgr2=0x55744ee5f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2693007086 shutdown_connections 2024-09-10T06:24:00.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.019+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2693007086 wait complete. 2024-09-10T06:24:00.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb81ad89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb81ad89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55744ed69680 con 0x55744ee61520 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53032/0 (socket says 172.21.15.117:53032) 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2865783297 learned_addr learned my addr 172.21.15.117:0/2865783297 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.031+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2865783297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ece4da0 con 0x55744ee61520 2024-09-10T06:24:00.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/2865783297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdb700ad040 tx=0x7fdb700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1571bd5966fb36f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6d60a640 1 -- 172.21.15.117:0/2865783297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700af040 con 0x55744ee61520 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6d60a640 1 -- 172.21.15.117:0/2865783297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700aaa60 con 0x55744ee61520 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6d60a640 1 -- 172.21.15.117:0/2865783297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700aad40 con 0x55744ee61520 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2865783297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 msgr2=0x55744ef4c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2865783297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdb700ad040 tx=0x7fdb700033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2865783297 shutdown_connections 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2865783297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef4c840 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2865783297 >> 172.21.15.117:0/2865783297 conn(0x55744ee5d040 msgr2=0x55744ef484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2865783297 shutdown_connections 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2865783297 wait complete. 2024-09-10T06:24:00.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef53c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55744ed0ba50 con 0x55744ee61520 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef53c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef53c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53044/0 (socket says 172.21.15.117:53044) 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2441151548 learned_addr learned my addr 172.21.15.117:0/2441151548 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ef541f0 con 0x55744ee61520 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef53c90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdb700b8040 tx=0x7fdb70017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6be07640 1 -- 172.21.15.117:0/2441151548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700c5070 con 0x55744ee61520 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6be07640 1 -- 172.21.15.117:0/2441151548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700c1690 con 0x55744ee61520 2024-09-10T06:24:00.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744ef54480 con 0x55744ee61520 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fda6be07640 1 -- 172.21.15.117:0/2441151548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700c1970 con 0x55744ee61520 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.035+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744ef54eb0 con 0x55744ee61520 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fda6be07640 1 -- 172.21.15.117:0/2441151548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb700c8070 con 0x55744ee61520 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fda6be07640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda64039a70 0x7fda6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fda6be07640 1 -- 172.21.15.117:0/2441151548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb700bb070 con 0x55744ee61520 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda64039a70 0x7fda6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ee646b0 0x55744ef5ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef5b340 con 0x55744ee646b0 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ee646b0 0x55744ef5ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda64039a70 0x7fda6403bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb74004180 tx=0x7fdb74001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ee646b0 0x55744ef5ae00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7fddf640 1 -- 172.21.15.117:0/2441151548 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ee646b0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef5b780 con 0x55744ee646b0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7fddf640 1 -- 172.21.15.117:0/2441151548 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ee646b0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef5d590 0x55744ef5f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef60050 con 0x55744ef5d590 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef5d590 0x55744ef5f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef5d590 0x55744ef5f980 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7f5de640 1 -- 172.21.15.117:0/2441151548 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef5d590 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef5c430 con 0x55744ee646b0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7fddf640 1 -- 172.21.15.117:0/2441151548 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ee646b0 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef61490 0x55744ef63880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef64010 con 0x55744ef61490 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef61490 0x55744ef63880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.039+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef61490 0x55744ef63880 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7eddd640 1 -- 172.21.15.117:0/2441151548 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef61490 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55744ed76450 con 0x55744ef71ad0 2024-09-10T06:24:00.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53058/0 (socket says 172.21.15.117:53058) 2024-09-10T06:24:00.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7f5de640 1 -- 172.21.15.117:0/1330074685 learned_addr learned my addr 172.21.15.117:0/1330074685 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7f5de640 1 -- 172.21.15.117:0/1330074685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ef72530 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdb700b47c0 tx=0x7fdb700e9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 -- 172.21.15.117:0/1330074685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700c1d20 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 -- 172.21.15.117:0/1330074685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb70004fd0 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744ef72d90 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 -- 172.21.15.117:0/1330074685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700052f0 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744ef73300 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 -- 172.21.15.117:0/1330074685 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb700e9260 con 0x55744ef71ad0 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 0x7fda5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fda69602640 1 -- 172.21.15.117:0/1330074685 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb700e0070 con 0x55744ef71ad0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 0x7fda5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 0x7fda5803bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55744ef64410 tx=0x7fdb7400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.043+0000 7fdb81ad89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55744ef4cfb0 con 0x55744ef7f2c0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53064/0 (socket says 172.21.15.117:53064) 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 -- 172.21.15.117:0/792959194 learned_addr learned my addr 172.21.15.117:0/792959194 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 -- 172.21.15.117:0/792959194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ef7fc70 con 0x55744ef7f2c0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/792959194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdb700c5ff0 tx=0x7fdb700bca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c058ef791c4aa7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda62ffd640 1 -- 172.21.15.117:0/792959194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700bcba0 con 0x55744ef7f2c0 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda62ffd640 1 -- 172.21.15.117:0/792959194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700de130 con 0x55744ef7f2c0 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda62ffd640 1 -- 172.21.15.117:0/792959194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700e9550 con 0x55744ef7f2c0 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/792959194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 msgr2=0x55744ef7f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/792959194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdb700c5ff0 tx=0x7fdb700bca60 comp rx=0 tx=0).stop 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/792959194 shutdown_connections 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/792959194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef7f6a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/792959194 >> 172.21.15.117:0/792959194 conn(0x55744ef7a680 msgr2=0x55744ef788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/792959194 shutdown_connections 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/792959194 wait complete. 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 Processor -- start 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- start start 2024-09-10T06:24:00.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55744ef7e030 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53066/0 (socket says 172.21.15.117:53066) 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 learned_addr learned my addr 172.21.15.117:0/3290109682 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744ef85aa0 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdb70007f10 tx=0x7fdb700edf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda617fa640 1 -- 172.21.15.117:0/3290109682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7010f070 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744ef85aa0 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda617fa640 1 -- 172.21.15.117:0/3290109682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700eb4e0 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744ef86070 con 0x55744ef7f2c0 2024-09-10T06:24:00.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.047+0000 7fda617fa640 1 -- 172.21.15.117:0/3290109682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700ca450 con 0x55744ef7f2c0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fda617fa640 1 -- 172.21.15.117:0/3290109682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb700d4450 con 0x55744ef7f2c0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fda617fa640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda48039a70 0x7fda4803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fda617fa640 1 -- 172.21.15.117:0/3290109682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdb70105030 con 0x55744ef7f2c0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda48039a70 0x7fda4803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ef90730 0x55744ef92bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef93310 con 0x55744ef90730 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ef90730 0x55744ef92bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda48039a70 0x7fda4803bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c010 tx=0x7fdb74010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ef90730 0x55744ef92bc0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ef90730 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 realm 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef93720 con 0x55744ef90730 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ef90730 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef93ff0 con 0x55744ef90730 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ef90730 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ef90730 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef950f0 0x55744ef974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef97b30 con 0x55744ef950f0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef950f0 0x55744ef974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef950f0 0x55744ef974e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 20 searching for the correct realm 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef99a10 0x55744ef9be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9c4c0 con 0x55744ef99a10 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef99a10 0x55744ef9be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.051+0000 7fdb7eddd640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef99a10 0x55744ef9be40 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9c4c0 con 0x55744ef950f0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7f5de640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fdb700ca070 0x7fdb700d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9c4c0 con 0x7fdb700ca070 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fdb700ca070 0x7fdb700d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fdb700ca070 0x7fdb700d89f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb780083f0 con 0x7fdb700ca070 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb780083f0 con 0x55744ef90730 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef950f0 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.055+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef950f0 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.059+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef950f0 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef950f0 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef99a10 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x7fdb700ca070 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef90730 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55744ef94390 con 0x55744ef950f0 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:00.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.063+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef98380 con 0x55744ef90730 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef98770 con 0x55744ef90730 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef98770 con 0x55744ef99a10 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 zone default found 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 4 Realm: () 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 zonegroup default 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9c940 con 0x7fdb700ca070 2024-09-10T06:24:00.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9e430 con 0x55744ef99a10 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9e8f0 con 0x55744ef99a10 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 started sync module instance, tier type = 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:00.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9d7d0 con 0x55744ef950f0 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93958029565184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9d7d0 con 0x55744ef950f0 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9f430 con 0x55744ef90730 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.067+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93958029565184] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93958029569824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9d7d0 con 0x55744ef90730 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744ef9fe70 con 0x55744ef99a10 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93958029572544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa06c0 con 0x55744ef99a10 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa10e0 con 0x55744ef950f0 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.071+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93958029569824] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93958029577168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa14d0 con 0x55744ef950f0 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa1e90 con 0x55744ef90730 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93958029572544] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93958029577168] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93958029562656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa19e0 con 0x55744ef90730 2024-09-10T06:24:00.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa2230 con 0x7fdb700ca070 2024-09-10T06:24:00.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.075+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93958029562656] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93958029580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa22b0 con 0x7fdb700ca070 2024-09-10T06:24:00.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa2b00 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93958029580768] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93958029582304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa29d0 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.079+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa34c0 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93958029586320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa3930 con 0x7fdb700ca070 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=0 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=1 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=2 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=3 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=4 2024-09-10T06:24:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=5 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93958029582304] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=6 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93958029586320] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 add_watcher() i=7 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efa3930 con 0x55744ef90730 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93958029587584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efa38a0 con 0x55744ef90730 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93958029587584] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fda35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.083+0000 7fdb81ad89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:00.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.087+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efaf340 con 0x55744ef90730 2024-09-10T06:24:00.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.087+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.087+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efaf910 con 0x7fdb700ca070 2024-09-10T06:24:00.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.087+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.087+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efafd90 con 0x55744ef99a10 2024-09-10T06:24:00.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb0300 con 0x55744ef90730 2024-09-10T06:24:00.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb07b0 con 0x55744ef950f0 2024-09-10T06:24:00.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb07b0 con 0x55744ef99a10 2024-09-10T06:24:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.091+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb0d20 con 0x55744ef90730 2024-09-10T06:24:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.095+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.095+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb0d20 con 0x7fdb700ca070 2024-09-10T06:24:00.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.095+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.095+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb0d20 con 0x55744ef950f0 2024-09-10T06:24:00.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb0d20 con 0x55744ef99a10 2024-09-10T06:24:00.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb12f0 con 0x55744ef950f0 2024-09-10T06:24:00.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.099+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb12d0 con 0x7fdb700ca070 2024-09-10T06:24:00.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1290 con 0x55744ef950f0 2024-09-10T06:24:00.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1290 con 0x7fdb700ca070 2024-09-10T06:24:00.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.103+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1460 con 0x55744ef90730 2024-09-10T06:24:00.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1460 con 0x55744ef99a10 2024-09-10T06:24:00.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1460 con 0x55744ef950f0 2024-09-10T06:24:00.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.107+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1460 con 0x55744ef99a10 2024-09-10T06:24:00.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb14f0 con 0x55744ef90730 2024-09-10T06:24:00.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb14f0 con 0x55744ef90730 2024-09-10T06:24:00.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.111+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb14f0 con 0x55744ef99a10 2024-09-10T06:24:00.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef950f0 2024-09-10T06:24:00.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.115+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.119+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x7fdb700ca070 2024-09-10T06:24:00.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x7fdb700ca070 2024-09-10T06:24:00.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.123+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef99a10 2024-09-10T06:24:00.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.127+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.127+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x7fdb700ca070 2024-09-10T06:24:00.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.127+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.127+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efb1600 con 0x55744ef950f0 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.127+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fda34fe1640 20 reqs_thread_entry: start 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 Filter name: none 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fd9ae7fc640 20 reqs_thread_entry: start 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T06:24:00.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efaede0 con 0x55744ef950f0 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:00.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efcf290 con 0x55744ef90730 2024-09-10T06:24:00.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 : miss 2024-09-10T06:24:00.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:96 8.1d 8:bf9aa310:root::.bucket.meta.myfoo6%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efcf080 con 0x7fdb700ca070 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(96 .bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x17 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 4.3f 4:fd9408fc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04c600 con 0x55744ef950f0 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(97 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 4.0 4:00753f2a:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04c600 con 0x55744ef99a10 2024-09-10T06:24:00.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(98 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 4.19 4:9b7aa4d7:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04c600 con 0x55744ef99a10 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(99 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:100 4.b 4:d3d3f200:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04c600 con 0x55744ef950f0 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(100 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d1070 con 0x55744ef950f0 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 4.9 4:921fd45d:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb80 con 0x55744ef90730 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(101 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.131+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 4.19 4:996555dd:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb80 con 0x55744ef99a10 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(102 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:103 4.2e 4:74665b48:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb80 con 0x55744ef99a10 2024-09-10T06:24:00.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(103 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:104 4.3c 4:3e25fad6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb80 con 0x55744ef90730 2024-09-10T06:24:00.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(104 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:105 4.1f 4:fb828412:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb60 con 0x55744ef99a10 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(105 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:106 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb60 con 0x55744ef90730 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(106 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [call out=349b] v0'0 uv21 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 10 cls_bucket_list_unordered: got thirteen 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 4.33 4:cdb31416:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04cb60 con 0x7fdb700ca070 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(107 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 20 get_obj_state: octx=0x7fdb700e9ab0 obj=myfoo6:thirteen state=0x55744f04ac78 s->prefetch_data=0 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 3.17 3:e8c9cc8e:::be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04baa0 con 0x55744ef90730 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(108 be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 10 manifest: total_size = 8 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 20 get_obj_state: setting s->obj_tag to _g4kd6CbYjZUfxIW_aJjyMrf1d5Ptrip 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 20 get_obj_state: octx=0x7fdb700e9ab0 obj=myfoo6:thirteen state=0x55744f04ac78 s->prefetch_data=0 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 20 prepare_atomic_modification: state is not atomic. state=0x55744f04ac78 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.135+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:109 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efd3860 con 0x55744ef90730 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(109 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [stat,call,call] v32'22 uv22 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:110 3.17 3:e8c9cc8e:::be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efd3860 con 0x55744ef90730 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(110 be621638-e902-4133-b94d-0397be1b6a7c.4227.9_thirteen [call] v32'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:111 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efd42f0 con 0x55744ef90730 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 20 list_objects_ordered: starting attempt 1 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:112 4.3f 4:fd9408fc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efd42f0 con 0x55744ef950f0 2024-09-10T06:24:00.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:113 4.0 4:00753f2a:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04af40 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:114 4.19 4:9b7aa4d7:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efdb100 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:115 4.b 4:d3d3f200:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efddb50 con 0x55744ef950f0 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:116 4.9 4:921fd45d:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04af40 con 0x55744ef90730 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:117 4.19 4:996555dd:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efddb50 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:118 4.2e 4:74665b48:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe5230 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:119 4.3c 4:3e25fad6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe80b0 con 0x55744ef90730 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:120 4.1f 4:fb828412:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:121 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efedd10 con 0x55744ef90730 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:122 4.33 4:cdb31416:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0b40 con 0x7fdb700ca070 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(113 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(115 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(118 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(112 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(120 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(114 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(117 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(116 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(119 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(122 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x7fdb700ca070 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(111 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [stat,call,call] v32'23 uv23 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fda627fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(121 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [call out=128b] v0'0 uv23 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[be621638-e902-4133-b94d-0397be1b6a7c.4227.9])"; uploads.size()=0; is_truncated=0 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:123 4.3f 4:fd9408fc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe80b0 con 0x55744ef950f0 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:124 4.0 4:00753f2a:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef99a10 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:125 4.19 4:9b7aa4d7:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efedd10 con 0x55744ef99a10 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:126 4.b 4:d3d3f200:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe80b0 con 0x55744ef950f0 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:127 4.9 4:921fd45d:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:128 4.19 4:996555dd:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efedd10 con 0x55744ef99a10 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:129 4.2e 4:74665b48:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe80b0 con 0x55744ef99a10 2024-09-10T06:24:00.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:130 4.3c 4:3e25fad6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:131 4.1f 4:fb828412:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff06b0 con 0x55744ef99a10 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:132 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744f04af40 con 0x55744ef90730 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:133 4.33 4:cdb31416:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efe3470 con 0x7fdb700ca070 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(123 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(127 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78026040 con 0x55744ef90730 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(124 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(126 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(125 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(129 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(131 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.139+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(128 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(130 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(132 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [call out=128b] v0'0 uv23 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(133 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-10T06:24:00.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-10T06:24:00.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T06:24:00.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93958030270816 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== watch-notify(notify (1) cookie 93958029577168 notify 137438953498 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55744efb0d70 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fda62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93958029577168 notifier 4750 bl.length()=150 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(137 notify.3 [notify cookie 93958030270816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fda62ffd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fda44003d70 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== watch-notify(notify_complete (2) cookie 93958030270816 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55744ef72530 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70132070 con 0x55744ef950f0 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.143+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:139 8.1d 8:bf9aa310:root::.bucket.meta.myfoo6%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x7fdb700ca070 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(139 .bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9 from cache 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:be621638-e902-4133-b94d-0397be1b6a7c.4227.9, ofs0, ns] 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93958030270816 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== watch-notify(notify (1) cookie 93958029565184 notify 137438953499 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55744ef72530 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fda627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 93958029565184 notifier 4750 bl.length()=207 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(140 notify.0 [notify cookie 93958030270816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fda627fc640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd9b40032d0 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== watch-notify(notify_complete (2) cookie 93958030270816 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55744ef54eb0 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:142 4.3f 4:fd9408fc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef950f0 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:143 4.0 4:00753f2a:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efe4ad0 con 0x55744ef99a10 2024-09-10T06:24:00.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:144 4.19 4:9b7aa4d7:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef99a10 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:145 4.b 4:d3d3f200:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef950f0 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:146 4.9 4:921fd45d:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744f04af40 con 0x55744ef90730 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:147 4.19 4:996555dd:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efcd8e0 con 0x55744ef99a10 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:148 4.2e 4:74665b48:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efcdc80 con 0x55744ef99a10 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:149 4.3c 4:3e25fad6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efeaee0 con 0x55744ef90730 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:150 4.1f 4:fb828412:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef99a10 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 4.35 4:aeabaee6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efebc20 con 0x55744ef90730 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:152 4.33 4:cdb31416:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744efe3df0 con 0x7fdb700ca070 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(142 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.147+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(143 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(148 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.6 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 44 ==== osd_op_reply(144 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(145 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 45 ==== osd_op_reply(147 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.5 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(152 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.10 [delete] v32'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 46 ==== osd_op_reply(150 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(149 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(146 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.4 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(151 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.9.9 [delete] v32'24 uv24 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/be621638-e902-4133-b94d-0397be1b6a7c.4227.9 : miss 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:153 6.5 6:a0c611ce:::pubsub..bucket.myfoo6%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef950f0 2024-09-10T06:24:00.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(153 pubsub..bucket.myfoo6/be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/be621638-e902-4133-b94d-0397be1b6a7c.4227.9 info.flags=0x0 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/be621638-e902-4133-b94d-0397be1b6a7c.4227.9 to cache LRU end 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:154 6.5 6:a0c611ce:::pubsub..bucket.myfoo6%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef950f0 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(154 pubsub..bucket.myfoo6/be621638-e902-4133-b94d-0397be1b6a7c.4227.9 [delete] v32'16 uv15 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.151+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-10T06:24:00.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 49 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93958030270816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== watch-notify(notify (1) cookie 93958029580768 notify 137438953508 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55744efce600 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fda62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 93958029580768 notifier 4750 bl.length()=170 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fda62ffd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fda44003d70 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(157 notify.5 [notify cookie 93958030270816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== watch-notify(notify_complete (2) cookie 93958030270816 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55744efafc80 con 0x7fdb700ca070 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 10 removing email index: 2024-09-10T06:24:00.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 10 removing user buckets index 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 50 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93958030270816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== watch-notify(notify (1) cookie 93958029582304 notify 137438953509 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55744efafc80 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fda627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 93958029582304 notifier 4750 bl.length()=160 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fda627fc640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd9b40032d0 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.155+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(160 notify.6 [notify cookie 93958030270816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== watch-notify(notify_complete (2) cookie 93958030270816 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55744efaf510 con 0x7fdb700ca070 2024-09-10T06:24:00.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb81ad89c0 10 removing user index: bud 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef950f0 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(162 bud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb81ad89c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb81ad89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93958030270816 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== watch-notify(notify (1) cookie 93958029580768 notify 137438953510 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55744efaf510 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fda62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 93958029580768 notifier 4750 bl.length()=152 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(163 notify.5 [notify cookie 93958030270816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fda62ffd640 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fda44003d70 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.159+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== watch-notify(notify_complete (2) cookie 93958030270816 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55744efaf340 con 0x7fdb700ca070 2024-09-10T06:24:00.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fda35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:00.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93958029587584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 51 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93958029587584] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93958029565184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef950f0 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93958029565184] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb81ad89c0 20 remove_watcher() i=0 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb81ad89c0 2 removed watcher, disabling cache 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.163+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93958029569824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 52 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93958029569824] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 20 remove_watcher() i=1 2024-09-10T06:24:00.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93958029572544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef99a10 2024-09-10T06:24:00.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb7eddd640 1 -- 172.21.15.117:0/3290109682 <== osd.3 v2:172.21.15.117:6808/266380039 47 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93958029572544] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7400e6c0 con 0x55744ef99a10 2024-09-10T06:24:00.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 20 remove_watcher() i=2 2024-09-10T06:24:00.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93958029577168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef950f0 2024-09-10T06:24:00.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb7f5de640 1 -- 172.21.15.117:0/3290109682 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93958029577168] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7013a020 con 0x55744ef950f0 2024-09-10T06:24:00.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 20 remove_watcher() i=3 2024-09-10T06:24:00.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.167+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93958029562656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x55744ef90730 2024-09-10T06:24:00.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.1 v2:172.21.15.117:6800/2871996333 53 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93958029562656] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x55744ef90730 2024-09-10T06:24:00.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb81ad89c0 20 remove_watcher() i=4 2024-09-10T06:24:00.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93958029580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93958029580768] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb81ad89c0 20 remove_watcher() i=5 2024-09-10T06:24:00.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.171+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93958029582304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93958029582304] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 20 remove_watcher() i=6 2024-09-10T06:24:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93958029586320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55744eff0980 con 0x7fdb700ca070 2024-09-10T06:24:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93958029586320] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb78053040 con 0x7fdb700ca070 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 20 remove_watcher() i=7 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fdb700ca070 msgr2=0x7fdb700d89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fdb700ca070 0x7fdb700d89f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ef90730 msgr2=0x55744ef92bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ef90730 0x55744ef92bc0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef950f0 msgr2=0x55744ef974e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef950f0 0x55744ef974e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef99a10 msgr2=0x55744ef9be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef99a10 0x55744ef9be40 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda48039a70 msgr2=0x7fda4803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda48039a70 0x7fda4803bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c010 tx=0x7fdb74010000 comp rx=0 tx=0).stop 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 msgr2=0x55744ef85540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb7fddf640 1 -- 172.21.15.117:0/3290109682 reap_dead start 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdb70007f10 tx=0x7fdb700edf40 comp rx=0 tx=0).stop 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 shutdown_connections 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/3290109682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef7f2c0 0x55744ef85540 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 >> 172.21.15.117:0/3290109682 conn(0x55744ef7a680 msgr2=0x55744ef78890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 shutdown_connections 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/3290109682 wait complete. 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 msgr2=0x7fda5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 0x7fda5803bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55744ef64410 tx=0x7fdb7400f000 comp rx=0 tx=0).stop 2024-09-10T06:24:00.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 msgr2=0x55744ef71ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdb700b47c0 tx=0x7fdb700e9f60 comp rx=0 tx=0).stop 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 shutdown_connections 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda58039a70 0x7fda5803bf30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/1330074685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ef71ad0 0x55744ef71ef0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 >> 172.21.15.117:0/1330074685 conn(0x55744ef67480 msgr2=0x55744ef67860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 shutdown_connections 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/1330074685 wait complete. 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ee646b0 msgr2=0x55744ef5ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55744ee646b0 0x55744ef5ae00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef5d590 msgr2=0x55744ef5f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55744ef5d590 0x55744ef5f980 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef61490 msgr2=0x55744ef63880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.175+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55744ef61490 0x55744ef63880 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda64039a70 msgr2=0x7fda6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fda64039a70 0x7fda6403bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb74004180 tx=0x7fdb74001340 comp rx=0 tx=0).stop 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 msgr2=0x55744ef53c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 --2- 172.21.15.117:0/2441151548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55744ee61520 0x55744ef53c90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdb700b8040 tx=0x7fdb70017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb7fddf640 1 -- 172.21.15.117:0/2441151548 reap_dead start 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 shutdown_connections 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 >> 172.21.15.117:0/2441151548 conn(0x55744ee5d040 msgr2=0x55744ef46f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 shutdown_connections 2024-09-10T06:24:00.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.179+0000 7fdb81ad89c0 1 -- 172.21.15.117:0/2441151548 wait complete. 2024-09-10T06:24:00.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T06:24:00.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T06:24:00.194 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-10T06:24:00.269 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:00.269 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:00.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55881bc448c0 0x55881bc46cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55881baf49c0 con 0x55881bbb4770 2024-09-10T06:24:00.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55881bb446d0 con 0x55881bc448c0 2024-09-10T06:24:00.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e8a0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55881bc448c0 0x55881bc46cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5f0a1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55881bbb4770 0x55881bc431a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:49132/0 (socket says 172.21.15.117:49132) 2024-09-10T06:24:00.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/1164474208 learned_addr learned my addr 172.21.15.117:0/1164474208 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:00.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/1164474208 >> v1:172.21.15.84:6789/0 conn(0x55881bbb4770 legacy=0x55881bc431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/1164474208 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bae8ca0 con 0x55881bc448c0 2024-09-10T06:24:00.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/1164474208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bc448c0 0x55881bc46cb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a480 tx=0x7f9c4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4aa8c90bf4fafb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e09f640 1 -- 172.21.15.117:0/1164474208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480af070 con 0x55881bc448c0 2024-09-10T06:24:00.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e09f640 1 -- 172.21.15.117:0/1164474208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480aa530 con 0x55881bc448c0 2024-09-10T06:24:00.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c5e09f640 1 -- 172.21.15.117:0/1164474208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480aa830 con 0x55881bc448c0 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1164474208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bc448c0 msgr2=0x55881bc46cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1164474208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bc448c0 0x55881bc46cb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a480 tx=0x7f9c4801b280 comp rx=0 tx=0).stop 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1164474208 shutdown_connections 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1164474208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bc448c0 0x55881bc46cb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1164474208 >> 172.21.15.117:0/1164474208 conn(0x55881bc3ae90 msgr2=0x55881bc3d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1164474208 shutdown_connections 2024-09-10T06:24:00.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.267+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1164474208 wait complete. 2024-09-10T06:24:00.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55881bb48680 con 0x55881bbb4770 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53092/0 (socket says 172.21.15.117:53092) 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/1808986886 learned_addr learned my addr 172.21.15.117:0/1808986886 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/1808986886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bac3da0 con 0x55881bbb4770 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/1808986886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9c50001e00 tx=0x7f9c5000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38a9ecdb557c4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4d60a640 1 -- 172.21.15.117:0/1808986886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50012020 con 0x55881bbb4770 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4d60a640 1 -- 172.21.15.117:0/1808986886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000e690 con 0x55881bbb4770 2024-09-10T06:24:00.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4d60a640 1 -- 172.21.15.117:0/1808986886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c5000ea10 con 0x55881bbb4770 2024-09-10T06:24:00.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1808986886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 msgr2=0x55881bc406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1808986886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9c50001e00 tx=0x7f9c5000b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1808986886 shutdown_connections 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1808986886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bc406a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1808986886 >> 172.21.15.117:0/1808986886 conn(0x55881bc3ae90 msgr2=0x55881bd27570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1808986886 shutdown_connections 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1808986886 wait complete. 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bd351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55881baeaa50 con 0x55881bbb4770 2024-09-10T06:24:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bd351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bd351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53094/0 (socket says 172.21.15.117:53094) 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/711695843 learned_addr learned my addr 172.21.15.117:0/711695843 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bd35750 con 0x55881bbb4770 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bd351f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x55881bc40260 tx=0x7f9c50000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 -- 172.21.15.117:0/711695843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50012030 con 0x55881bbb4770 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 -- 172.21.15.117:0/711695843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50001460 con 0x55881bbb4770 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55881bd359e0 con 0x55881bbb4770 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 -- 172.21.15.117:0/711695843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c5001a7a0 con 0x55881bbb4770 2024-09-10T06:24:00.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881bd36390 con 0x55881bbb4770 2024-09-10T06:24:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 -- 172.21.15.117:0/711695843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c50015020 con 0x55881bbb4770 2024-09-10T06:24:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b44039a70 0x7f9b4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9b4be07640 1 -- 172.21.15.117:0/711695843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9c50020030 con 0x55881bbb4770 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b44039a70 0x7f9b4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bc448c0 0x55881bd3c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd3c8a0 con 0x55881bc448c0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bc448c0 0x55881bd3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.287+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b44039a70 0x7f9b4403bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ac000 tx=0x7f9c480a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bc448c0 0x55881bd3c360 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/711695843 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bc448c0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd36700 con 0x55881bc448c0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/711695843 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bc448c0 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd3eb40 0x55881bd40f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd41600 con 0x55881bd3eb40 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd3eb40 0x55881bd40f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd3eb40 0x55881bd40f30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/711695843 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd3eb40 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd3d9e0 con 0x55881bc448c0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/711695843 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bc448c0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd42a40 0x55881bd44e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd455c0 con 0x55881bd42a40 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd42a40 0x55881bd44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd42a40 0x55881bd44e30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/711695843 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c480a8070 con 0x55881bd42a40 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c6159b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55881bb55450 con 0x55881bd53080 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53110/0 (socket says 172.21.15.117:53110) 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/426978941 learned_addr learned my addr 172.21.15.117:0/426978941 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.291+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/426978941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bd53ae0 con 0x55881bd53080 2024-09-10T06:24:00.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9c5004e9d0 tx=0x7f9c50016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 -- 172.21.15.117:0/426978941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50018430 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55881bd53ae0 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 -- 172.21.15.117:0/426978941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50047500 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 -- 172.21.15.117:0/426978941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c5004d220 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881bd53ae0 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 -- 172.21.15.117:0/426978941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c50009070 con 0x55881bd53080 2024-09-10T06:24:00.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 0x7f9b3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b49602640 1 -- 172.21.15.117:0/426978941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9c50005050 con 0x55881bd53080 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 0x7f9b3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c6159b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55881bc40ef0 con 0x55881bd5f450 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 0x7f9b3803bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c480aa500 tx=0x7f9c48005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53118/0 (socket says 172.21.15.117:53118) 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/1088285607 learned_addr learned my addr 172.21.15.117:0/1088285607 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/1088285607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bd5fe00 con 0x55881bd5f450 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/1088285607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9c50052030 tx=0x7f9c5004d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac0acd11456bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b42ffd640 1 -- 172.21.15.117:0/1088285607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50047e60 con 0x55881bd5f450 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b42ffd640 1 -- 172.21.15.117:0/1088285607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000dce0 con 0x55881bd5f450 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.295+0000 7f9b42ffd640 1 -- 172.21.15.117:0/1088285607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c500502d0 con 0x55881bd5f450 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1088285607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 msgr2=0x55881bd5f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1088285607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9c50052030 tx=0x7f9c5004d790 comp rx=0 tx=0).stop 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1088285607 shutdown_connections 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/1088285607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd5f830 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1088285607 >> 172.21.15.117:0/1088285607 conn(0x55881bd5b880 msgr2=0x55881bd59ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1088285607 shutdown_connections 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/1088285607 wait complete. 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 Processor -- start 2024-09-10T06:24:00.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- start start 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55881bd602e0 con 0x55881bd5f450 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f0a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:53126/0 (socket says 172.21.15.117:53126) 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 learned_addr learned my addr 172.21.15.117:0/871435481 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881bd66d70 con 0x55881bd5f450 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c500185f0 tx=0x7f9c5002df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 -- 172.21.15.117:0/871435481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50063070 con 0x55881bd5f450 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55881bd66d70 con 0x55881bd5f450 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 -- 172.21.15.117:0/871435481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5000dce0 con 0x55881bd5f450 2024-09-10T06:24:00.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 -- 172.21.15.117:0/871435481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50047e60 con 0x55881bd5f450 2024-09-10T06:24:00.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881bd66d70 con 0x55881bd5f450 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 -- 172.21.15.117:0/871435481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c5002e000 con 0x55881bd5f450 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b28039a20 0x7f9b2803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9b417fa640 1 -- 172.21.15.117:0/871435481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9c50058140 con 0x55881bd5f450 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b28039a20 0x7f9b2803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bd71870 0x55881bd73d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd74450 con 0x55881bd71870 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.299+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bd71870 0x55881bd73d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b28039a20 0x7f9b2803bee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a480 tx=0x7f9c480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bd71870 0x55881bd73d00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 realm 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd74860 con 0x55881bd71870 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd75130 con 0x55881bd71870 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:00.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd76230 0x55881bd78620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd78bf0 con 0x55881bd76230 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd76230 0x55881bd78620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd76230 0x55881bd78620 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 20 searching for the correct realm 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd7ab40 0x55881bd7cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7d5f0 con 0x55881bd7ab40 2024-09-10T06:24:00.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd7ab40 0x55881bd7cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5e8a0640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd7ab40 0x55881bd7cf70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7d5f0 con 0x55881bd76230 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9c50017050 0x7f9c500342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7d5f0 con 0x7f9c50017050 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9c50017050 0x7f9c500342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.303+0000 7f9c5f8a2640 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9c50017050 0x7f9c500342f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd76230 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd76230 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.307+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd76230 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.311+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd76230 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd7ab40 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x7f9c50017050 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd71870 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55881bd754d0 con 0x55881bd76230 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd794b0 con 0x55881bd71870 2024-09-10T06:24:00.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd798a0 con 0x55881bd71870 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd798a0 con 0x55881bd7ab40 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 zone default found 2024-09-10T06:24:00.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 4 Realm: () 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 zonegroup default 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7da70 con 0x7f9c50017050 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7f560 con 0x55881bd7ab40 2024-09-10T06:24:00.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7f970 con 0x55881bd7ab40 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 started sync module instance, tier type = 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.315+0000 7f9c6159b9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7e900 con 0x55881bd76230 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94043071048944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd80280 con 0x55881bd76230 2024-09-10T06:24:00.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd80ad0 con 0x55881bd71870 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94043071048944] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94043071053264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd80ad0 con 0x55881bd71870 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.319+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd81510 con 0x55881bd7ab40 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94043071053264] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94043071055392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd80a40 con 0x55881bd7ab40 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd822c0 con 0x55881bd76230 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94043071061424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd82b60 con 0x55881bd76230 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd83560 con 0x55881bd71870 2024-09-10T06:24:00.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94043071061424] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94043071055392] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94043071060224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd826b0 con 0x55881bd71870 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.323+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd83e00 con 0x7f9c50017050 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.327+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94043071060224] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.327+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.327+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94043071066224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd826b0 con 0x7f9c50017050 2024-09-10T06:24:00.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.327+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd842f0 con 0x7f9c50017050 2024-09-10T06:24:00.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.327+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94043071066224] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94043071069632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd842b0 con 0x7f9c50017050 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd84cf0 con 0x7f9c50017050 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94043071069632] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94043071072192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd84cb0 con 0x7f9c50017050 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=0 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=1 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=2 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=3 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=4 2024-09-10T06:24:00.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=5 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.331+0000 7f9c6159b9c0 20 add_watcher() i=6 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94043071072192] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 20 add_watcher() i=7 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd880e0 con 0x55881bd71870 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94043071067984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd85600 con 0x55881bd71870 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94043071067984] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9b167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:00.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:00.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd90a80 con 0x55881bd71870 2024-09-10T06:24:00.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.335+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd91090 con 0x7f9c50017050 2024-09-10T06:24:00.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd91600 con 0x55881bd7ab40 2024-09-10T06:24:00.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd91e50 con 0x55881bd71870 2024-09-10T06:24:00.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.339+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd92240 con 0x55881bd76230 2024-09-10T06:24:00.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd926f0 con 0x55881bd7ab40 2024-09-10T06:24:00.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd8e7a0 con 0x55881bd71870 2024-09-10T06:24:00.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.343+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd8e7a0 con 0x7f9c50017050 2024-09-10T06:24:00.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.347+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.347+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd8e7a0 con 0x55881bd76230 2024-09-10T06:24:00.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.347+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.347+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd8e7a0 con 0x55881bd7ab40 2024-09-10T06:24:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.351+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.351+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x55881bd76230 2024-09-10T06:24:00.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.351+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.351+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x7f9c50017050 2024-09-10T06:24:00.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x55881bd76230 2024-09-10T06:24:00.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x7f9c50017050 2024-09-10T06:24:00.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.355+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x55881bd71870 2024-09-10T06:24:00.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93250 con 0x55881bd7ab40 2024-09-10T06:24:00.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd932e0 con 0x55881bd76230 2024-09-10T06:24:00.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.359+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd932e0 con 0x55881bd7ab40 2024-09-10T06:24:00.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd932e0 con 0x55881bd71870 2024-09-10T06:24:00.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93910 con 0x55881bd71870 2024-09-10T06:24:00.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.363+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93850 con 0x55881bd7ab40 2024-09-10T06:24:00.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd76230 2024-09-10T06:24:00.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.367+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.371+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.371+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.375+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.375+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.379+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.379+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x7f9c50017050 2024-09-10T06:24:00.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.379+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.379+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.383+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.383+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x7f9c50017050 2024-09-10T06:24:00.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.383+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.383+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd7ab40 2024-09-10T06:24:00.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.387+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.387+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x7f9c50017050 2024-09-10T06:24:00.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.387+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.387+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd93700 con 0x55881bd76230 2024-09-10T06:24:00.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9b157e2640 20 reqs_thread_entry: start 2024-09-10T06:24:00.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c6159b9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:00.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c6159b9c0 20 Filter name: none 2024-09-10T06:24:00.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9b0e7fc640 20 reqs_thread_entry: start 2024-09-10T06:24:00.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c6159b9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T06:24:00.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.391+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bd8dc10 con 0x7f9c50017050 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:00.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb10e0 con 0x7f9c50017050 2024-09-10T06:24:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 : miss 2024-09-10T06:24:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:96 8.11 8:895ed960:root::.bucket.meta.myfoo7%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb1130 con 0x55881bd7ab40 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 info.flags=0x17 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 to cache LRU end 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 2024-09-10T06:24:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 4.21 4:872e515f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e660 con 0x7f9c50017050 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(97 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:98 4.22 4:47d1a422:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e660 con 0x55881bd71870 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(98 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 4.11 4:8a5a28eb:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e660 con 0x7f9c50017050 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(99 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.395+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 4.37 4:ec011139:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e660 con 0x7f9c50017050 2024-09-10T06:24:00.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(100 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 4.20 4:04a939a6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x55881bd71870 2024-09-10T06:24:00.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(101 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:102 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x55881bd76230 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(102 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [call out=381b] v0'0 uv3 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 10 cls_bucket_list_unordered: got fourteen 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:103 4.39 4:9de83fe0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x55881bd7ab40 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(103 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 4.24 4:2545b4ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x7f9c50017050 2024-09-10T06:24:00.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(104 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 4.2a 4:56406252:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x55881bd71870 2024-09-10T06:24:00.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(105 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.399+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:106 4.2a 4:5549b2fe:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x55881bd71870 2024-09-10T06:24:00.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(106 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 4.33 4:cf54d5f2:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2e5e0 con 0x7f9c50017050 2024-09-10T06:24:00.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(107 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 20 get_obj_state: octx=0x7f9c50040e60 obj=myfoo7:fourteen state=0x55881be2cb08 s->prefetch_data=0 2024-09-10T06:24:00.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:108 3.23 3:c54d6b41:::be621638-e902-4133-b94d-0397be1b6a7c.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2d930 con 0x7f9c50017050 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(108 be621638-e902-4133-b94d-0397be1b6a7c.4227.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 10 manifest: total_size = 8 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.6472759048069115319 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 20 get_obj_state: octx=0x7f9c50040e60 obj=myfoo7:fourteen state=0x55881be2cb08 s->prefetch_data=0 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 20 prepare_atomic_modification: state is not atomic. state=0x55881be2cb08 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 2024-09-10T06:24:00.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:109 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb5830 con 0x55881bd76230 2024-09-10T06:24:00.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(109 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.403+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 3.23 3:c54d6b41:::be621638-e902-4133-b94d-0397be1b6a7c.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb3810 con 0x7f9c50017050 2024-09-10T06:24:00.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(110 be621638-e902-4133-b94d-0397be1b6a7c.4227.10_fourteen [call] v32'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:111 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb5e10 con 0x55881bd76230 2024-09-10T06:24:00.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 20 list_objects_ordered: starting attempt 1 2024-09-10T06:24:00.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T06:24:00.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:112 4.21 4:872e515f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb5e10 con 0x7f9c50017050 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:113 4.22 4:47d1a422:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2cdd0 con 0x55881bd71870 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:114 4.11 4:8a5a28eb:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbcbf0 con 0x7f9c50017050 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:115 4.37 4:ec011139:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbf4c0 con 0x7f9c50017050 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:116 4.20 4:04a939a6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2cdd0 con 0x55881bd71870 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:117 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbf4c0 con 0x55881bd76230 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:118 4.39 4:9de83fe0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdc6b10 con 0x55881bd7ab40 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:119 4.24 4:2545b4ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdc9560 con 0x7f9c50017050 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:120 4.2a 4:56406252:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcc3a0 con 0x55881bd71870 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:121 4.2a 4:5549b2fe:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcec90 con 0x55881bd71870 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:122 4.33 4:cf54d5f2:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcc3e0 con 0x7f9c50017050 2024-09-10T06:24:00.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(118 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c480d9070 con 0x55881bd7ab40 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(113 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(116 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(120 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(114 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(112 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(121 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(115 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(119 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(122 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(111 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9b427fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-10T06:24:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.407+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(117 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[be621638-e902-4133-b94d-0397be1b6a7c.4227.10])"; uploads.size()=0; is_truncated=0 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:123 4.21 4:872e515f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2bfb0 con 0x7f9c50017050 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:124 4.22 4:47d1a422:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcbd50 con 0x55881bd71870 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:125 4.11 4:8a5a28eb:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2bfb0 con 0x7f9c50017050 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:126 4.37 4:ec011139:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcbd50 con 0x7f9c50017050 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:127 4.20 4:04a939a6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2bfb0 con 0x55881bd71870 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:128 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcbd50 con 0x55881bd76230 2024-09-10T06:24:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:129 4.39 4:9de83fe0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2bfb0 con 0x55881bd7ab40 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:130 4.24 4:2545b4ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdce870 con 0x7f9c50017050 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:131 4.2a 4:56406252:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcbd50 con 0x55881bd71870 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:132 4.2a 4:5549b2fe:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2bfb0 con 0x55881bd71870 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:133 4.33 4:cf54d5f2:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbb530 con 0x7f9c50017050 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(124 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(128 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(127 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(129 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(123 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(125 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(131 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(126 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(130 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(132 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(133 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881be2d750 con 0x7f9c50017050 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2d750 con 0x55881bd76230 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.411+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881be2c920 con 0x55881bd76230 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94043071760672 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbb9d0 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== watch-notify(notify (1) cookie 94043071061424 notify 137438953500 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55881bd8eb50 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9b427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94043071061424 notifier 4757 bl.length()=150 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9b427fc640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9a880032d0 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(137 notify.3 [notify cookie 94043071760672 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== watch-notify(notify_complete (2) cookie 94043071760672 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9c5004d050 con 0x55881bd76230 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:139 8.11 8:895ed960:root::.bucket.meta.myfoo7%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbc9e0 con 0x55881bd7ab40 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(139 .bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10 from cache 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:be621638-e902-4133-b94d-0397be1b6a7c.4227.10, ofs0, ns] 2024-09-10T06:24:00.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.415+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94043071760672 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881be2d5f0 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== watch-notify(notify (1) cookie 94043071053264 notify 137438953493 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55881bd8e340 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94043071053264 notifier 4757 bl.length()=208 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(140 notify.1 [notify cookie 94043071760672 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9b42ffd640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9b24003d70 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== watch-notify(notify_complete (2) cookie 94043071760672 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55881bd90510 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:142 4.21 4:872e515f:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb10a0 con 0x7f9c50017050 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:143 4.22 4:47d1a422:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcaba0 con 0x55881bd71870 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:144 4.11 4:8a5a28eb:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb3f0 con 0x7f9c50017050 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:145 4.37 4:ec011139:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdaf8b0 con 0x7f9c50017050 2024-09-10T06:24:00.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:146 4.20 4:04a939a6:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdc9a20 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:147 4.3e 4:7d0ffddf:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb10a0 con 0x55881bd76230 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:148 4.39 4:9de83fe0:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbb9d0 con 0x55881bd7ab40 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:149 4.24 4:2545b4ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb3f0 con 0x7f9c50017050 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:150 4.2a 4:56406252:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdaf8b0 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 4.2a 4:5549b2fe:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbcfb0 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:152 4.33 4:cf54d5f2:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb10a0 con 0x7f9c50017050 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(148 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.6 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(143 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.1 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(150 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.8 [delete] v32'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(151 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.9 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(147 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.5 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(152 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.10 [delete] v32'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(145 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.3 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.419+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(142 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.0 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(146 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.4 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(144 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.2 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 47 ==== osd_op_reply(149 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.10.7 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/be621638-e902-4133-b94d-0397be1b6a7c.4227.10 : miss 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:153 6.4 6:22a93eb1:::pubsub..bucket.myfoo7%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb3f0 con 0x55881bd71870 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(153 pubsub..bucket.myfoo7/be621638-e902-4133-b94d-0397be1b6a7c.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/be621638-e902-4133-b94d-0397be1b6a7c.4227.10 info.flags=0x0 2024-09-10T06:24:00.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/be621638-e902-4133-b94d-0397be1b6a7c.4227.10 to cache LRU end 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:154 6.4 6:22a93eb1:::pubsub..bucket.myfoo7%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb810 con 0x55881bd71870 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 49 ==== osd_op_reply(154 pubsub..bucket.myfoo7/be621638-e902-4133-b94d-0397be1b6a7c.4227.10 [delete] v32'227 uv166 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb810 con 0x7f9c50017050 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 48 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T06:24:00.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.423+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb810 con 0x7f9c50017050 2024-09-10T06:24:00.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 49 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c6159b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T06:24:00.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94043071254688 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdcb810 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== watch-notify(notify (1) cookie 94043071055392 notify 137438953479 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55881bdb0650 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94043071055392 notifier 4757 bl.length()=170 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9b42ffd640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9b24003d70 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(157 notify.2 [notify cookie 94043071254688 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== watch-notify(notify_complete (2) cookie 94043071254688 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55881bd91e00 con 0x55881bd7ab40 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c6159b9c0 10 removing email index: 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c6159b9c0 10 removing user buckets index 2024-09-10T06:24:00.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.427+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdb10a0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 50 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c6159b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94043071254688 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbc9e0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 51 ==== watch-notify(notify (1) cookie 94043071069632 notify 137438953511 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55881bd90510 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9b427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94043071069632 notifier 4757 bl.length()=160 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9b427fc640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9a880032d0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 52 ==== osd_op_reply(160 notify.6 [notify cookie 94043071254688 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 53 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 54 ==== watch-notify(notify_complete (2) cookie 94043071254688 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55881bd90310 con 0x7f9c50017050 2024-09-10T06:24:00.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c6159b9c0 10 removing user index: fud 2024-09-10T06:24:00.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.431+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bdbc9e0 con 0x7f9c50017050 2024-09-10T06:24:00.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 55 ==== osd_op_reply(162 fud [call,call,delete] v32'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c6159b9c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T06:24:00.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c6159b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T06:24:00.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94043071254688 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55881bdc9a20 con 0x7f9c50017050 2024-09-10T06:24:00.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 56 ==== watch-notify(notify (1) cookie 94043071066224 notify 137438953512 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55881bd90310 con 0x7f9c50017050 2024-09-10T06:24:00.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94043071066224 notifier 4757 bl.length()=152 2024-09-10T06:24:00.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9b42ffd640 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9b24003d70 con 0x7f9c50017050 2024-09-10T06:24:00.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 57 ==== osd_op_reply(163 notify.5 [notify cookie 94043071254688 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 58 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 59 ==== watch-notify(notify_complete (2) cookie 94043071254688 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55881bd91430 con 0x7f9c50017050 2024-09-10T06:24:00.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9b167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:00.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.435+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94043071067984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd87710 con 0x55881bd71870 2024-09-10T06:24:00.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 50 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94043071067984] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94043071048944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd83750 con 0x55881bd76230 2024-09-10T06:24:00.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94043071048944] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c6159b9c0 20 remove_watcher() i=0 2024-09-10T06:24:00.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c6159b9c0 2 removed watcher, disabling cache 2024-09-10T06:24:00.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.439+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94043071053264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd87710 con 0x55881bd71870 2024-09-10T06:24:00.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 51 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94043071053264] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 20 remove_watcher() i=1 2024-09-10T06:24:00.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94043071055392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7fdd0 con 0x55881bd7ab40 2024-09-10T06:24:00.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c5e8a0640 1 -- 172.21.15.117:0/871435481 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94043071055392] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c480ea040 con 0x55881bd7ab40 2024-09-10T06:24:00.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 20 remove_watcher() i=2 2024-09-10T06:24:00.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94043071061424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd87710 con 0x55881bd76230 2024-09-10T06:24:00.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c5f0a1640 1 -- 172.21.15.117:0/871435481 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94043071061424] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c50008030 con 0x55881bd76230 2024-09-10T06:24:00.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 20 remove_watcher() i=3 2024-09-10T06:24:00.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.443+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94043071060224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd80620 con 0x55881bd71870 2024-09-10T06:24:00.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.1 v2:172.21.15.117:6800/2871996333 52 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94043071060224] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x55881bd71870 2024-09-10T06:24:00.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c6159b9c0 20 remove_watcher() i=4 2024-09-10T06:24:00.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94043071066224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd7fdd0 con 0x7f9c50017050 2024-09-10T06:24:00.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 60 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94043071066224] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c6159b9c0 20 remove_watcher() i=5 2024-09-10T06:24:00.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.447+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94043071069632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd87710 con 0x7f9c50017050 2024-09-10T06:24:00.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 61 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94043071069632] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 20 remove_watcher() i=6 2024-09-10T06:24:00.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94043071072192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55881bd81900 con 0x7f9c50017050 2024-09-10T06:24:00.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 <== osd.0 v2:172.21.15.84:6800/3404052370 62 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94043071072192] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c5800a4d0 con 0x7f9c50017050 2024-09-10T06:24:00.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 20 remove_watcher() i=7 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9c50017050 msgr2=0x7f9c500342f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9c50017050 0x7f9c500342f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bd71870 msgr2=0x55881bd73d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bd71870 0x55881bd73d00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd76230 msgr2=0x55881bd78620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd76230 0x55881bd78620 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd7ab40 msgr2=0x55881bd7cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd7ab40 0x55881bd7cf70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b28039a20 msgr2=0x7f9b2803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b28039a20 0x7f9b2803bee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a480 tx=0x7f9c480a7000 comp rx=0 tx=0).stop 2024-09-10T06:24:00.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 msgr2=0x55881bd66810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/871435481 reap_dead start 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c500185f0 tx=0x7f9c5002df00 comp rx=0 tx=0).stop 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 shutdown_connections 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/871435481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd5f450 0x55881bd66810 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 >> 172.21.15.117:0/871435481 conn(0x55881bd5b880 msgr2=0x55881bd59a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 shutdown_connections 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.451+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/871435481 wait complete. 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 msgr2=0x7f9b3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 0x7f9b3803bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c480aa500 tx=0x7f9c48005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 msgr2=0x55881bd534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9c5004e9d0 tx=0x7f9c50016b00 comp rx=0 tx=0).stop 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 shutdown_connections 2024-09-10T06:24:00.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b38039a70 0x7f9b3803bf30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/426978941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bd53080 0x55881bd534a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 >> 172.21.15.117:0/426978941 conn(0x55881bd48a30 msgr2=0x55881bd48e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 shutdown_connections 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/426978941 wait complete. 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bc448c0 msgr2=0x55881bd3c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55881bc448c0 0x55881bd3c360 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd3eb40 msgr2=0x55881bd40f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55881bd3eb40 0x55881bd40f30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd42a40 msgr2=0x55881bd44e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55881bd42a40 0x55881bd44e30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b44039a70 msgr2=0x7f9b4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9b44039a70 0x7f9b4403bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ac000 tx=0x7f9c480a5000 comp rx=0 tx=0).stop 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 msgr2=0x55881bd351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 --2- 172.21.15.117:0/711695843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55881bbb4770 0x55881bd351f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x55881bc40260 tx=0x7f9c50000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c5f8a2640 1 -- 172.21.15.117:0/711695843 reap_dead start 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 shutdown_connections 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 >> 172.21.15.117:0/711695843 conn(0x55881bc3ae90 msgr2=0x55881bc3f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 shutdown_connections 2024-09-10T06:24:00.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:00.455+0000 7f9c6159b9c0 1 -- 172.21.15.117:0/711695843 wait complete. 2024-09-10T06:24:40.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-10T06:24:40.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-10T06:24:40.472 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-10T06:24:40.513 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:40.513 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:40.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.510+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.510+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.510+0000 7f3e006329c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564726cfc560 0x564726cfe950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.510+0000 7f3e006329c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564726bad9c0 con 0x564726cf8370 2024-09-10T06:24:40.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.510+0000 7f3e006329c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x564726bfd6d0 con 0x564726cfc560 2024-09-10T06:24:40.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd937640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564726cfc560 0x564726cfe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfe138640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x564726cf8370 0x564726cf8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54304/0 (socket says 172.21.15.117:54304) 2024-09-10T06:24:40.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfe138640 1 -- 172.21.15.117:0/727073913 learned_addr learned my addr 172.21.15.117:0/727073913 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:40.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd937640 1 -- 172.21.15.117:0/727073913 >> v1:172.21.15.84:6789/0 conn(0x564726cf8370 legacy=0x564726cf8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd937640 1 -- 172.21.15.117:0/727073913 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726ba1ca0 con 0x564726cfc560 2024-09-10T06:24:40.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd937640 1 --2- 172.21.15.117:0/727073913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cfc560 0x564726cfe950 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3df400a420 tx=0x7f3df401b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56601d4226eca8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd136640 1 -- 172.21.15.117:0/727073913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df40af070 con 0x564726cfc560 2024-09-10T06:24:40.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd136640 1 -- 172.21.15.117:0/727073913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df40aa530 con 0x564726cfc560 2024-09-10T06:24:40.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3dfd136640 1 -- 172.21.15.117:0/727073913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df40aa850 con 0x564726cfc560 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3e006329c0 1 -- 172.21.15.117:0/727073913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cfc560 msgr2=0x564726cfe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3e006329c0 1 --2- 172.21.15.117:0/727073913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cfc560 0x564726cfe950 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3df400a420 tx=0x7f3df401b060 comp rx=0 tx=0).stop 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3e006329c0 1 -- 172.21.15.117:0/727073913 shutdown_connections 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3e006329c0 1 --2- 172.21.15.117:0/727073913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cfc560 0x564726cfe950 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.514+0000 7f3e006329c0 1 -- 172.21.15.117:0/727073913 >> 172.21.15.117:0/727073913 conn(0x564726cf3e90 msgr2=0x564726cf62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.518+0000 7f3e006329c0 1 -- 172.21.15.117:0/727073913 shutdown_connections 2024-09-10T06:24:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.518+0000 7f3e006329c0 1 -- 172.21.15.117:0/727073913 wait complete. 2024-09-10T06:24:40.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564726c01680 con 0x564726cf8370 2024-09-10T06:24:40.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45288/0 (socket says 172.21.15.117:45288) 2024-09-10T06:24:40.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 -- 172.21.15.117:0/3824148505 learned_addr learned my addr 172.21.15.117:0/3824148505 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 -- 172.21.15.117:0/3824148505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726b7cda0 con 0x564726cf8370 2024-09-10T06:24:40.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3824148505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3df0001e00 tx=0x7f3df000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330a7fea207e6f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3cec608640 1 -- 172.21.15.117:0/3824148505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df0012020 con 0x564726cf8370 2024-09-10T06:24:40.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3cec608640 1 -- 172.21.15.117:0/3824148505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df000e690 con 0x564726cf8370 2024-09-10T06:24:40.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3cec608640 1 -- 172.21.15.117:0/3824148505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df000ea10 con 0x564726cf8370 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- 172.21.15.117:0/3824148505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 msgr2=0x564726de47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3824148505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3df0001e00 tx=0x7f3df000b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- 172.21.15.117:0/3824148505 shutdown_connections 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3824148505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726de47f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- 172.21.15.117:0/3824148505 >> 172.21.15.117:0/3824148505 conn(0x564726cf3e90 msgr2=0x564726de0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- 172.21.15.117:0/3824148505 shutdown_connections 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- 172.21.15.117:0/3824148505 wait complete. 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726debe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3e006329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564726ba3a50 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.534+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726debe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726debe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45290/0 (socket says 172.21.15.117:45290) 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe138640 1 -- 172.21.15.117:0/2046428189 learned_addr learned my addr 172.21.15.117:0/2046428189 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe138640 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726dec3f0 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe138640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726debe90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x564726de57e0 tx=0x7f3df0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 -- 172.21.15.117:0/2046428189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df0012030 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564726dec680 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 -- 172.21.15.117:0/2046428189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df001a750 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 -- 172.21.15.117:0/2046428189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df001aa50 con 0x564726cf8370 2024-09-10T06:24:40.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564726ded030 con 0x564726cf8370 2024-09-10T06:24:40.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 -- 172.21.15.117:0/2046428189 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3df0015020 con 0x564726cf8370 2024-09-10T06:24:40.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3ce4039a70 0x7f3ce403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3ceae05640 1 -- 172.21.15.117:0/2046428189 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3df0020030 con 0x564726cf8370 2024-09-10T06:24:40.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfd937640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3ce4039a70 0x7f3ce403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726cfc560 0x564726df3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726df3540 con 0x564726cfc560 2024-09-10T06:24:40.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe939640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726cfc560 0x564726df3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfd937640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3ce4039a70 0x7f3ce403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ac000 tx=0x7f3df40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe939640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726cfc560 0x564726df3000 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3dfe939640 1 -- 172.21.15.117:0/2046428189 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df80083f0 con 0x564726cfc560 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.538+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726df3990 con 0x564726cfc560 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe939640 1 -- 172.21.15.117:0/2046428189 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3df80083f0 con 0x564726cfc560 2024-09-10T06:24:40.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726df57a0 0x564726df7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726df8260 con 0x564726df57a0 2024-09-10T06:24:40.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726df57a0 0x564726df7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726df57a0 0x564726df7b90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 -- 172.21.15.117:0/2046428189 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3df0008030 con 0x564726df57a0 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726df4640 con 0x564726cfc560 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe939640 1 -- 172.21.15.117:0/2046428189 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3df80083f0 con 0x564726cfc560 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726df96a0 0x564726dfba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726dfc220 con 0x564726df96a0 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfd937640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726df96a0 0x564726dfba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfd937640 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726df96a0 0x564726dfba90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfd937640 1 -- 172.21.15.117:0/2046428189 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3df40b2070 con 0x564726df96a0 2024-09-10T06:24:40.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3e006329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564726c0e450 con 0x564726e09ce0 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45306/0 (socket says 172.21.15.117:45306) 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.542+0000 7f3dfe138640 1 -- 172.21.15.117:0/3263893489 learned_addr learned my addr 172.21.15.117:0/3263893489 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 -- 172.21.15.117:0/3263893489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726e0a740 con 0x564726e09ce0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3df004ec80 tx=0x7f3df001aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 -- 172.21.15.117:0/3263893489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df002ce60 con 0x564726e09ce0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 -- 172.21.15.117:0/3263893489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df0016d10 con 0x564726e09ce0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564726e0afa0 con 0x564726e09ce0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 -- 172.21.15.117:0/3263893489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df0016570 con 0x564726e09ce0 2024-09-10T06:24:40.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564726e0afa0 con 0x564726e09ce0 2024-09-10T06:24:40.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 -- 172.21.15.117:0/3263893489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3df004a040 con 0x564726e09ce0 2024-09-10T06:24:40.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 0x7f3cd803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3ce3fff640 1 -- 172.21.15.117:0/3263893489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3df0005050 con 0x564726e09ce0 2024-09-10T06:24:40.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 0x7f3cd803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3e006329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564726de5040 con 0x564726e17270 2024-09-10T06:24:40.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 0x7f3cd803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ad040 tx=0x7f3df4005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45318/0 (socket says 172.21.15.117:45318) 2024-09-10T06:24:40.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 -- 172.21.15.117:0/3463302004 learned_addr learned my addr 172.21.15.117:0/3463302004 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.546+0000 7f3dfe138640 1 -- 172.21.15.117:0/3463302004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726e17c40 con 0x564726e17270 2024-09-10T06:24:40.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3463302004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3df0018c60 tx=0x7f3df0004010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ece813473d08e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ce1ffb640 1 -- 172.21.15.117:0/3463302004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df000cc20 con 0x564726e17270 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ce1ffb640 1 -- 172.21.15.117:0/3463302004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df005f070 con 0x564726e17270 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ce1ffb640 1 -- 172.21.15.117:0/3463302004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df0050cf0 con 0x564726e17270 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3463302004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 msgr2=0x564726e17650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3463302004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3df0018c60 tx=0x7f3df0004010 comp rx=0 tx=0).stop 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3463302004 shutdown_connections 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3463302004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e17650 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3463302004 >> 172.21.15.117:0/3463302004 conn(0x564726e12690 msgr2=0x564726e108d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3463302004 shutdown_connections 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3463302004 wait complete. 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 Processor -- start 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- start start 2024-09-10T06:24:40.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564726e16040 con 0x564726e17270 2024-09-10T06:24:40.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45320/0 (socket says 172.21.15.117:45320) 2024-09-10T06:24:40.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 learned_addr learned my addr 172.21.15.117:0/3320614623 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564726e1dac0 con 0x564726e17270 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3df0018c60 tx=0x7f3df00037e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ccffff640 1 -- 172.21.15.117:0/3320614623 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df0040210 con 0x564726e17270 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564726e1dac0 con 0x564726e17270 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564726e1dac0 con 0x564726e17270 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ccffff640 1 -- 172.21.15.117:0/3320614623 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df005f070 con 0x564726e17270 2024-09-10T06:24:40.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.550+0000 7f3ccffff640 1 -- 172.21.15.117:0/3320614623 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3df004d500 con 0x564726e17270 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3ccffff640 1 -- 172.21.15.117:0/3320614623 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3df0059070 con 0x564726e17270 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3ccffff640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cc8039a70 0x7f3cc803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3ccffff640 1 -- 172.21.15.117:0/3320614623 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3df006ebe0 con 0x564726e17270 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cc8039a70 0x7f3cc803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726e286d0 0x564726e2ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e2b2e0 con 0x564726e286d0 2024-09-10T06:24:40.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726e286d0 0x564726e2ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cc8039a70 0x7f3cc803bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3df40aafd0 tx=0x7f3df40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726e286d0 0x564726e2ab90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df80083f0 con 0x564726e286d0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 realm 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e2b6f0 con 0x564726e286d0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df80083f0 con 0x564726e286d0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e2bfc0 con 0x564726e286d0 2024-09-10T06:24:40.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df80083f0 con 0x564726e286d0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3df80083f0 con 0x564726e286d0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726e2d0c0 0x564726e2f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e2fa70 con 0x564726e2d0c0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726e2d0c0 0x564726e2f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726e2d0c0 0x564726e2f4b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:40.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 20 searching for the correct realm 2024-09-10T06:24:40.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726e319c0 0x564726e33dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.554+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e344a0 con 0x564726e319c0 2024-09-10T06:24:40.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726e319c0 0x564726e33dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfd937640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726e319c0 0x564726e33dd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e344a0 con 0x564726e2d0c0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe138640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3df0017050 0x7f3df0027340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e344a0 con 0x7f3df0017050 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3df0017050 0x7f3df0027340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3df0017050 0x7f3df0027340 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df80083f0 con 0x7f3df0017050 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df80083f0 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.558+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e2d0c0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e2d0c0 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.562+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e2d0c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.566+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e2d0c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e319c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x7f3df0017050 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e286d0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564726e2c360 con 0x564726e2d0c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:40.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e30330 con 0x564726e286d0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e30720 con 0x564726e286d0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e30720 con 0x564726e319c0 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 zone default found 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 4 Realm: () 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 zonegroup default 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e34920 con 0x7f3df0017050 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e36460 con 0x564726e319c0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.570+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e368c0 con 0x564726e319c0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 20 started sync module instance, tier type = 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:40.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e357b0 con 0x564726e2d0c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863595101088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e35410 con 0x564726e2d0c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e377d0 con 0x564726e286d0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863595101088] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863595107104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e37bf0 con 0x564726e286d0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.574+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e38480 con 0x564726e319c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863595107104] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863595108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e38870 con 0x564726e319c0 2024-09-10T06:24:40.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e39230 con 0x564726e2d0c0 2024-09-10T06:24:40.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863595115984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e39ea0 con 0x564726e2d0c0 2024-09-10T06:24:40.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.578+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3a860 con 0x564726e286d0 2024-09-10T06:24:40.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863595108432] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863595115984] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863595119536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e39ea0 con 0x564726e286d0 2024-09-10T06:24:40.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3a7d0 con 0x7f3df0017050 2024-09-10T06:24:40.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863595121664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3a7d0 con 0x7f3df0017050 2024-09-10T06:24:40.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.582+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3bc20 con 0x7f3df0017050 2024-09-10T06:24:40.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863595119536] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863595117040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3bc20 con 0x7f3df0017050 2024-09-10T06:24:40.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3c5e0 con 0x7f3df0017050 2024-09-10T06:24:40.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863595121664] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863595117040] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863595124592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3bb90 con 0x7f3df0017050 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=0 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=1 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=2 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=3 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=4 2024-09-10T06:24:40.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=5 2024-09-10T06:24:40.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.586+0000 7f3e006329c0 20 add_watcher() i=6 2024-09-10T06:24:40.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863595124592] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3e006329c0 20 add_watcher() i=7 2024-09-10T06:24:40.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3e006329c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:40.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e3f610 con 0x564726e286d0 2024-09-10T06:24:40.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863595127088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3ca00 con 0x564726e286d0 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.590+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863595127088] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3cb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 5 note: GC not initialized 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3c2f7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 Filter name: none 2024-09-10T06:24:40.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3c2d7fa640 20 reqs_thread_entry: start 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564726e62ac0 con 0x564726e286d0 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:40.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.594+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x7f3df0017050 2024-09-10T06:24:40.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.598+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.598+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x7f3df0017050 2024-09-10T06:24:40.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.598+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3cb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:40.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863595127088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x564726e286d0 2024-09-10T06:24:40.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94863595127088] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863595101088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x564726e2d0c0 2024-09-10T06:24:40.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94863595101088] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3e006329c0 20 remove_watcher() i=0 2024-09-10T06:24:40.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3e006329c0 2 removed watcher, disabling cache 2024-09-10T06:24:40.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.602+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863595107104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x564726e286d0 2024-09-10T06:24:40.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94863595107104] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3e006329c0 20 remove_watcher() i=1 2024-09-10T06:24:40.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863595108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e624a0 con 0x564726e319c0 2024-09-10T06:24:40.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3dfd937640 1 -- 172.21.15.117:0/3320614623 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94863595108432] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df40c9070 con 0x564726e319c0 2024-09-10T06:24:40.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3e006329c0 20 remove_watcher() i=2 2024-09-10T06:24:40.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.606+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863595115984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e37320 con 0x564726e2d0c0 2024-09-10T06:24:40.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3dfe138640 1 -- 172.21.15.117:0/3320614623 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94863595115984] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df0073020 con 0x564726e2d0c0 2024-09-10T06:24:40.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3e006329c0 20 remove_watcher() i=3 2024-09-10T06:24:40.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863595119536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e37850 con 0x564726e286d0 2024-09-10T06:24:40.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94863595119536] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x564726e286d0 2024-09-10T06:24:40.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3e006329c0 20 remove_watcher() i=4 2024-09-10T06:24:40.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.610+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863595121664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e395d0 con 0x7f3df0017050 2024-09-10T06:24:40.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94863595121664] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3e006329c0 20 remove_watcher() i=5 2024-09-10T06:24:40.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863595117040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e37320 con 0x7f3df0017050 2024-09-10T06:24:40.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94863595117040] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3e006329c0 20 remove_watcher() i=6 2024-09-10T06:24:40.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.614+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863595124592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564726e3a3b0 con 0x7f3df0017050 2024-09-10T06:24:40.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94863595124592] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3df8026040 con 0x7f3df0017050 2024-09-10T06:24:40.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 20 remove_watcher() i=7 2024-09-10T06:24:40.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3df0017050 msgr2=0x7f3df0027340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f3df0017050 0x7f3df0027340 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726e286d0 msgr2=0x564726e2ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726e286d0 0x564726e2ab90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726e2d0c0 msgr2=0x564726e2f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726e2d0c0 0x564726e2f4b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726e319c0 msgr2=0x564726e33dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726e319c0 0x564726e33dd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cc8039a70 msgr2=0x7f3cc803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cc8039a70 0x7f3cc803bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3df40aafd0 tx=0x7f3df40a7000 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 msgr2=0x564726e1d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3dfe939640 1 -- 172.21.15.117:0/3320614623 reap_dead start 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3df0018c60 tx=0x7f3df00037e0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 shutdown_connections 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3320614623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e17270 0x564726e1d560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 >> 172.21.15.117:0/3320614623 conn(0x564726e12690 msgr2=0x564726e108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 shutdown_connections 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3320614623 wait complete. 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 msgr2=0x7f3cd803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 0x7f3cd803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ad040 tx=0x7f3df4005d90 comp rx=0 tx=0).stop 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 msgr2=0x564726e0a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3df004ec80 tx=0x7f3df001aec0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 shutdown_connections 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3cd8039a70 0x7f3cd803bf30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/3263893489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726e09ce0 0x564726e0a100 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 >> 172.21.15.117:0/3263893489 conn(0x564726dff690 msgr2=0x564726dffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 shutdown_connections 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/3263893489 wait complete. 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726cfc560 msgr2=0x564726df3000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564726cfc560 0x564726df3000 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726df57a0 msgr2=0x564726df7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564726df57a0 0x564726df7b90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726df96a0 msgr2=0x564726dfba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564726df96a0 0x564726dfba90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3ce4039a70 msgr2=0x7f3ce403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f3ce4039a70 0x7f3ce403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ac000 tx=0x7f3df40a5000 comp rx=0 tx=0).stop 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 msgr2=0x564726debe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 --2- 172.21.15.117:0/2046428189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564726cf8370 0x564726debe90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x564726de57e0 tx=0x7f3df0000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3dfe939640 1 -- 172.21.15.117:0/2046428189 reap_dead start 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 shutdown_connections 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 >> 172.21.15.117:0/2046428189 conn(0x564726cf3e90 msgr2=0x564726ddef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 shutdown_connections 2024-09-10T06:24:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.618+0000 7f3e006329c0 1 -- 172.21.15.117:0/2046428189 wait complete. 2024-09-10T06:24:40.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T06:24:40.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T06:24:40.633 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T06:24:40.706 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:40.707 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7abde59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562d828d3770 0x562d829645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7abde59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d828139c0 con 0x562d828d3b50 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7abde59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x562d828636d0 con 0x562d828d3770 2024-09-10T06:24:40.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7a98eb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562d828d3770 0x562d829645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7a90ea640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x562d828d3b50 0x562d82966af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54320/0 (socket says 172.21.15.117:54320) 2024-09-10T06:24:40.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7a90ea640 1 -- 172.21.15.117:0/1486399519 learned_addr learned my addr 172.21.15.117:0/1486399519 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:40.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7a98eb640 1 -- 172.21.15.117:0/1486399519 >> v1:172.21.15.84:6789/0 conn(0x562d828d3b50 legacy=0x562d82966af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.706+0000 7fe7a98eb640 1 -- 172.21.15.117:0/1486399519 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d82807ca0 con 0x562d828d3770 2024-09-10T06:24:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/1486399519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d829645a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400a420 tx=0x7fe7a401ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf583a02155aada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7a88e9640 1 -- 172.21.15.117:0/1486399519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40b0070 con 0x562d828d3770 2024-09-10T06:24:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7a88e9640 1 -- 172.21.15.117:0/1486399519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40a3ce0 con 0x562d828d3770 2024-09-10T06:24:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7a88e9640 1 -- 172.21.15.117:0/1486399519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40ab440 con 0x562d828d3770 2024-09-10T06:24:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 -- 172.21.15.117:0/1486399519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 msgr2=0x562d829645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/1486399519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d829645a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400a420 tx=0x7fe7a401ae60 comp rx=0 tx=0).stop 2024-09-10T06:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 -- 172.21.15.117:0/1486399519 shutdown_connections 2024-09-10T06:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/1486399519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d829645a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 -- 172.21.15.117:0/1486399519 >> 172.21.15.117:0/1486399519 conn(0x562d82959e90 msgr2=0x562d8295c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 -- 172.21.15.117:0/1486399519 shutdown_connections 2024-09-10T06:24:40.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.710+0000 7fe7abde59c0 1 -- 172.21.15.117:0/1486399519 wait complete. 2024-09-10T06:24:40.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7abde59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7abde59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d82867680 con 0x562d828d3770 2024-09-10T06:24:40.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45328/0 (socket says 172.21.15.117:45328) 2024-09-10T06:24:40.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7a98eb640 1 -- 172.21.15.117:0/4098438595 learned_addr learned my addr 172.21.15.117:0/4098438595 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7a98eb640 1 -- 172.21.15.117:0/4098438595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d827e2da0 con 0x562d828d3770 2024-09-10T06:24:40.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.726+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/4098438595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4018a90 tx=0x7fe7a40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c57d1e681ccf509 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe697e07640 1 -- 172.21.15.117:0/4098438595 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40b9070 con 0x562d828d3770 2024-09-10T06:24:40.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe697e07640 1 -- 172.21.15.117:0/4098438595 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40ab440 con 0x562d828d3770 2024-09-10T06:24:40.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe697e07640 1 -- 172.21.15.117:0/4098438595 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40b0040 con 0x562d828d3770 2024-09-10T06:24:40.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/4098438595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 msgr2=0x562d82a4ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/4098438595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4018a90 tx=0x7fe7a40033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/4098438595 shutdown_connections 2024-09-10T06:24:40.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/4098438595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a4ca40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/4098438595 >> 172.21.15.117:0/4098438595 conn(0x562d82959e90 msgr2=0x562d82a48680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/4098438595 shutdown_connections 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/4098438595 wait complete. 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a53f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d82809a50 con 0x562d828d3770 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a53f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a53f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45344/0 (socket says 172.21.15.117:45344) 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7a98eb640 1 -- 172.21.15.117:0/105469385 learned_addr learned my addr 172.21.15.117:0/105469385 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7a98eb640 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d82a544d0 con 0x562d828d3770 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a53f70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40a4fd0 tx=0x7fe7a4017c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe696604640 1 -- 172.21.15.117:0/105469385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40c3020 con 0x562d828d3770 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d82a54760 con 0x562d828d3770 2024-09-10T06:24:40.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe696604640 1 -- 172.21.15.117:0/105469385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40ace40 con 0x562d828d3770 2024-09-10T06:24:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe696604640 1 -- 172.21.15.117:0/105469385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40b9040 con 0x562d828d3770 2024-09-10T06:24:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.730+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d82a55190 con 0x562d828d3770 2024-09-10T06:24:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe696604640 1 -- 172.21.15.117:0/105469385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7a40bf580 con 0x562d828d3770 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe696604640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe690039ac0 0x7fe69003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe696604640 1 -- 172.21.15.117:0/105469385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe7a40e9d10 con 0x562d828d3770 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe690039ac0 0x7fe69003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d828d3b50 0x562d82a5b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a5b620 con 0x562d828d3b50 2024-09-10T06:24:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d828d3b50 0x562d82a5b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe690039ac0 0x7fe69003bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b2e0 tx=0x7fe7940014f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d828d3b50 0x562d82a5b0e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/105469385 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d828d3b50 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a5ba50 con 0x562d828d3b50 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/105469385 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d828d3b50 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a5d860 0x562d82a5fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a60320 con 0x562d82a5d860 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a5d860 0x562d82a5fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a5d860 0x562d82a5fc50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a98eb640 1 -- 172.21.15.117:0/105469385 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7a40c5020 con 0x562d82a5d860 2024-09-10T06:24:40.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a5c700 con 0x562d828d3b50 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/105469385 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d828d3b50 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a61760 0x562d82a63b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a642c0 con 0x562d82a61760 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.734+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a61760 0x562d82a63b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a61760 0x562d82a63b50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a90ea640 1 -- 172.21.15.117:0/105469385 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe79400f760 con 0x562d82a61760 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d82874450 con 0x562d82a71d80 2024-09-10T06:24:40.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45356/0 (socket says 172.21.15.117:45356) 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a98eb640 1 -- 172.21.15.117:0/3610794165 learned_addr learned my addr 172.21.15.117:0/3610794165 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a98eb640 1 -- 172.21.15.117:0/3610794165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d82a727e0 con 0x562d82a71d80 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40e8150 tx=0x7fe7a40bcb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe68f7fe640 1 -- 172.21.15.117:0/3610794165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40b39c0 con 0x562d82a71d80 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d82a73040 con 0x562d82a71d80 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe68f7fe640 1 -- 172.21.15.117:0/3610794165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40b3b60 con 0x562d82a71d80 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe68f7fe640 1 -- 172.21.15.117:0/3610794165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40e92a0 con 0x562d82a71d80 2024-09-10T06:24:40.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.738+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d82a73040 con 0x562d82a71d80 2024-09-10T06:24:40.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68f7fe640 1 -- 172.21.15.117:0/3610794165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7a40e9440 con 0x562d82a71d80 2024-09-10T06:24:40.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68f7fe640 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 0x7fe68403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68f7fe640 1 -- 172.21.15.117:0/3610794165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe7a40dc070 con 0x562d82a71d80 2024-09-10T06:24:40.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 0x7fe68403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 0x7fe68403bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562d82a646c0 tx=0x7fe794006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d82a4d1d0 con 0x562d82a7e2f0 2024-09-10T06:24:40.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45372/0 (socket says 172.21.15.117:45372) 2024-09-10T06:24:40.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a98eb640 1 -- 172.21.15.117:0/2771522452 learned_addr learned my addr 172.21.15.117:0/2771522452 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a98eb640 1 -- 172.21.15.117:0/2771522452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d82a7eca0 con 0x562d82a7e2f0 2024-09-10T06:24:40.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/2771522452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40df4b0 tx=0x7fe7a40d3ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a0917896dd7bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68d7fa640 1 -- 172.21.15.117:0/2771522452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40e10d0 con 0x562d82a7e2f0 2024-09-10T06:24:40.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68d7fa640 1 -- 172.21.15.117:0/2771522452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40c1d30 con 0x562d82a7e2f0 2024-09-10T06:24:40.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe68d7fa640 1 -- 172.21.15.117:0/2771522452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40e1270 con 0x562d82a7e2f0 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- 172.21.15.117:0/2771522452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 msgr2=0x562d82a7e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/2771522452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40df4b0 tx=0x7fe7a40d3ad0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- 172.21.15.117:0/2771522452 shutdown_connections 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/2771522452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a7e6d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- 172.21.15.117:0/2771522452 >> 172.21.15.117:0/2771522452 conn(0x562d82a7a720 msgr2=0x562d82a78960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- 172.21.15.117:0/2771522452 shutdown_connections 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- 172.21.15.117:0/2771522452 wait complete. 2024-09-10T06:24:40.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 Processor -- start 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.742+0000 7fe7abde59c0 1 -- start start 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d82a7f180 con 0x562d82a7e2f0 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a98eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45388/0 (socket says 172.21.15.117:45388) 2024-09-10T06:24:40.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 learned_addr learned my addr 172.21.15.117:0/53668329 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d82a85b70 con 0x562d82a7e2f0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40df4b0 tx=0x7fe7a40c4f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 -- 172.21.15.117:0/53668329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a410c070 con 0x562d82a7e2f0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 -- 172.21.15.117:0/53668329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40c73b0 con 0x562d82a7e2f0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d82a85b70 con 0x562d82a7e2f0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 -- 172.21.15.117:0/53668329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7a40dfb00 con 0x562d82a7e2f0 2024-09-10T06:24:40.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d82a85b70 con 0x562d82a7e2f0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 -- 172.21.15.117:0/53668329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7a410f070 con 0x562d82a7e2f0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe674039ac0 0x7fe67403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe67b7fe640 1 -- 172.21.15.117:0/53668329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe7a4112c00 con 0x562d82a7e2f0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe674039ac0 0x7fe67403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d82a90610 0x562d82a92aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a931f0 con 0x562d82a90610 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.746+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d82a90610 0x562d82a92aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe674039ac0 0x7fe67403bf80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe79400fc20 tx=0x7fe794023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d82a90610 0x562d82a92aa0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d82a90610 2024-09-10T06:24:40.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 realm 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a93650 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a93f20 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d82a90610 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a94db0 0x562d82a971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a978e0 con 0x562d82a94db0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a94db0 0x562d82a971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a94db0 0x562d82a971a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 20 searching for the correct realm 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a99880 0x562d82a9bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9c3f0 con 0x562d82a99880 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a99880 0x562d82a9bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a90ea640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a99880 0x562d82a9bd20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9c3f0 con 0x562d82a94db0 2024-09-10T06:24:40.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe7a4111070 0x7fe7a40d5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9c3f0 con 0x7fe7a4111070 2024-09-10T06:24:40.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.750+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe7a4111070 0x7fe7a40d5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe7a4111070 0x7fe7a40d5660 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c0083f0 con 0x7fe7a4111070 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c0083f0 con 0x562d82a90610 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a94db0 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.754+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a94db0 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.758+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a94db0 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a94db0 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a99880 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x7fe7a4111070 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.762+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a90610 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d82a942c0 con 0x562d82a94db0 2024-09-10T06:24:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a981a0 con 0x562d82a90610 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a98590 con 0x562d82a90610 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a98590 con 0x562d82a99880 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 zone default found 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 4 Realm: () 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 zonegroup default 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9c870 con 0x7fe7a4111070 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9e260 con 0x562d82a99880 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9e600 con 0x562d82a99880 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 started sync module instance, tier type = 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:40.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.766+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9d700 con 0x562d82a94db0 2024-09-10T06:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753465686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9ef40 con 0x562d82a94db0 2024-09-10T06:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9f790 con 0x562d82a90610 2024-09-10T06:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753465686768] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753465690768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9f790 con 0x562d82a90610 2024-09-10T06:24:40.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.770+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa0210 con 0x562d82a99880 2024-09-10T06:24:40.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753465690768] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753465692896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9f700 con 0x562d82a99880 2024-09-10T06:24:40.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa0f60 con 0x562d82a94db0 2024-09-10T06:24:40.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753465701200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa1c20 con 0x562d82a94db0 2024-09-10T06:24:40.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa25e0 con 0x562d82a90610 2024-09-10T06:24:40.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.774+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753465692896] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753465701200] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753465702256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa1b90 con 0x562d82a90610 2024-09-10T06:24:40.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa2a90 con 0x7fe7a4111070 2024-09-10T06:24:40.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753465702256] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753465704752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa2a00 con 0x7fe7a4111070 2024-09-10T06:24:40.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.778+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa34a0 con 0x7fe7a4111070 2024-09-10T06:24:40.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753465708528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa38c0 con 0x7fe7a4111070 2024-09-10T06:24:40.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa42c0 con 0x7fe7a4111070 2024-09-10T06:24:40.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753465704752] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753465708528] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753465705808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa3410 con 0x7fe7a4111070 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=0 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=1 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=2 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=3 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=4 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=5 2024-09-10T06:24:40.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.782+0000 7fe7abde59c0 20 add_watcher() i=6 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753465705808] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 20 add_watcher() i=7 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa73c0 con 0x562d82a90610 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753465712080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa4840 con 0x562d82a90610 2024-09-10T06:24:40.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753465712080] v32'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe65b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:40.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:40.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:40.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 5 note: GC not initialized 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe65a7fc640 20 reqs_thread_entry: start 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe7abde59c0 20 Filter name: none 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.786+0000 7fe5cbfff640 20 reqs_thread_entry: start 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82aca2f0 con 0x562d82a90610 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:24:40.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d82acb840 con 0x7fe7a4111070 2024-09-10T06:24:40.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe65b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:40.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753465712080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa4390 con 0x562d82a90610 2024-09-10T06:24:40.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94753465712080] v32'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.790+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753465686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa3dd0 con 0x562d82a94db0 2024-09-10T06:24:40.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94753465686768] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7abde59c0 20 remove_watcher() i=0 2024-09-10T06:24:40.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7abde59c0 2 removed watcher, disabling cache 2024-09-10T06:24:40.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753465690768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa3dd0 con 0x562d82a90610 2024-09-10T06:24:40.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94753465690768] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7abde59c0 20 remove_watcher() i=1 2024-09-10T06:24:40.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.794+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753465692896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9ea90 con 0x562d82a99880 2024-09-10T06:24:40.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7a90ea640 1 -- 172.21.15.117:0/53668329 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94753465692896] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe794037040 con 0x562d82a99880 2024-09-10T06:24:40.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7abde59c0 20 remove_watcher() i=2 2024-09-10T06:24:40.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753465701200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa3dd0 con 0x562d82a94db0 2024-09-10T06:24:40.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7a98eb640 1 -- 172.21.15.117:0/53668329 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94753465701200] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7a4118070 con 0x562d82a94db0 2024-09-10T06:24:40.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7abde59c0 20 remove_watcher() i=3 2024-09-10T06:24:40.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.798+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753465702256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9f2e0 con 0x562d82a90610 2024-09-10T06:24:40.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94753465702256] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x562d82a90610 2024-09-10T06:24:40.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7abde59c0 20 remove_watcher() i=4 2024-09-10T06:24:40.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753465704752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa3dd0 con 0x7fe7a4111070 2024-09-10T06:24:40.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94753465704752] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7abde59c0 20 remove_watcher() i=5 2024-09-10T06:24:40.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.802+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753465708528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82a9f2e0 con 0x7fe7a4111070 2024-09-10T06:24:40.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94753465708528] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 20 remove_watcher() i=6 2024-09-10T06:24:40.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753465705808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d82aa2130 con 0x7fe7a4111070 2024-09-10T06:24:40.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94753465705808] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe79c026040 con 0x7fe7a4111070 2024-09-10T06:24:40.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 20 remove_watcher() i=7 2024-09-10T06:24:40.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe7a4111070 msgr2=0x7fe7a40d5660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fe7a4111070 0x7fe7a40d5660 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d82a90610 msgr2=0x562d82a92aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d82a90610 0x562d82a92aa0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a94db0 msgr2=0x562d82a971a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a94db0 0x562d82a971a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a99880 msgr2=0x562d82a9bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a99880 0x562d82a9bd20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe674039ac0 msgr2=0x7fe67403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe674039ac0 0x7fe67403bf80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe79400fc20 tx=0x7fe794023040 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/53668329 reap_dead start 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 msgr2=0x562d82a85610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40df4b0 tx=0x7fe7a40c4f60 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 shutdown_connections 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/53668329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a7e2f0 0x562d82a85610 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 >> 172.21.15.117:0/53668329 conn(0x562d82a7a720 msgr2=0x562d82a78930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 shutdown_connections 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/53668329 wait complete. 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 msgr2=0x7fe68403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 0x7fe68403bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x562d82a646c0 tx=0x7fe794006000 comp rx=0 tx=0).stop 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 msgr2=0x562d82a721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40e8150 tx=0x7fe7a40bcb60 comp rx=0 tx=0).stop 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 shutdown_connections 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe684039a70 0x7fe68403bf30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/3610794165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d82a71d80 0x562d82a721a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 >> 172.21.15.117:0/3610794165 conn(0x562d82a67730 msgr2=0x562d82a67b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 shutdown_connections 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.806+0000 7fe7abde59c0 1 -- 172.21.15.117:0/3610794165 wait complete. 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d828d3b50 msgr2=0x562d82a5b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562d828d3b50 0x562d82a5b0e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a5d860 msgr2=0x562d82a5fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562d82a5d860 0x562d82a5fc50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a61760 msgr2=0x562d82a63b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562d82a61760 0x562d82a63b50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe690039ac0 msgr2=0x7fe69003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe690039ac0 0x7fe69003bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b2e0 tx=0x7fe7940014f0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 msgr2=0x562d82a53f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 --2- 172.21.15.117:0/105469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d828d3770 0x562d82a53f70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40a4fd0 tx=0x7fe7a4017c00 comp rx=0 tx=0).stop 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7aa0ec640 1 -- 172.21.15.117:0/105469385 reap_dead start 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 shutdown_connections 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 >> 172.21.15.117:0/105469385 conn(0x562d82959e90 msgr2=0x562d82a47110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 shutdown_connections 2024-09-10T06:24:40.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.810+0000 7fe7abde59c0 1 -- 172.21.15.117:0/105469385 wait complete. 2024-09-10T06:24:40.822 INFO:teuthology.orchestra.run.smithi117.stdout:{"entries":[],"summary":[]} 2024-09-10T06:24:40.822 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T06:24:40.822 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T06:24:40.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T06:24:40.822 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-10T06:24:40.897 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:40.897 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:40.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.894+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.894+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.894+0000 7fa5281ee9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563bf49fe880 0x563bf4a00c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.894+0000 7fa5281ee9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563bf48ae9c0 con 0x563bf496e7b0 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.894+0000 7fa5281ee9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x563bf48fe6d0 con 0x563bf49fe880 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa5254f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563bf49fe880 0x563bf4a00c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa525cf4640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x563bf496e7b0 0x563bf49fd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54332/0 (socket says 172.21.15.117:54332) 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa5254f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563bf49fe880 0x563bf4a00c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45404/0 (socket says 172.21.15.117:45404) 2024-09-10T06:24:40.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa525cf4640 1 -- 172.21.15.117:0/4105146319 learned_addr learned my addr 172.21.15.117:0/4105146319 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa5254f3640 1 -- 172.21.15.117:0/4105146319 >> v1:172.21.15.84:6789/0 conn(0x563bf496e7b0 legacy=0x563bf49fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa5254f3640 1 -- 172.21.15.117:0/4105146319 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf48a2ca0 con 0x563bf49fe880 2024-09-10T06:24:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa5254f3640 1 --2- 172.21.15.117:0/4105146319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf49fe880 0x563bf4a00c70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00a420 tx=0x7fa51c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e2412f68c3e244 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa524cf2640 1 -- 172.21.15.117:0/4105146319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51c0b0070 con 0x563bf49fe880 2024-09-10T06:24:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa524cf2640 1 -- 172.21.15.117:0/4105146319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c0a3dc0 con 0x563bf49fe880 2024-09-10T06:24:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.898+0000 7fa524cf2640 1 -- 172.21.15.117:0/4105146319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51c0ab570 con 0x563bf49fe880 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4105146319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf49fe880 msgr2=0x563bf4a00c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4105146319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf49fe880 0x563bf4a00c70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00a420 tx=0x7fa51c01afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4105146319 shutdown_connections 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4105146319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf49fe880 0x563bf4a00c70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4105146319 >> 172.21.15.117:0/4105146319 conn(0x563bf49f4e90 msgr2=0x563bf49f72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4105146319 shutdown_connections 2024-09-10T06:24:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.902+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4105146319 wait complete. 2024-09-10T06:24:40.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563bf4902680 con 0x563bf496e7b0 2024-09-10T06:24:40.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45412/0 (socket says 172.21.15.117:45412) 2024-09-10T06:24:40.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa525cf4640 1 -- 172.21.15.117:0/1629797695 learned_addr learned my addr 172.21.15.117:0/1629797695 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa525cf4640 1 -- 172.21.15.117:0/1629797695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf487dda0 con 0x563bf496e7b0 2024-09-10T06:24:40.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa525cf4640 1 --2- 172.21.15.117:0/1629797695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa518001e50 tx=0x7fa518001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5174714a21a2f78a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa413e07640 1 -- 172.21.15.117:0/1629797695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa518012020 con 0x563bf496e7b0 2024-09-10T06:24:40.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa413e07640 1 -- 172.21.15.117:0/1629797695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51800e7c0 con 0x563bf496e7b0 2024-09-10T06:24:40.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa413e07640 1 -- 172.21.15.117:0/1629797695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51800eaa0 con 0x563bf496e7b0 2024-09-10T06:24:40.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/1629797695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 msgr2=0x563bf4ae5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/1629797695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa518001e50 tx=0x7fa518001e80 comp rx=0 tx=0).stop 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/1629797695 shutdown_connections 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/1629797695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4ae5910 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/1629797695 >> 172.21.15.117:0/1629797695 conn(0x563bf49f4e90 msgr2=0x563bf4ae15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/1629797695 shutdown_connections 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/1629797695 wait complete. 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4aecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.918+0000 7fa5281ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563bf48a4a50 con 0x563bf496e7b0 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4aecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4aecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45414/0 (socket says 172.21.15.117:45414) 2024-09-10T06:24:40.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa525cf4640 1 -- 172.21.15.117:0/2381812046 learned_addr learned my addr 172.21.15.117:0/2381812046 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa525cf4640 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf4aed510 con 0x563bf496e7b0 2024-09-10T06:24:40.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa525cf4640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4aecfb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x563bf4ae6900 tx=0x7fa518000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 -- 172.21.15.117:0/2381812046 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa518012030 con 0x563bf496e7b0 2024-09-10T06:24:40.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bf4aed7a0 con 0x563bf496e7b0 2024-09-10T06:24:40.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 -- 172.21.15.117:0/2381812046 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51801a680 con 0x563bf496e7b0 2024-09-10T06:24:40.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 -- 172.21.15.117:0/2381812046 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51801a980 con 0x563bf496e7b0 2024-09-10T06:24:40.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bf4aee150 con 0x563bf496e7b0 2024-09-10T06:24:40.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 -- 172.21.15.117:0/2381812046 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa518015020 con 0x563bf496e7b0 2024-09-10T06:24:40.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa40c039a70 0x7fa40c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa412604640 1 -- 172.21.15.117:0/2381812046 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa518020070 con 0x563bf496e7b0 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5254f3640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa40c039a70 0x7fa40c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf49fe880 0x563bf4af4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4af4660 con 0x563bf49fe880 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5264f5640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf49fe880 0x563bf4af4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5254f3640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa40c039a70 0x7fa40c03bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0ad000 tx=0x7fa51c0a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5264f5640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf49fe880 0x563bf4af4120 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.922+0000 7fa5264f5640 1 -- 172.21.15.117:0/2381812046 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf49fe880 2024-09-10T06:24:40.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4aee490 con 0x563bf49fe880 2024-09-10T06:24:40.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5264f5640 1 -- 172.21.15.117:0/2381812046 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf49fe880 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4af68d0 0x563bf4af8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4af93b0 con 0x563bf4af68d0 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4af68d0 0x563bf4af8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4af68d0 0x563bf4af8cc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 -- 172.21.15.117:0/2381812046 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa518008030 con 0x563bf4af68d0 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4af5770 con 0x563bf49fe880 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5264f5640 1 -- 172.21.15.117:0/2381812046 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf49fe880 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4afa810 0x563bf4afcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4afd340 con 0x563bf4afa810 2024-09-10T06:24:40.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5254f3640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4afa810 0x563bf4afcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5254f3640 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4afa810 0x563bf4afcc00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5254f3640 1 -- 172.21.15.117:0/2381812046 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa51c0aba70 con 0x563bf4afa810 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa5281ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563bf490f450 con 0x563bf4b0ae00 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45416/0 (socket says 172.21.15.117:45416) 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.926+0000 7fa525cf4640 1 -- 172.21.15.117:0/4063488692 learned_addr learned my addr 172.21.15.117:0/4063488692 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 -- 172.21.15.117:0/4063488692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf4b0b860 con 0x563bf4b0ae00 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa51804ecf0 tx=0x7fa5180186d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 -- 172.21.15.117:0/4063488692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51801ad30 con 0x563bf4b0ae00 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 -- 172.21.15.117:0/4063488692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51802cb80 con 0x563bf4b0ae00 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bf4b0c0c0 con 0x563bf4b0ae00 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 -- 172.21.15.117:0/4063488692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51802cd70 con 0x563bf4b0ae00 2024-09-10T06:24:40.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bf4b0c0c0 con 0x563bf4b0ae00 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 -- 172.21.15.117:0/4063488692 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa518049040 con 0x563bf4b0ae00 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 0x7fa40003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa40b7fe640 1 -- 172.21.15.117:0/4063488692 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa518005050 con 0x563bf4b0ae00 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5254f3640 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 0x7fa40003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5254f3640 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 0x7fa40003bf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x563bf4af4aa0 tx=0x7fa51c005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa5281ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563bf4ae6160 con 0x563bf4b18420 2024-09-10T06:24:40.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45424/0 (socket says 172.21.15.117:45424) 2024-09-10T06:24:40.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 -- 172.21.15.117:0/568758863 learned_addr learned my addr 172.21.15.117:0/568758863 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.930+0000 7fa525cf4640 1 -- 172.21.15.117:0/568758863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf4b18dd0 con 0x563bf4b18420 2024-09-10T06:24:40.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 --2- 172.21.15.117:0/568758863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa518024040 tx=0x7fa518024b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95687d25a87cc3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa4097fa640 1 -- 172.21.15.117:0/568758863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51805f020 con 0x563bf4b18420 2024-09-10T06:24:40.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa4097fa640 1 -- 172.21.15.117:0/568758863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa518016ce0 con 0x563bf4b18420 2024-09-10T06:24:40.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa4097fa640 1 -- 172.21.15.117:0/568758863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51801bcd0 con 0x563bf4b18420 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/568758863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 msgr2=0x563bf4b18800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/568758863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa518024040 tx=0x7fa518024b00 comp rx=0 tx=0).stop 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/568758863 shutdown_connections 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/568758863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b18800 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/568758863 >> 172.21.15.117:0/568758863 conn(0x563bf4b137e0 msgr2=0x563bf4b11a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/568758863 shutdown_connections 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/568758863 wait complete. 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 Processor -- start 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- start start 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563bf4b17190 con 0x563bf4b18420 2024-09-10T06:24:40.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45430/0 (socket says 172.21.15.117:45430) 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 learned_addr learned my addr 172.21.15.117:0/322915300 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf4b1ebd0 con 0x563bf4b18420 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa525cf4640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa518024040 tx=0x7fa518045f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa3f77fe640 1 -- 172.21.15.117:0/322915300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa518069070 con 0x563bf4b18420 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa3f77fe640 1 -- 172.21.15.117:0/322915300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51802fcb0 con 0x563bf4b18420 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa3f77fe640 1 -- 172.21.15.117:0/322915300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51805f070 con 0x563bf4b18420 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bf4b1ebd0 con 0x563bf4b18420 2024-09-10T06:24:40.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.934+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bf4b1ebd0 con 0x563bf4b18420 2024-09-10T06:24:40.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa3f77fe640 1 -- 172.21.15.117:0/322915300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa518009070 con 0x563bf4b18420 2024-09-10T06:24:40.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa3f77fe640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3f0039ac0 0x7fa3f003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa3f77fe640 1 -- 172.21.15.117:0/322915300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa518057040 con 0x563bf4b18420 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5254f3640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3f0039ac0 0x7fa3f003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf4b29870 0x563bf4b2bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2c450 con 0x563bf4b29870 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf4b29870 0x563bf4b2bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5254f3640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3f0039ac0 0x7fa3f003bf80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0ae040 tx=0x7fa51c0b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf4b29870 0x563bf4b2bd00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf4b29870 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 realm 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2c860 con 0x563bf4b29870 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf4b29870 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d130 con 0x563bf4b29870 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf4b29870 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf4b29870 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4b2e230 0x563bf4b30620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b30bf0 con 0x563bf4b2e230 2024-09-10T06:24:40.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa525cf4640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4b2e230 0x563bf4b30620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.938+0000 7fa525cf4640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4b2e230 0x563bf4b30620 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5281ee9c0 20 searching for the correct realm 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4b32b40 0x563bf4b34f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b355f0 con 0x563bf4b32b40 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5254f3640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4b32b40 0x563bf4b34f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5254f3640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4b32b40 0x563bf4b34f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b355f0 con 0x563bf4b2e230 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa525cf4640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa518017050 0x7fa518040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:40.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b355f0 con 0x7fa518017050 2024-09-10T06:24:40.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa518017050 0x7fa518040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:40.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa518017050 0x7fa518040150 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:40.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5200083f0 con 0x7fa518017050 2024-09-10T06:24:40.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5200083f0 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.942+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b2e230 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b2e230 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.946+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b2e230 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.950+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b2e230 2024-09-10T06:24:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b32b40 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x7fa518017050 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b29870 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b2d4d0 con 0x563bf4b2e230 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b314b0 con 0x563bf4b29870 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b318a0 con 0x563bf4b29870 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b318a0 con 0x563bf4b32b40 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 zone default found 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 4 Realm: () 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 zonegroup default 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.954+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b35a70 con 0x7fa518017050 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b37560 con 0x563bf4b32b40 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b37970 con 0x563bf4b32b40 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 started sync module instance, tier type = 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b36900 con 0x563bf4b2e230 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94815508458736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b38260 con 0x563bf4b2e230 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b38ab0 con 0x563bf4b29870 2024-09-10T06:24:40.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.958+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94815508458736] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94815508463024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b38ab0 con 0x563bf4b29870 2024-09-10T06:24:40.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b39570 con 0x563bf4b32b40 2024-09-10T06:24:40.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94815508467872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b39e40 con 0x563bf4b32b40 2024-09-10T06:24:40.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3a840 con 0x563bf4b2e230 2024-09-10T06:24:40.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.962+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94815508463024] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94815508465152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3b0e0 con 0x563bf4b2e230 2024-09-10T06:24:40.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3b930 con 0x563bf4b29870 2024-09-10T06:24:40.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94815508467872] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94815508465152] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94815508474928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3b500 con 0x563bf4b29870 2024-09-10T06:24:40.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.966+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3c1d0 con 0x7fa518017050 2024-09-10T06:24:40.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94815508474928] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94815508475984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3b470 con 0x7fa518017050 2024-09-10T06:24:40.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3c6d0 con 0x7fa518017050 2024-09-10T06:24:40.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94815508475984] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94815508480480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3c6d0 con 0x7fa518017050 2024-09-10T06:24:40.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.970+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3d0d0 con 0x7fa518017050 2024-09-10T06:24:40.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94815508480480] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94815508478832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3d090 con 0x7fa518017050 2024-09-10T06:24:40.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=0 2024-09-10T06:24:40.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=1 2024-09-10T06:24:40.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=2 2024-09-10T06:24:40.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=3 2024-09-10T06:24:40.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=4 2024-09-10T06:24:40.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=5 2024-09-10T06:24:40.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=6 2024-09-10T06:24:40.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94815508478832] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 20 add_watcher() i=7 2024-09-10T06:24:40.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:40.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b404f0 con 0x563bf4b29870 2024-09-10T06:24:40.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.974+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94815508483504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3da10 con 0x563bf4b29870 2024-09-10T06:24:40.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94815508483504] v32'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa3d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:40.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5281ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:40.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5281ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:40.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b48e70 con 0x563bf4b29870 2024-09-10T06:24:40.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.978+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b48e70 con 0x7fa518017050 2024-09-10T06:24:40.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b49930 con 0x563bf4b32b40 2024-09-10T06:24:40.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4a350 con 0x563bf4b29870 2024-09-10T06:24:40.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'234 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.982+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x563bf4b2e230 2024-09-10T06:24:40.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.986+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.986+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x563bf4b32b40 2024-09-10T06:24:40.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.986+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.986+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x563bf4b29870 2024-09-10T06:24:40.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.990+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:40.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.990+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x7fa518017050 2024-09-10T06:24:40.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.990+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:40.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.990+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x563bf4b2e230 2024-09-10T06:24:40.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b47560 con 0x563bf4b32b40 2024-09-10T06:24:40.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:40.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x563bf4b2e230 2024-09-10T06:24:40.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:40.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.994+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x7fa518017050 2024-09-10T06:24:40.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.998+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.998+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x563bf4b2e230 2024-09-10T06:24:41.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.998+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:40.998+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x7fa518017050 2024-09-10T06:24:41.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x563bf4b29870 2024-09-10T06:24:41.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'235 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b400 con 0x563bf4b32b40 2024-09-10T06:24:41.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.002+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b2e230 2024-09-10T06:24:41.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.006+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.006+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.006+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.006+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b29870 2024-09-10T06:24:41.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b29870 2024-09-10T06:24:41.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'236 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.010+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b2e230 2024-09-10T06:24:41.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.014+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.018+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.018+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.018+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.018+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x7fa518017050 2024-09-10T06:24:41.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x7fa518017050 2024-09-10T06:24:41.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.022+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b32b40 2024-09-10T06:24:41.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.026+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.026+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x7fa518017050 2024-09-10T06:24:41.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.026+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.026+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b4b6e0 con 0x563bf4b2e230 2024-09-10T06:24:41.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa3d67fc640 20 reqs_thread_entry: start 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 Filter name: none 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa347fff640 20 reqs_thread_entry: start 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b46960 con 0x563bf4b29870 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T06:24:41.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:41.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b69390 con 0x563bf4b2e230 2024-09-10T06:24:41.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 : miss 2024-09-10T06:24:41.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:96 8.3 8:c4a81246:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68f30 con 0x563bf4b29870 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(96 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv10 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 info.flags=0x17 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 to cache LRU end 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 2024-09-10T06:24:41.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.030+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:97 4.a 4:51de201c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b2e230 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(97 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:98 4.1b 4:dbc197e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b2e230 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(98 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa518061040 con 0x563bf4b2e230 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 4.19 4:981638e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b32b40 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(99 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:100 4.f 4:f2cc4db1:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b29870 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(100 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:101 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b29870 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(101 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 4.5 4:a07be08e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b32b40 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(102 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 4.2f 4:f6573b02:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b29870 2024-09-10T06:24:41.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(103 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:104 4.1c 4:388bce0b:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x7fa518017050 2024-09-10T06:24:41.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(104 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 4.f 4:f08a07ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b29870 2024-09-10T06:24:41.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(105 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:106 4.2f 4:f5a91d69:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be64f0 con 0x563bf4b29870 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(106 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.034+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:107 4.30 4:0d21bccc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be6470 con 0x563bf4b32b40 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(107 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 20 get_obj_state: octx=0x7fa518021d80 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x563bf4be4578 s->prefetch_data=0 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 3.2a 3:576c1b9a:::be621638-e902-4133-b94d-0397be1b6a7c.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be53a0 con 0x563bf4b29870 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(108 be621638-e902-4133-b94d-0397be1b6a7c.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 10 manifest: total_size = 6 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 20 get_obj_state: setting s->obj_tag to be621638-e902-4133-b94d-0397be1b6a7c.4227.10947344342567741447 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 20 get_obj_state: octx=0x7fa518021d80 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x563bf4be4578 s->prefetch_data=0 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 20 prepare_atomic_modification: state is not atomic. state=0x563bf4be4578 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 20 bucket index object: :.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:109 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6d630 con 0x563bf4b29870 2024-09-10T06:24:41.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(109 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.038+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:110 3.2a 3:576c1b9a:::be621638-e902-4133-b94d-0397be1b6a7c.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6b610 con 0x563bf4b29870 2024-09-10T06:24:41.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(110 be621638-e902-4133-b94d-0397be1b6a7c.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:111 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6d630 con 0x563bf4b29870 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 20 list_objects_ordered: starting attempt 1 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:112 4.a 4:51de201c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6d630 con 0x563bf4b2e230 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:113 4.1b 4:dbc197e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b720c0 con 0x563bf4b2e230 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:114 4.19 4:981638e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b749e0 con 0x563bf4b32b40 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:115 4.f 4:f2cc4db1:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6d630 con 0x563bf4b29870 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:116 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b79a00 con 0x563bf4b29870 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:117 4.5 4:a07be08e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b7c2f0 con 0x563bf4b32b40 2024-09-10T06:24:41.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(114 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:118 4.2f 4:f6573b02:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b79a00 con 0x563bf4b29870 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:119 4.1c 4:388bce0b:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b7c2f0 con 0x7fa518017050 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:120 4.f 4:f08a07ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b810d0 con 0x563bf4b29870 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:121 4.2f 4:f5a91d69:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b83a70 con 0x563bf4b29870 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(112 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(113 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(117 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:122 4.30 4:0d21bccc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be4460 con 0x563bf4b32b40 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.078+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(115 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(119 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x7fa518017050 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(120 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(118 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(111 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa4097fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(122 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(121 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(116 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa520026040 con 0x563bf4b29870 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T06:24:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[be621638-e902-4133-b94d-0397be1b6a7c.4227.7])"; uploads.size()=0; is_truncated=0 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:123 4.a 4:51de201c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b83a70 con 0x563bf4b2e230 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:124 4.1b 4:dbc197e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b2e230 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:125 4.19 4:981638e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b74530 con 0x563bf4b32b40 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:126 4.f 4:f2cc4db1:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be4350 con 0x563bf4b29870 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:127 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b83a70 con 0x563bf4b29870 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:128 4.5 4:a07be08e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b74530 con 0x563bf4b32b40 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:129 4.2f 4:f6573b02:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b29870 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:130 4.1c 4:388bce0b:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b7fea0 con 0x7fa518017050 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:131 4.f 4:f08a07ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4be4350 con 0x563bf4b29870 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:132 4.2f 4:f5a91d69:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b80c80 con 0x563bf4b29870 2024-09-10T06:24:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:133 4.30 4:0d21bccc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b32b40 2024-09-10T06:24:41.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(123 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(125 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(128 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(126 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(133 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(124 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(130 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(127 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(129 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(132 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(131 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.082+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b2e230 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(134 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b2e230 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T06:24:41.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T06:24:41.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.086+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b2e230 2024-09-10T06:24:41.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(136 myfoo [call,call,delete] v32'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5281ee9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T06:24:41.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T06:24:41.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94815508761728 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x7fa518017050 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== watch-notify(notify (1) cookie 94815508480480 notify 137438953513 ret 0) ==== 191+0+0 (crc 0 0 0) 0x563bf4b68540 con 0x7fa518017050 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94815508480480 notifier 4778 bl.length()=149 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(137 notify.6 [notify cookie 94815508761728 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa408ff9640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3500032d0 con 0x7fa518017050 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== watch-notify(notify_complete (2) cookie 94815508761728 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563bf4b49480 con 0x7fa518017050 2024-09-10T06:24:41.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.090+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:139 8.3 8:c4a81246:root::.bucket.meta.myfoo%3abe621638-e902-4133-b94d-0397be1b6a7c.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b29870 2024-09-10T06:24:41.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 49 ==== osd_op_reply(139 .bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 [call,call,delete] v32'13 uv13 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7 from cache 2024-09-10T06:24:41.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:be621638-e902-4133-b94d-0397be1b6a7c.4227.7, ofs0, ns] 2024-09-10T06:24:41.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94815509170464 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x7fa518017050 2024-09-10T06:24:41.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== watch-notify(notify (1) cookie 94815508475984 notify 137438953514 ret 0) ==== 248+0+0 (crc 0 0 0) 0x563bf4b49480 con 0x7fa518017050 2024-09-10T06:24:41.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa4097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94815508475984 notifier 4778 bl.length()=206 2024-09-10T06:24:41.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(140 notify.5 [notify cookie 94815509170464 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa4097fa640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3e8003d70 con 0x7fa518017050 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== watch-notify(notify_complete (2) cookie 94815509170464 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563bf4b42900 con 0x7fa518017050 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:142 4.a 4:51de201c:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b2e230 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:143 4.1b 4:dbc197e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x563bf4b2e230 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:144 4.19 4:981638e8:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67e40 con 0x563bf4b32b40 2024-09-10T06:24:41.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:145 4.f 4:f2cc4db1:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b29870 2024-09-10T06:24:41.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:146 4.12 4:4a6489ad:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x563bf4b29870 2024-09-10T06:24:41.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:147 4.5 4:a07be08e:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b73300 con 0x563bf4b32b40 2024-09-10T06:24:41.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.094+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:148 4.2f 4:f6573b02:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67e40 con 0x563bf4b29870 2024-09-10T06:24:41.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:149 4.1c 4:388bce0b:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x7fa518017050 2024-09-10T06:24:41.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:150 4.f 4:f08a07ef:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b29870 2024-09-10T06:24:41.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 4.2f 4:f5a91d69:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b73300 con 0x563bf4b29870 2024-09-10T06:24:41.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:152 4.30 4:0d21bccc:::.dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67e40 con 0x563bf4b32b40 2024-09-10T06:24:41.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(144 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.2 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(143 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.1 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(142 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.098+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 50 ==== osd_op_reply(146 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.4 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(149 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(147 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 51 ==== osd_op_reply(145 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.3 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(152 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.10 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 52 ==== osd_op_reply(148 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.6 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 53 ==== osd_op_reply(150 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 54 ==== osd_op_reply(151 .dir.be621638-e902-4133-b94d-0397be1b6a7c.4227.7.9 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.7 : miss 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:153 6.c 6:3550be3a:::pubsub..bucket.myfoo%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x563bf4b32b40 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(153 pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.7 info.flags=0x0 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 10 adding default.rgw.log++pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.7 to cache LRU end 2024-09-10T06:24:41.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.102+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:154 6.c 6:3550be3a:::pubsub..bucket.myfoo%2fbe621638-e902-4133-b94d-0397be1b6a7c.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x563bf4b32b40 2024-09-10T06:24:41.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.106+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(154 pubsub..bucket.myfoo/be621638-e902-4133-b94d-0397be1b6a7c.4227.7 [delete] v32'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.106+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b67530 con 0x563bf4b2e230 2024-09-10T06:24:41.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.106+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(155 foo.buckets [call] v32'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.106+0000 7fa5281ee9c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-10T06:24:41.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.106+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x7fa518017050 2024-09-10T06:24:41.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T06:24:41.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94815509170464 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b2e230 2024-09-10T06:24:41.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== watch-notify(notify (1) cookie 94815508465152 notify 137438953501 ret 0) ==== 212+0+0 (crc 0 0 0) 0x563bf4b470b0 con 0x563bf4b2e230 2024-09-10T06:24:41.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94815508465152 notifier 4778 bl.length()=170 2024-09-10T06:24:41.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(157 notify.3 [notify cookie 94815509170464 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa408ff9640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3500032b0 con 0x563bf4b2e230 2024-09-10T06:24:41.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== watch-notify(notify_complete (2) cookie 94815509170464 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa51807e020 con 0x563bf4b2e230 2024-09-10T06:24:41.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa51808c070 con 0x563bf4b2e230 2024-09-10T06:24:41.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa5281ee9c0 10 removing email index: foo@foo.com 2024-09-10T06:24:41.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.110+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b6dfa0 con 0x563bf4b29870 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 55 ==== osd_op_reply(159 foo@foo.com [delete] v32'14 uv14 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94815509170464 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b2e230 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== watch-notify(notify (1) cookie 94815508465152 notify 137438953502 ret 0) ==== 204+0+0 (crc 0 0 0) 0x7fa51807e020 con 0x563bf4b2e230 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94815508465152 notifier 4778 bl.length()=162 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(160 notify.3 [notify cookie 94815509170464 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa518094020 con 0x563bf4b2e230 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa408ff9640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3500032b0 con 0x563bf4b2e230 2024-09-10T06:24:41.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== watch-notify(notify_complete (2) cookie 94815509170464 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa518041e30 con 0x563bf4b2e230 2024-09-10T06:24:41.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518094020 con 0x563bf4b2e230 2024-09-10T06:24:41.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa5281ee9c0 10 removing user buckets index 2024-09-10T06:24:41.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.114+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b2e230 2024-09-10T06:24:41.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(162 foo.buckets [delete] v32'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa518094020 con 0x563bf4b2e230 2024-09-10T06:24:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-10T06:24:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94815509172144 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x7fa518017050 2024-09-10T06:24:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== watch-notify(notify (1) cookie 94815508475984 notify 137438953515 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563bf4b42900 con 0x7fa518017050 2024-09-10T06:24:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa4097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94815508475984 notifier 4778 bl.length()=160 2024-09-10T06:24:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(163 notify.5 [notify cookie 94815509172144 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa4097fa640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3e8003d70 con 0x7fa518017050 2024-09-10T06:24:41.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== watch-notify(notify_complete (2) cookie 94815509172144 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563bf4b426f0 con 0x7fa518017050 2024-09-10T06:24:41.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.118+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5281ee9c0 10 removing user index: foo 2024-09-10T06:24:41.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b29870 2024-09-10T06:24:41.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 56 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5281ee9c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-10T06:24:41.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5281ee9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T06:24:41.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94815509172144 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b29870 2024-09-10T06:24:41.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 57 ==== watch-notify(notify (1) cookie 94815508474928 notify 137438953494 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563bf4b426f0 con 0x563bf4b29870 2024-09-10T06:24:41.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa4097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94815508474928 notifier 4778 bl.length()=152 2024-09-10T06:24:41.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa4097fa640 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa3e8003d70 con 0x563bf4b29870 2024-09-10T06:24:41.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.122+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 58 ==== osd_op_reply(166 notify.4 [notify cookie 94815509172144 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.126+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 59 ==== watch-notify(notify_complete (2) cookie 94815509172144 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563bf4b49210 con 0x563bf4b29870 2024-09-10T06:24:41.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.126+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 60 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.126+0000 7fa3d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:41.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.126+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94815508483504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b29870 2024-09-10T06:24:41.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 61 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94815508483504] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94815508458736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b68ea0 con 0x563bf4b2e230 2024-09-10T06:24:41.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 41 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94815508458736] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518094020 con 0x563bf4b2e230 2024-09-10T06:24:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa5281ee9c0 20 remove_watcher() i=0 2024-09-10T06:24:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa5281ee9c0 2 removed watcher, disabling cache 2024-09-10T06:24:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.130+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94815508463024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b36cf0 con 0x563bf4b29870 2024-09-10T06:24:41.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 62 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94815508463024] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5281ee9c0 20 remove_watcher() i=1 2024-09-10T06:24:41.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94815508467872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b36cf0 con 0x563bf4b32b40 2024-09-10T06:24:41.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5254f3640 1 -- 172.21.15.117:0/322915300 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94815508467872] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa51c0c9070 con 0x563bf4b32b40 2024-09-10T06:24:41.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5281ee9c0 20 remove_watcher() i=2 2024-09-10T06:24:41.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.134+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94815508465152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b390a0 con 0x563bf4b2e230 2024-09-10T06:24:41.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.138+0000 7fa525cf4640 1 -- 172.21.15.117:0/322915300 <== osd.2 v2:172.21.15.117:6816/4244172515 42 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94815508465152] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa518094020 con 0x563bf4b2e230 2024-09-10T06:24:41.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.138+0000 7fa5281ee9c0 20 remove_watcher() i=3 2024-09-10T06:24:41.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.138+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94815508474928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b36cf0 con 0x563bf4b29870 2024-09-10T06:24:41.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.1 v2:172.21.15.117:6800/2871996333 63 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94815508474928] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x563bf4b29870 2024-09-10T06:24:41.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5281ee9c0 20 remove_watcher() i=4 2024-09-10T06:24:41.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94815508475984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b38600 con 0x7fa518017050 2024-09-10T06:24:41.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94815508475984] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5281ee9c0 20 remove_watcher() i=5 2024-09-10T06:24:41.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.142+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94815508480480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b390a0 con 0x7fa518017050 2024-09-10T06:24:41.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94815508480480] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 20 remove_watcher() i=6 2024-09-10T06:24:41.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94815508478832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563bf4b3c1e0 con 0x7fa518017050 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94815508478832] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa520052040 con 0x7fa518017050 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 20 remove_watcher() i=7 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa518017050 msgr2=0x7fa518040150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fa518017050 0x7fa518040150 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf4b29870 msgr2=0x563bf4b2bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf4b29870 0x563bf4b2bd00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4b2e230 msgr2=0x563bf4b30620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4b2e230 0x563bf4b30620 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4b32b40 msgr2=0x563bf4b34f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4b32b40 0x563bf4b34f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3f0039ac0 msgr2=0x7fa3f003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa3f0039ac0 0x7fa3f003bf80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0ae040 tx=0x7fa51c0b8040 comp rx=0 tx=0).stop 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 msgr2=0x563bf4b1e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5264f5640 1 -- 172.21.15.117:0/322915300 reap_dead start 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.146+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa518024040 tx=0x7fa518045f00 comp rx=0 tx=0).stop 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 shutdown_connections 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/322915300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b18420 0x563bf4b1e670 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 >> 172.21.15.117:0/322915300 conn(0x563bf4b137e0 msgr2=0x563bf4b119f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 shutdown_connections 2024-09-10T06:24:41.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/322915300 wait complete. 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 msgr2=0x7fa40003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 0x7fa40003bf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x563bf4af4aa0 tx=0x7fa51c005d90 comp rx=0 tx=0).stop 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 msgr2=0x563bf4b0b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa51804ecf0 tx=0x7fa5180186d0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 shutdown_connections 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa400039ac0 0x7fa40003bf80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/4063488692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf4b0ae00 0x563bf4b0b220 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 >> 172.21.15.117:0/4063488692 conn(0x563bf4b007b0 msgr2=0x563bf4b00b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 shutdown_connections 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/4063488692 wait complete. 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf49fe880 msgr2=0x563bf4af4120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563bf49fe880 0x563bf4af4120 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4af68d0 msgr2=0x563bf4af8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563bf4af68d0 0x563bf4af8cc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4afa810 msgr2=0x563bf4afcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563bf4afa810 0x563bf4afcc00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa40c039a70 msgr2=0x7fa40c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fa40c039a70 0x7fa40c03bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0ad000 tx=0x7fa51c0a5070 comp rx=0 tx=0).stop 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 msgr2=0x563bf4aecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 --2- 172.21.15.117:0/2381812046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563bf496e7b0 0x563bf4aecfb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x563bf4ae6900 tx=0x7fa518000ee0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5264f5640 1 -- 172.21.15.117:0/2381812046 reap_dead start 2024-09-10T06:24:41.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 shutdown_connections 2024-09-10T06:24:41.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 >> 172.21.15.117:0/2381812046 conn(0x563bf49f4e90 msgr2=0x563bf4ae0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 shutdown_connections 2024-09-10T06:24:41.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.150+0000 7fa5281ee9c0 1 -- 172.21.15.117:0/2381812046 wait complete. 2024-09-10T06:24:41.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T06:24:41.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T06:24:41.169 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T06:24:41.252 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.252 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e371c99c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55da68428560 0x55da6842a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e371c99c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da682d99c0 con 0x55da68424370 2024-09-10T06:24:41.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e371c99c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55da683296d0 con 0x55da68428560 2024-09-10T06:24:41.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e344ce640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55da68428560 0x55da6842a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e34ccf640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55da68424370 0x55da68424750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54348/0 (socket says 172.21.15.117:54348) 2024-09-10T06:24:41.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e34ccf640 1 -- 172.21.15.117:0/4249639368 learned_addr learned my addr 172.21.15.117:0/4249639368 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e344ce640 1 -- 172.21.15.117:0/4249639368 >> v1:172.21.15.84:6789/0 conn(0x55da68424370 legacy=0x55da68424750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.250+0000 7f8e344ce640 1 -- 172.21.15.117:0/4249639368 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da682cdca0 con 0x55da68428560 2024-09-10T06:24:41.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e344ce640 1 --2- 172.21.15.117:0/4249639368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68428560 0x55da6842a950 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00a480 tx=0x7f8e1c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef9e4303401dd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e33ccd640 1 -- 172.21.15.117:0/4249639368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c0aa570 con 0x55da68428560 2024-09-10T06:24:41.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e33ccd640 1 -- 172.21.15.117:0/4249639368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0af070 con 0x55da68428560 2024-09-10T06:24:41.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e33ccd640 1 -- 172.21.15.117:0/4249639368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c0aa860 con 0x55da68428560 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 -- 172.21.15.117:0/4249639368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68428560 msgr2=0x55da6842a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/4249639368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68428560 0x55da6842a950 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00a480 tx=0x7f8e1c01b310 comp rx=0 tx=0).stop 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 -- 172.21.15.117:0/4249639368 shutdown_connections 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/4249639368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68428560 0x55da6842a950 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 -- 172.21.15.117:0/4249639368 >> 172.21.15.117:0/4249639368 conn(0x55da6841fe90 msgr2=0x55da684222b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 -- 172.21.15.117:0/4249639368 shutdown_connections 2024-09-10T06:24:41.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.254+0000 7f8e371c99c0 1 -- 172.21.15.117:0/4249639368 wait complete. 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.270+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.270+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.270+0000 7f8e371c99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.270+0000 7f8e371c99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da6832d680 con 0x55da68424370 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45444/0 (socket says 172.21.15.117:45444) 2024-09-10T06:24:41.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 -- 172.21.15.117:0/1199753658 learned_addr learned my addr 172.21.15.117:0/1199753658 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 -- 172.21.15.117:0/1199753658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da682a8da0 con 0x55da68424370 2024-09-10T06:24:41.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/1199753658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8e24001810 tx=0x7f8e24001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830bbb1ce225fdb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8d22e0d640 1 -- 172.21.15.117:0/1199753658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24004530 con 0x55da68424370 2024-09-10T06:24:41.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8d22e0d640 1 -- 172.21.15.117:0/1199753658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e240046d0 con 0x55da68424370 2024-09-10T06:24:41.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8d22e0d640 1 -- 172.21.15.117:0/1199753658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e240049f0 con 0x55da68424370 2024-09-10T06:24:41.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- 172.21.15.117:0/1199753658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 msgr2=0x55da68510790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/1199753658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8e24001810 tx=0x7f8e24001cd0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- 172.21.15.117:0/1199753658 shutdown_connections 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/1199753658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68510790 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- 172.21.15.117:0/1199753658 >> 172.21.15.117:0/1199753658 conn(0x55da6841fe90 msgr2=0x55da6850c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- 172.21.15.117:0/1199753658 shutdown_connections 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- 172.21.15.117:0/1199753658 wait complete. 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68517e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e371c99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da682cfa50 con 0x55da68424370 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68517e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68517e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45454/0 (socket says 172.21.15.117:45454) 2024-09-10T06:24:41.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 -- 172.21.15.117:0/3858059741 learned_addr learned my addr 172.21.15.117:0/3858059741 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.274+0000 7f8e34ccf640 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da68518390 con 0x55da68424370 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68517e30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000f90 tx=0x7f8e24001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 -- 172.21.15.117:0/3858059741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24013820 con 0x55da68424370 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da68518620 con 0x55da68424370 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 -- 172.21.15.117:0/3858059741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e240139c0 con 0x55da68424370 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 -- 172.21.15.117:0/3858059741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24013ce0 con 0x55da68424370 2024-09-10T06:24:41.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da68518fd0 con 0x55da68424370 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 -- 172.21.15.117:0/3858059741 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e24010070 con 0x55da68424370 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d1c039ac0 0x7f8d1c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8d2160a640 1 -- 172.21.15.117:0/3858059741 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8e24018070 con 0x55da68424370 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e344ce640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d1c039ac0 0x7f8d1c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68428560 0x55da6851efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6851f4e0 con 0x55da68428560 2024-09-10T06:24:41.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e354d0640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68428560 0x55da6851efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e344ce640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d1c039ac0 0x7f8d1c03bf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0ae000 tx=0x7f8e1c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e354d0640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68428560 0x55da6851efa0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e354d0640 1 -- 172.21.15.117:0/3858059741 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68428560 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6851f910 con 0x55da68428560 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e354d0640 1 -- 172.21.15.117:0/3858059741 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68428560 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da68521720 0x55da68523b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da685241e0 con 0x55da68521720 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.278+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da68521720 0x55da68523b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da68521720 0x55da68523b10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 -- 172.21.15.117:0/3858059741 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e2401b030 con 0x55da68521720 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da685205c0 con 0x55da68428560 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e354d0640 1 -- 172.21.15.117:0/3858059741 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68428560 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da68525620 0x55da68527a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da685281a0 con 0x55da68525620 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e344ce640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da68525620 0x55da68527a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e344ce640 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da68525620 0x55da68527a10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e344ce640 1 -- 172.21.15.117:0/3858059741 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da68525620 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da6833a450 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45456/0 (socket says 172.21.15.117:45456) 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2817308738 learned_addr learned my addr 172.21.15.117:0/2817308738 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2817308738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da685366c0 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e2404eaa0 tx=0x7f8e24010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8d1a7fc640 1 -- 172.21.15.117:0/2817308738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24046070 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8d1a7fc640 1 -- 172.21.15.117:0/2817308738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24050440 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da68536f20 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8d1a7fc640 1 -- 172.21.15.117:0/2817308738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24011a70 con 0x55da68535c60 2024-09-10T06:24:41.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.282+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da68537490 con 0x55da68535c60 2024-09-10T06:24:41.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d1a7fc640 1 -- 172.21.15.117:0/2817308738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e24049070 con 0x55da68535c60 2024-09-10T06:24:41.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d1a7fc640 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 0x7f8d0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d1a7fc640 1 -- 172.21.15.117:0/2817308738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8e2404cbf0 con 0x55da68535c60 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 0x7f8d0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 0x7f8d0c03bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c018f40 tx=0x7f8e1c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da68510fe0 con 0x55da6842b070 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45460/0 (socket says 172.21.15.117:45460) 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e34ccf640 1 -- 172.21.15.117:0/3028242285 learned_addr learned my addr 172.21.15.117:0/3028242285 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e34ccf640 1 -- 172.21.15.117:0/3028242285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6842ba20 con 0x55da6842b070 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/3028242285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401e800 tx=0x7f8e24043450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea51df37a0e7af08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d0bfff640 1 -- 172.21.15.117:0/3028242285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24061070 con 0x55da6842b070 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d0bfff640 1 -- 172.21.15.117:0/3028242285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24055070 con 0x55da6842b070 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8d0bfff640 1 -- 172.21.15.117:0/3028242285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24026b00 con 0x55da6842b070 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3028242285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 msgr2=0x55da6842b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3028242285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401e800 tx=0x7f8e24043450 comp rx=0 tx=0).stop 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3028242285 shutdown_connections 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3028242285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6842b450 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3028242285 >> 172.21.15.117:0/3028242285 conn(0x55da6853e7d0 msgr2=0x55da6853ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3028242285 shutdown_connections 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.286+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3028242285 wait complete. 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 Processor -- start 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 -- start start 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da6842bf80 con 0x55da6842b070 2024-09-10T06:24:41.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e34ccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45476/0 (socket says 172.21.15.117:45476) 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 learned_addr learned my addr 172.21.15.117:0/2952327816 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6854be70 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e24012ec0 tx=0x7f8e240435a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 -- 172.21.15.117:0/2952327816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24061030 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da6854be70 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 -- 172.21.15.117:0/2952327816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24026d30 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da6854c440 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 -- 172.21.15.117:0/2952327816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e2404f040 con 0x55da6842b070 2024-09-10T06:24:41.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 -- 172.21.15.117:0/2952327816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e2406f030 con 0x55da6842b070 2024-09-10T06:24:41.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d000399d0 0x7f8d0003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8d0a7fc640 1 -- 172.21.15.117:0/2952327816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8e2406d020 con 0x55da6842b070 2024-09-10T06:24:41.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d000399d0 0x7f8d0003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68556ab0 0x55da68558f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.290+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da68559690 con 0x55da68556ab0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68556ab0 0x55da68558f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d000399d0 0x7f8d0003be90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0cd040 tx=0x7f8e1c0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68556ab0 0x55da68558f40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68556ab0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 realm 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da68559aa0 con 0x55da68556ab0 2024-09-10T06:24:41.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68556ab0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a370 con 0x55da68556ab0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68556ab0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68556ab0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da6855b200 0x55da6855d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855dd30 con 0x55da6855b200 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da6855b200 0x55da6855d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da6855b200 0x55da6855d5f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 20 searching for the correct realm 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da6855fcd0 0x55da68562170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da68562840 con 0x55da6855fcd0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da6855fcd0 0x55da68562170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e344ce640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da6855fcd0 0x55da68562170 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da68562840 con 0x55da6855b200 2024-09-10T06:24:41.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8e2404b060 0x7f8e24041850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da68562840 con 0x7f8e2404b060 2024-09-10T06:24:41.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.294+0000 7f8e354d0640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8e2404b060 0x7f8e24041850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8e2404b060 0x7f8e24041850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c0083f0 con 0x7f8e2404b060 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c0083f0 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855b200 2024-09-10T06:24:41.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.298+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855b200 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855b200 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.302+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855b200 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855fcd0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da6855b200 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855a710 con 0x55da68556ab0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855e5f0 con 0x55da68556ab0 2024-09-10T06:24:41.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.306+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855e5f0 con 0x55da6855fcd0 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 zone default found 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 4 Realm: () 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 zonegroup default 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855eec0 con 0x7f8e2404b060 2024-09-10T06:24:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6855eec0 con 0x55da6855fcd0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da685646b0 con 0x55da6855fcd0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 started sync module instance, tier type = 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:41.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68563b50 con 0x55da6855b200 2024-09-10T06:24:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396541714544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68563b50 con 0x55da6855b200 2024-09-10T06:24:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.310+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68565110 con 0x55da68556ab0 2024-09-10T06:24:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396541714544] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396541717536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68563b50 con 0x55da68556ab0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68565b50 con 0x55da6855fcd0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396541717536] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396541712032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68563ac0 con 0x55da6855fcd0 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.314+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da685668a0 con 0x55da6855b200 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396541723936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68567140 con 0x55da6855b200 2024-09-10T06:24:41.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68567b00 con 0x55da68556ab0 2024-09-10T06:24:41.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396541712032] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396541723936] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396541725840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68567b00 con 0x55da68556ab0 2024-09-10T06:24:41.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.318+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da685670b0 con 0x7f8e2404b060 2024-09-10T06:24:41.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396541725840] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396541728336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68567f20 con 0x7f8e2404b060 2024-09-10T06:24:41.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68568910 con 0x7f8e2404b060 2024-09-10T06:24:41.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396541728336] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396541731872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68568af0 con 0x7f8e2404b060 2024-09-10T06:24:41.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.322+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68569340 con 0x7f8e2404b060 2024-09-10T06:24:41.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396541731872] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396541733616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da685693c0 con 0x7f8e2404b060 2024-09-10T06:24:41.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=0 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=1 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=2 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=3 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=4 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=5 2024-09-10T06:24:41.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=6 2024-09-10T06:24:41.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396541733616] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 20 add_watcher() i=7 2024-09-10T06:24:41.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:41.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.326+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6856c710 con 0x55da68556ab0 2024-09-10T06:24:41.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396541747488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da68569530 con 0x55da68556ab0 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396541747488] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8ceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 5 note: GC not initialized 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8ce9fe3640 20 reqs_thread_entry: start 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:41.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 Filter name: none 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8c5b7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f960 con 0x55da68556ab0 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:41.334 INFO:teuthology.orchestra.run.smithi117.stderr:could not fetch user info: no user info saved 2024-09-10T06:24:41.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8ceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:41.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.330+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396541747488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da68556ab0 2024-09-10T06:24:41.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94396541747488] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396541714544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da6855b200 2024-09-10T06:24:41.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94396541714544] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 20 remove_watcher() i=0 2024-09-10T06:24:41.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 2 removed watcher, disabling cache 2024-09-10T06:24:41.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396541717536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da68556ab0 2024-09-10T06:24:41.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94396541717536] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 20 remove_watcher() i=1 2024-09-10T06:24:41.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.334+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396541712032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da6855fcd0 2024-09-10T06:24:41.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e344ce640 1 -- 172.21.15.117:0/2952327816 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94396541712032] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c0a8070 con 0x55da6855fcd0 2024-09-10T06:24:41.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e371c99c0 20 remove_watcher() i=2 2024-09-10T06:24:41.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396541723936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da6855b200 2024-09-10T06:24:41.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e34ccf640 1 -- 172.21.15.117:0/2952327816 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94396541723936] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e24079040 con 0x55da6855b200 2024-09-10T06:24:41.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e371c99c0 20 remove_watcher() i=3 2024-09-10T06:24:41.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.338+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396541725840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x55da68556ab0 2024-09-10T06:24:41.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94396541725840] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x55da68556ab0 2024-09-10T06:24:41.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e371c99c0 20 remove_watcher() i=4 2024-09-10T06:24:41.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396541728336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x7f8e2404b060 2024-09-10T06:24:41.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94396541728336] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e371c99c0 20 remove_watcher() i=5 2024-09-10T06:24:41.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.342+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396541731872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x7f8e2404b060 2024-09-10T06:24:41.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94396541731872] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 20 remove_watcher() i=6 2024-09-10T06:24:41.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396541733616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da6858f920 con 0x7f8e2404b060 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94396541733616] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e2c026040 con 0x7f8e2404b060 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 20 remove_watcher() i=7 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8e2404b060 msgr2=0x7f8e24041850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8e2404b060 0x7f8e24041850 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68556ab0 msgr2=0x55da68558f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68556ab0 0x55da68558f40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da6855b200 msgr2=0x55da6855d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da6855b200 0x55da6855d5f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da6855fcd0 msgr2=0x55da68562170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da6855fcd0 0x55da68562170 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d000399d0 msgr2=0x7f8d0003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d000399d0 0x7f8d0003be90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0cd040 tx=0x7f8e1c0a8000 comp rx=0 tx=0).stop 2024-09-10T06:24:41.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 msgr2=0x55da6854b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e354d0640 1 -- 172.21.15.117:0/2952327816 reap_dead start 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e24012ec0 tx=0x7f8e240435a0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 shutdown_connections 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2952327816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da6842b070 0x55da6854b910 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 >> 172.21.15.117:0/2952327816 conn(0x55da6853e7d0 msgr2=0x55da6853c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 shutdown_connections 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2952327816 wait complete. 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 msgr2=0x7f8d0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 0x7f8d0c03bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c018f40 tx=0x7f8e1c005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 msgr2=0x55da68536080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e2404eaa0 tx=0x7f8e24010910 comp rx=0 tx=0).stop 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 shutdown_connections 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d0c039a70 0x7f8d0c03bf30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/2817308738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68535c60 0x55da68536080 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 >> 172.21.15.117:0/2817308738 conn(0x55da6852b610 msgr2=0x55da6852b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 shutdown_connections 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/2817308738 wait complete. 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68428560 msgr2=0x55da6851efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55da68428560 0x55da6851efa0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da68521720 msgr2=0x55da68523b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55da68521720 0x55da68523b10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da68525620 msgr2=0x55da68527a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55da68525620 0x55da68527a10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d1c039ac0 msgr2=0x7f8d1c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8d1c039ac0 0x7f8d1c03bf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0ae000 tx=0x7f8e1c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 msgr2=0x55da68517e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 --2- 172.21.15.117:0/3858059741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da68424370 0x55da68517e30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000f90 tx=0x7f8e24001260 comp rx=0 tx=0).stop 2024-09-10T06:24:41.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e354d0640 1 -- 172.21.15.117:0/3858059741 reap_dead start 2024-09-10T06:24:41.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 shutdown_connections 2024-09-10T06:24:41.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 >> 172.21.15.117:0/3858059741 conn(0x55da6841fe90 msgr2=0x55da6850aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 shutdown_connections 2024-09-10T06:24:41.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.346+0000 7f8e371c99c0 1 -- 172.21.15.117:0/3858059741 wait complete. 2024-09-10T06:24:41.359 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T06:24:41.360 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-10T06:24:41.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-10T06:24:41.360 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc4958039c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f5f4541770 0x55f5f4543b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc4958039c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5f43f19c0 con 0x55f5f453d5d0 2024-09-10T06:24:41.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc4958039c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55f5f44416d0 con 0x55f5f4541770 2024-09-10T06:24:41.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc493309640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55f5f453d5d0 0x55f5f453d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54354/0 (socket says 172.21.15.117:54354) 2024-09-10T06:24:41.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492b08640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f5f4541770 0x55f5f4543b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc493309640 1 -- 172.21.15.117:0/3137281603 learned_addr learned my addr 172.21.15.117:0/3137281603 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492307640 1 -- 172.21.15.117:0/3137281603 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081013689 0 0) 0x55f5f43f19c0 con 0x55f5f453d5d0 2024-09-10T06:24:41.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492307640 1 -- 172.21.15.117:0/3137281603 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47c001e20 con 0x55f5f453d5d0 2024-09-10T06:24:41.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492b08640 1 -- 172.21.15.117:0/3137281603 >> v1:172.21.15.84:6789/0 conn(0x55f5f453d5d0 legacy=0x55f5f453d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492b08640 1 -- 172.21.15.117:0/3137281603 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f43e5ca0 con 0x55f5f4541770 2024-09-10T06:24:41.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.438+0000 7fc492b08640 1 --2- 172.21.15.117:0/3137281603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f4541770 0x55f5f4543b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc48800a480 tx=0x7fc48801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1c0d44f0e9f8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc492307640 1 -- 172.21.15.117:0/3137281603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880aa570 con 0x55f5f4541770 2024-09-10T06:24:41.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc492307640 1 -- 172.21.15.117:0/3137281603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880af070 con 0x55f5f4541770 2024-09-10T06:24:41.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc492307640 1 -- 172.21.15.117:0/3137281603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880aa840 con 0x55f5f4541770 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 -- 172.21.15.117:0/3137281603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f4541770 msgr2=0x55f5f4543b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3137281603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f4541770 0x55f5f4543b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc48800a480 tx=0x7fc48801b310 comp rx=0 tx=0).stop 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 -- 172.21.15.117:0/3137281603 shutdown_connections 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3137281603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f4541770 0x55f5f4543b60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 -- 172.21.15.117:0/3137281603 >> 172.21.15.117:0/3137281603 conn(0x55f5f45390f0 msgr2=0x55f5f453b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 -- 172.21.15.117:0/3137281603 shutdown_connections 2024-09-10T06:24:41.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.442+0000 7fc4958039c0 1 -- 172.21.15.117:0/3137281603 wait complete. 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc4958039c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc4958039c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5f4445680 con 0x55f5f453d5d0 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45486/0 (socket says 172.21.15.117:45486) 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc493309640 1 -- 172.21.15.117:0/348167377 learned_addr learned my addr 172.21.15.117:0/348167377 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.454+0000 7fc493309640 1 -- 172.21.15.117:0/348167377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f43c0da0 con 0x55f5f453d5d0 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 --2- 172.21.15.117:0/348167377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e40 tx=0x7fc48400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ce2233e919364c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc38160a640 1 -- 172.21.15.117:0/348167377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc484012020 con 0x55f5f453d5d0 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc38160a640 1 -- 172.21.15.117:0/348167377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48400e690 con 0x55f5f453d5d0 2024-09-10T06:24:41.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc38160a640 1 -- 172.21.15.117:0/348167377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48400e9b0 con 0x55f5f453d5d0 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/348167377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 msgr2=0x55f5f46287a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 --2- 172.21.15.117:0/348167377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e40 tx=0x7fc48400b790 comp rx=0 tx=0).stop 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/348167377 shutdown_connections 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 --2- 172.21.15.117:0/348167377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f46287a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/348167377 >> 172.21.15.117:0/348167377 conn(0x55f5f45390f0 msgr2=0x55f5f4624440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/348167377 shutdown_connections 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/348167377 wait complete. 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5f43e7a50 con 0x55f5f453d5d0 2024-09-10T06:24:41.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45492/0 (socket says 172.21.15.117:45492) 2024-09-10T06:24:41.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 -- 172.21.15.117:0/869146339 learned_addr learned my addr 172.21.15.117:0/869146339 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 -- 172.21.15.117:0/869146339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f462e0d0 con 0x55f5f453d5d0 2024-09-10T06:24:41.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc493309640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc484004180 tx=0x7fc4840040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc37fe07640 1 -- 172.21.15.117:0/869146339 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc484012030 con 0x55f5f453d5d0 2024-09-10T06:24:41.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc37fe07640 1 -- 172.21.15.117:0/869146339 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48401a7a0 con 0x55f5f453d5d0 2024-09-10T06:24:41.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f462e360 con 0x55f5f453d5d0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc37fe07640 1 -- 172.21.15.117:0/869146339 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48401aae0 con 0x55f5f453d5d0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.458+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f462ed10 con 0x55f5f453d5d0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5f4452450 con 0x55f5f463a7f0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37fe07640 1 -- 172.21.15.117:0/869146339 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc484015020 con 0x55f5f453d5d0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45498/0 (socket says 172.21.15.117:45498) 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 -- 172.21.15.117:0/1582055422 learned_addr learned my addr 172.21.15.117:0/1582055422 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37fe07640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 0x7fc378040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37fe07640 1 -- 172.21.15.117:0/869146339 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc484020070 con 0x55f5f453d5d0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493309640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 0x7fc378040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 -- 172.21.15.117:0/1582055422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f463b1e0 con 0x55f5f463a7f0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493309640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 0x7fc378040340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc484008fd0 tx=0x7fc484018f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 --2- 172.21.15.117:0/1582055422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a430 tx=0x7fc48c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8201087c1ba638bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37de03640 1 -- 172.21.15.117:0/1582055422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c00f6e0 con 0x55f5f463a7f0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37de03640 1 -- 172.21.15.117:0/1582055422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c015070 con 0x55f5f463a7f0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc37de03640 1 -- 172.21.15.117:0/1582055422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c00fa10 con 0x55f5f463a7f0 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- 172.21.15.117:0/1582055422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 msgr2=0x55f5f463abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 --2- 172.21.15.117:0/1582055422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00a430 tx=0x7fc48c00a8f0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- 172.21.15.117:0/1582055422 shutdown_connections 2024-09-10T06:24:41.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 --2- 172.21.15.117:0/1582055422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f463abf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- 172.21.15.117:0/1582055422 >> 172.21.15.117:0/1582055422 conn(0x55f5f4541770 msgr2=0x55f5f4636230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- 172.21.15.117:0/1582055422 shutdown_connections 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- 172.21.15.117:0/1582055422 wait complete. 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc4958039c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5f463b9d0 con 0x55f5f463a7f0 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45506/0 (socket says 172.21.15.117:45506) 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 -- 172.21.15.117:0/2346518127 learned_addr learned my addr 172.21.15.117:0/2346518127 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.462+0000 7fc493b0a640 1 -- 172.21.15.117:0/2346518127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f4642110 con 0x55f5f463a7f0 2024-09-10T06:24:41.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493b0a640 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00adf0 tx=0x7fc48c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 -- 172.21.15.117:0/2346518127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c010a10 con 0x55f5f463a7f0 2024-09-10T06:24:41.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 -- 172.21.15.117:0/2346518127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c020070 con 0x55f5f463a7f0 2024-09-10T06:24:41.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f46423a0 con 0x55f5f463a7f0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 -- 172.21.15.117:0/2346518127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc48c010d40 con 0x55f5f463a7f0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f4642d50 con 0x55f5f463a7f0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 -- 172.21.15.117:0/2346518127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc48c01b420 con 0x55f5f463a7f0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 Processor -- start 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- start start 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 0x7fc37403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5f4628fd0 con 0x55f5f465b4b0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493b0a640 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 0x7fc37403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc36ffff640 1 -- 172.21.15.117:0/2346518127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc48c050bd0 con 0x55f5f463a7f0 2024-09-10T06:24:41.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493309640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45508/0 (socket says 172.21.15.117:45508) 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493309640 1 -- 172.21.15.117:0/3934764884 learned_addr learned my addr 172.21.15.117:0/3934764884 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493b0a640 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 0x7fc37403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc48c015ff0 tx=0x7fc48c01c8b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493309640 1 -- 172.21.15.117:0/3934764884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f465bf10 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc493309640 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc484007fb0 tx=0x7fc484006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc2ebfff640 1 -- 172.21.15.117:0/3934764884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc484016de0 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc2ebfff640 1 -- 172.21.15.117:0/3934764884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48400d3e0 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc2ebfff640 1 -- 172.21.15.117:0/3934764884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc484016c00 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f465c770 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.466+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f465cc40 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc2ebfff640 1 -- 172.21.15.117:0/3934764884 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc484009070 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc2ebfff640 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 0x7fc2cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc2ebfff640 1 -- 172.21.15.117:0/3934764884 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc484005050 con 0x55f5f465b4b0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc492b08640 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 0x7fc2cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc2e9ffb640 20 reqs_thread_entry: start 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 0x55f5f4663360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f4663a30 con 0x55f5f4660ef0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc492b08640 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 0x7fc2cc03bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc4880ae000 tx=0x7fc4880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493b0a640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 0x55f5f4663360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493b0a640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 0x55f5f4663360 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493b0a640 1 -- 172.21.15.117:0/869146339 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc48c00e070 con 0x55f5f4660ef0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 0x55f5f4667bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:2 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f46682c0 con 0x55f5f4665800 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493309640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 0x55f5f4667bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493309640 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 0x55f5f4667bf0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc493309640 1 -- 172.21.15.117:0/869146339 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(2 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc484008030 con 0x55f5f4665800 2024-09-10T06:24:41.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 msgr2=0x7fc37403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 0x7fc37403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc48c015ff0 tx=0x7fc48c01c8b0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 msgr2=0x55f5f4641bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00adf0 tx=0x7fc48c003380 comp rx=0 tx=0).stop 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 shutdown_connections 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc374039a70 0x7fc37403bf30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 --2- 172.21.15.117:0/2346518127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f463a7f0 0x55f5f4641bb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 >> 172.21.15.117:0/2346518127 conn(0x55f5f4541770 msgr2=0x55f5f4635d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.470+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 shutdown_connections 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/2346518127 wait complete. 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 msgr2=0x7fc2cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 0x7fc2cc03bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc4880ae000 tx=0x7fc4880a6000 comp rx=0 tx=0).stop 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 msgr2=0x55f5f465b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc484007fb0 tx=0x7fc484006ef0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 shutdown_connections 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc2cc039a70 0x7fc2cc03bf30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/3934764884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f465b4b0 0x55f5f465b8d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 >> 172.21.15.117:0/3934764884 conn(0x55f5f4650ae0 msgr2=0x55f5f4650ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 shutdown_connections 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/3934764884 wait complete. 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 msgr2=0x55f5f4663360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 0x55f5f4663360 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 msgr2=0x55f5f4667bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 0x55f5f4667bf0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 msgr2=0x7fc378040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 0x7fc378040340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc484008fd0 tx=0x7fc484018f50 comp rx=0 tx=0).stop 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 msgr2=0x55f5f462db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc484004180 tx=0x7fc4840040f0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 shutdown_connections 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5f4665800 0x55f5f4667bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5f4660ef0 0x55f5f4663360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc37803de80 0x7fc378040340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 --2- 172.21.15.117:0/869146339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5f453d5d0 0x55f5f462db70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 >> 172.21.15.117:0/869146339 conn(0x55f5f45390f0 msgr2=0x55f5f4622ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 shutdown_connections 2024-09-10T06:24:41.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.474+0000 7fc4958039c0 1 -- 172.21.15.117:0/869146339 wait complete. 2024-09-10T06:24:41.485 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T06:24:41.485 DEBUG:tasks.util.rgw: json result: {'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T06:24:41.486 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-10T06:24:41.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-10T06:24:41.486 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-10T06:24:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.559 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e84bc9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5620958f86a0 0x5620958faa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e84bc9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5620957a89c0 con 0x5620958f4500 2024-09-10T06:24:41.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e84bc9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5620957f86d0 con 0x5620958f86a0 2024-09-10T06:24:41.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e57c1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5620958f86a0 0x5620958faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e5fc2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5620958f4500 0x5620958f48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54362/0 (socket says 172.21.15.117:54362) 2024-09-10T06:24:41.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/3231051718 learned_addr learned my addr 172.21.15.117:0/3231051718 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e57c1640 1 -- 172.21.15.117:0/3231051718 >> v1:172.21.15.84:6789/0 conn(0x5620958f4500 legacy=0x5620958f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.558+0000 7ff2e57c1640 1 -- 172.21.15.117:0/3231051718 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209579cca0 con 0x5620958f86a0 2024-09-10T06:24:41.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e57c1640 1 --2- 172.21.15.117:0/3231051718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f86a0 0x5620958faa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00a480 tx=0x7ff2dc01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0d94b6790711c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e4fc0640 1 -- 172.21.15.117:0/3231051718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2dc0aa570 con 0x5620958f86a0 2024-09-10T06:24:41.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e4fc0640 1 -- 172.21.15.117:0/3231051718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc0af070 con 0x5620958f86a0 2024-09-10T06:24:41.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e4fc0640 1 -- 172.21.15.117:0/3231051718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2dc0aa860 con 0x5620958f86a0 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3231051718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f86a0 msgr2=0x5620958faa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/3231051718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f86a0 0x5620958faa90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00a480 tx=0x7ff2dc01b310 comp rx=0 tx=0).stop 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3231051718 shutdown_connections 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/3231051718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f86a0 0x5620958faa90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3231051718 >> 172.21.15.117:0/3231051718 conn(0x5620958f0020 msgr2=0x5620958f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3231051718 shutdown_connections 2024-09-10T06:24:41.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.562+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3231051718 wait complete. 2024-09-10T06:24:41.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.574+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.574+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5620957fc680 con 0x5620958f4500 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45526/0 (socket says 172.21.15.117:45526) 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/3929317685 learned_addr learned my addr 172.21.15.117:0/3929317685 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/3929317685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562095777da0 con 0x5620958f4500 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/3929317685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8001e00 tx=0x7ff2d800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bf3ed0946f2960 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff1d3e07640 1 -- 172.21.15.117:0/3929317685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d8012020 con 0x5620958f4500 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff1d3e07640 1 -- 172.21.15.117:0/3929317685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d800e690 con 0x5620958f4500 2024-09-10T06:24:41.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff1d3e07640 1 -- 172.21.15.117:0/3929317685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d800ea10 con 0x5620958f4500 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3929317685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 msgr2=0x5620959df830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/3929317685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8001e00 tx=0x7ff2d800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3929317685 shutdown_connections 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/3929317685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959df830 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3929317685 >> 172.21.15.117:0/3929317685 conn(0x5620958f0020 msgr2=0x5620959db4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3929317685 shutdown_connections 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/3929317685 wait complete. 2024-09-10T06:24:41.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e84bc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56209579ea50 con 0x5620958f4500 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959e6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45538/0 (socket says 172.21.15.117:45538) 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 learned_addr learned my addr 172.21.15.117:0/2626070765 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620959e7370 con 0x5620958f4500 2024-09-10T06:24:41.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.578+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959e6e10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800b710 tx=0x7ff2d8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 -- 172.21.15.117:0/2626070765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d8012030 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620959e7600 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 -- 172.21.15.117:0/2626070765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d801a750 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620959e7fb0 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 -- 172.21.15.117:0/2626070765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d801aa30 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562095809450 con 0x56209586b2f0 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45546/0 (socket says 172.21.15.117:45546) 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 -- 172.21.15.117:0/4211538538 learned_addr learned my addr 172.21.15.117:0/4211538538 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 -- 172.21.15.117:0/2626070765 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2d8015020 con 0x5620958f4500 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1cc039a70 0x7ff1cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1d2604640 1 -- 172.21.15.117:0/2626070765 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff2d8020030 con 0x5620958f4500 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 -- 172.21.15.117:0/4211538538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209586b7a0 con 0x56209586b2f0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1cc039a70 0x7ff1cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/4211538538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000a430 tx=0x7ff2e000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bec9dee07744a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1cc039a70 0x7ff1cc03bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff2d801af20 tx=0x7ff2d801adb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1cbfff640 1 -- 172.21.15.117:0/4211538538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e000f6e0 con 0x56209586b2f0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1cbfff640 1 -- 172.21.15.117:0/4211538538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e0015070 con 0x56209586b2f0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff1cbfff640 1 -- 172.21.15.117:0/4211538538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e000fa10 con 0x56209586b2f0 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/4211538538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 msgr2=0x562095869a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/4211538538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000a430 tx=0x7ff2e000a8f0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/4211538538 shutdown_connections 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/4211538538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x562095869a60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/4211538538 >> 172.21.15.117:0/4211538538 conn(0x5620958f86a0 msgr2=0x5620959ef4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/4211538538 shutdown_connections 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/4211538538 wait complete. 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e84bc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56209586a060 con 0x56209586b2f0 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.582+0000 7ff2e67c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45560/0 (socket says 172.21.15.117:45560) 2024-09-10T06:24:41.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2758886105 learned_addr learned my addr 172.21.15.117:0/2758886105 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2758886105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620959fd4f0 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000adf0 tx=0x7ff2e0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 -- 172.21.15.117:0/2758886105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e0010a10 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620959fd780 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 -- 172.21.15.117:0/2758886105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e0020070 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620959fe130 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 -- 172.21.15.117:0/2758886105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e0010d00 con 0x56209586b2f0 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 -- 172.21.15.117:0/2758886105 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2e0025470 con 0x56209586b2f0 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 Processor -- start 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 0x7ff1c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 -- start start 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff1ca7fc640 1 -- 172.21.15.117:0/2758886105 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff2e0050f60 con 0x56209586b2f0 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 0x7ff1c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e84bc9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5620959e0060 con 0x562095a16890 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 0x7ff1c003bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0010f60 tx=0x7ff2e0042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e5fc2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45576/0 (socket says 172.21.15.117:45576) 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/1528733586 learned_addr learned my addr 172.21.15.117:0/1528733586 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.586+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/1528733586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562095a172f0 con 0x562095a16890 2024-09-10T06:24:41.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8016fd0 tx=0x7ff2d8040ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 -- 172.21.15.117:0/1528733586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d802d870 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 -- 172.21.15.117:0/1528733586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d802da10 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562095a17a60 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 -- 172.21.15.117:0/1528733586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d802dcf0 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562095a17fd0 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 -- 172.21.15.117:0/1528733586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2d8009070 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 0x7ff11c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1aafe5640 1 -- 172.21.15.117:0/1528733586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff2d8005050 con 0x562095a16890 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e57c1640 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 0x7ff11c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff1a8fe1640 20 reqs_thread_entry: start 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562095a1c340 0x562095a1e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e57c1640 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 0x7ff11c03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0ae000 tx=0x7ff2dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a1ee50 con 0x562095a1c340 2024-09-10T06:24:41.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562095a1c340 0x562095a1e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562095a1c340 0x562095a1e7d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a1f700 con 0x562095a1c340 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562095a20fc0 0x562095a23410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a23ba0 con 0x562095a20fc0 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562095a20fc0 0x562095a23410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562095a20fc0 0x562095a23410 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.590+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a2ab00 con 0x562095a1c340 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:NOTICE: set zone's realm_id= 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562095a2eb60 0x562095a2af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e57c1640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562095a2eb60 0x562095a2af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e57c1640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562095a2eb60 0x562095a2af80 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e5fc2640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2d8017050 0x7ff2d8050810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2d8017050 0x7ff2d8050810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2d8017050 0x7ff2d8050810 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.594+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.598+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a2eb60 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0a8070 con 0x562095a2eb60 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e57c1640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x7ff2d8017050 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2e0046070 con 0x7ff2d8017050 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.602+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a1c340 2024-09-10T06:24:41.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095a2a390 con 0x562095a20fc0 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(36 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a2c130 con 0x562095a1c340 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:38 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095a2c9b0 con 0x562095a20fc0 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(38 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:39 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095a2cdb0 con 0x562095a20fc0 2024-09-10T06:24:41.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e5fc2640 1 -- 172.21.15.117:0/2626070765 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(39 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7ff2d8059040 con 0x562095a20fc0 2024-09-10T06:24:41.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.606+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095a29650 con 0x562095a1c340 2024-09-10T06:24:41.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095a2f5b0 con 0x562095a1c340 2024-09-10T06:24:41.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7ff2e0046070 con 0x562095a1c340 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 msgr2=0x7ff1c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 0x7ff1c003bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0010f60 tx=0x7ff2e0042040 comp rx=0 tx=0).stop 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 msgr2=0x5620959fcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000adf0 tx=0x7ff2e0003380 comp rx=0 tx=0).stop 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 shutdown_connections 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1c0039a70 0x7ff1c003bf30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2758886105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56209586b2f0 0x5620959fcf90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 >> 172.21.15.117:0/2758886105 conn(0x5620958f86a0 msgr2=0x5620959ed8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 shutdown_connections 2024-09-10T06:24:41.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2758886105 wait complete. 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 msgr2=0x7ff11c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 0x7ff11c03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0ae000 tx=0x7ff2dc0a6000 comp rx=0 tx=0).stop 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 msgr2=0x562095a16cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8016fd0 tx=0x7ff2d8040ed0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 shutdown_connections 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff11c039a70 0x7ff11c03bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/1528733586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562095a16890 0x562095a16cb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 >> 172.21.15.117:0/1528733586 conn(0x562095a0bec0 msgr2=0x562095a0c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 shutdown_connections 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.610+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/1528733586 wait complete. 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2d8017050 msgr2=0x7ff2d8050810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7ff2d8017050 0x7ff2d8050810 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562095a1c340 msgr2=0x562095a1e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562095a1c340 0x562095a1e7d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562095a20fc0 msgr2=0x562095a23410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562095a20fc0 0x562095a23410 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562095a2eb60 msgr2=0x562095a2af80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562095a2eb60 0x562095a2af80 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1cc039a70 msgr2=0x7ff1cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ff1cc039a70 0x7ff1cc03bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff2d801af20 tx=0x7ff2d801adb0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 msgr2=0x5620959e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 --2- 172.21.15.117:0/2626070765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5620958f4500 0x5620959e6e10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800b710 tx=0x7ff2d8000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 reap_dead start 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e67c3640 1 -- 172.21.15.117:0/2626070765 reap_dead start 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 shutdown_connections 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 >> 172.21.15.117:0/2626070765 conn(0x5620958f0020 msgr2=0x5620959d9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 shutdown_connections 2024-09-10T06:24:41.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.614+0000 7ff2e84bc9c0 1 -- 172.21.15.117:0/2626070765 wait complete. 2024-09-10T06:24:41.624 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T06:24:41.624 DEBUG:tasks.util.rgw: json result: {'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T06:24:41.624 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-10T06:24:41.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-10T06:24:41.625 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-10T06:24:41.693 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.693 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.690+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.690+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.690+0000 7f20bac459c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e09babd4d0 0x55e09babd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.690+0000 7f20bac459c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e09b9719c0 con 0x55e09bac0610 2024-09-10T06:24:41.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.690+0000 7f20bac459c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55e09b9c16d0 con 0x55e09babd4d0 2024-09-10T06:24:41.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b874b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e09babd4d0 0x55e09babd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b7f4a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55e09bac0610 0x55e09bac2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54374/0 (socket says 172.21.15.117:54374) 2024-09-10T06:24:41.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b874b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55e09babd4d0 0x55e09babd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45582/0 (socket says 172.21.15.117:45582) 2024-09-10T06:24:41.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b7f4a640 1 -- 172.21.15.117:0/2683254981 learned_addr learned my addr 172.21.15.117:0/2683254981 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b874b640 1 -- 172.21.15.117:0/2683254981 >> v1:172.21.15.84:6789/0 conn(0x55e09bac0610 legacy=0x55e09bac2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.694+0000 7f20b874b640 1 -- 172.21.15.117:0/2683254981 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09b965ca0 con 0x55e09babd4d0 2024-09-10T06:24:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20b874b640 1 --2- 172.21.15.117:0/2683254981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09babd8b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a480 tx=0x7f20a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f7942dac6472c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20b7749640 1 -- 172.21.15.117:0/2683254981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80b0070 con 0x55e09babd4d0 2024-09-10T06:24:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20b7749640 1 -- 172.21.15.117:0/2683254981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80ab540 con 0x55e09babd4d0 2024-09-10T06:24:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20b7749640 1 -- 172.21.15.117:0/2683254981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80ab840 con 0x55e09babd4d0 2024-09-10T06:24:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 -- 172.21.15.117:0/2683254981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 msgr2=0x55e09babd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 --2- 172.21.15.117:0/2683254981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09babd8b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a480 tx=0x7f20a801b280 comp rx=0 tx=0).stop 2024-09-10T06:24:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 -- 172.21.15.117:0/2683254981 shutdown_connections 2024-09-10T06:24:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 --2- 172.21.15.117:0/2683254981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09babd8b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 -- 172.21.15.117:0/2683254981 >> 172.21.15.117:0/2683254981 conn(0x55e09bab8ff0 msgr2=0x55e09babb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 -- 172.21.15.117:0/2683254981 shutdown_connections 2024-09-10T06:24:41.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.698+0000 7f20bac459c0 1 -- 172.21.15.117:0/2683254981 wait complete. 2024-09-10T06:24:41.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.710+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.710+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.710+0000 7f20bac459c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.710+0000 7f20bac459c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e09b9c5680 con 0x55e09babd4d0 2024-09-10T06:24:41.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45592/0 (socket says 172.21.15.117:45592) 2024-09-10T06:24:41.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 -- 172.21.15.117:0/3520526710 learned_addr learned my addr 172.21.15.117:0/3520526710 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 -- 172.21.15.117:0/3520526710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09b940da0 con 0x55e09babd4d0 2024-09-10T06:24:41.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- 172.21.15.117:0/3520526710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f20a8018eb0 tx=0x7f20a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e0eb9a579586cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f1fa660c640 1 -- 172.21.15.117:0/3520526710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80b0070 con 0x55e09babd4d0 2024-09-10T06:24:41.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f1fa660c640 1 -- 172.21.15.117:0/3520526710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80b1040 con 0x55e09babd4d0 2024-09-10T06:24:41.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f1fa660c640 1 -- 172.21.15.117:0/3520526710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80ab6f0 con 0x55e09babd4d0 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- 172.21.15.117:0/3520526710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 msgr2=0x55e09bba65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 --2- 172.21.15.117:0/3520526710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f20a8018eb0 tx=0x7f20a8003030 comp rx=0 tx=0).stop 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- 172.21.15.117:0/3520526710 shutdown_connections 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 --2- 172.21.15.117:0/3520526710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bba65c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- 172.21.15.117:0/3520526710 >> 172.21.15.117:0/3520526710 conn(0x55e09bab8ff0 msgr2=0x55e09bba2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- 172.21.15.117:0/3520526710 shutdown_connections 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- 172.21.15.117:0/3520526710 wait complete. 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20bac459c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e09b967a50 con 0x55e09babd4d0 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45602/0 (socket says 172.21.15.117:45602) 2024-09-10T06:24:41.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 -- 172.21.15.117:0/1062058790 learned_addr learned my addr 172.21.15.117:0/1062058790 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09bbae040 con 0x55e09babd4d0 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.714+0000 7f20b874b640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f20a8018eb0 tx=0x7f20a8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 -- 172.21.15.117:0/1062058790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80c4070 con 0x55e09babd4d0 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 -- 172.21.15.117:0/1062058790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80b75b0 con 0x55e09babd4d0 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09bbae2d0 con 0x55e09babd4d0 2024-09-10T06:24:41.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 -- 172.21.15.117:0/1062058790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80b7890 con 0x55e09babd4d0 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09bbaec80 con 0x55e09babd4d0 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e09b9d2450 con 0x55e09bbba780 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45614/0 (socket says 172.21.15.117:45614) 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 -- 172.21.15.117:0/923397617 learned_addr learned my addr 172.21.15.117:0/923397617 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 -- 172.21.15.117:0/1062058790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20a80c7070 con 0x55e09babd4d0 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 0x7f1fa003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1fa4e09640 1 -- 172.21.15.117:0/1062058790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f20a80bc070 con 0x55e09babd4d0 2024-09-10T06:24:41.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 -- 172.21.15.117:0/923397617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09bbbb170 con 0x55e09bbba780 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b874b640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 0x7f1fa003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/923397617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a430 tx=0x7f20b000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1446d7611cb13b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b874b640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 0x7f1fa003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20a80c0fd0 tx=0x7f20a80b5f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1f9e7fc640 1 -- 172.21.15.117:0/923397617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b000f6e0 con 0x55e09bbba780 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1f9e7fc640 1 -- 172.21.15.117:0/923397617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0015070 con 0x55e09bbba780 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f1f9e7fc640 1 -- 172.21.15.117:0/923397617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b000fa10 con 0x55e09bbba780 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/923397617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 msgr2=0x55e09bbbab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 --2- 172.21.15.117:0/923397617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a430 tx=0x7f20b000a8f0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/923397617 shutdown_connections 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 --2- 172.21.15.117:0/923397617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbbab80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/923397617 >> 172.21.15.117:0/923397617 conn(0x55e09bac0610 msgr2=0x55e09bbb61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/923397617 shutdown_connections 2024-09-10T06:24:41.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- 172.21.15.117:0/923397617 wait complete. 2024-09-10T06:24:41.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20bac459c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e09bbbb960 con 0x55e09bbba780 2024-09-10T06:24:41.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.718+0000 7f20b8f4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45618/0 (socket says 172.21.15.117:45618) 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 -- 172.21.15.117:0/850833552 learned_addr learned my addr 172.21.15.117:0/850833552 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 -- 172.21.15.117:0/850833552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09bbc2080 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f20b000adf0 tx=0x7f20b0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 -- 172.21.15.117:0/850833552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0010a10 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 -- 172.21.15.117:0/850833552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0020070 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09bbc2310 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 -- 172.21.15.117:0/850833552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0010d40 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09bbc2cc0 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 -- 172.21.15.117:0/850833552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20b001b420 con 0x55e09bbba780 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 Processor -- start 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 -- start start 2024-09-10T06:24:41.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f1f9cff9640 1 -- 172.21.15.117:0/850833552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f20b0050b30 con 0x55e09bbba780 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20bac459c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e09bba6d50 con 0x55e09bbdb470 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f20b0027040 tx=0x7f20b004b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b874b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45634/0 (socket says 172.21.15.117:45634) 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.722+0000 7f20b874b640 1 -- 172.21.15.117:0/939951952 learned_addr learned my addr 172.21.15.117:0/939951952 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b874b640 1 -- 172.21.15.117:0/939951952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09bbdbe60 con 0x55e09bbdb470 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b874b640 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f20a80abc40 tx=0x7f20a80b5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 -- 172.21.15.117:0/939951952 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80ce030 con 0x55e09bbdb470 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 -- 172.21.15.117:0/939951952 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80ed020 con 0x55e09bbdb470 2024-09-10T06:24:41.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e09bbdc710 con 0x55e09bbdb470 2024-09-10T06:24:41.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 -- 172.21.15.117:0/939951952 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80aa3b0 con 0x55e09bbdb470 2024-09-10T06:24:41.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09bbdcbe0 con 0x55e09bbdb470 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 -- 172.21.15.117:0/939951952 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20a80f0030 con 0x55e09bbdb470 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 0x7f1ef803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f7cfe1640 1 -- 172.21.15.117:0/939951952 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f20a80ee070 con 0x55e09bbdb470 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b7f4a640 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 0x7f1ef803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f1f167fc640 20 reqs_thread_entry: start 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 0x55e09bbe3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e09bbe38f0 con 0x55e09bbe0e20 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b7f4a640 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 0x7f1ef803bf80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001d00 tx=0x7f20ac001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 0x55e09bbe3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b8f4c640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 0x55e09bbe3270 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b8f4c640 1 -- 172.21.15.117:0/1062058790 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b000e070 con 0x55e09bbe0e20 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e09bbe41a0 con 0x55e09bbe0e20 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b8f4c640 1 -- 172.21.15.117:0/1062058790 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b000e070 con 0x55e09bbe0e20 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 0x55e09bbe7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e09bbe8660 con 0x55e09bbe5a60 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.726+0000 7f20b874b640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 0x55e09bbe7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20b874b640 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 0x55e09bbe7ed0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20b874b640 1 -- 172.21.15.117:0/1062058790 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f20a80e8020 con 0x55e09bbe5a60 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 msgr2=0x7f1f9003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f20b0027040 tx=0x7f20b004b040 comp rx=0 tx=0).stop 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 msgr2=0x55e09bbc1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f20b000adf0 tx=0x7f20b0003380 comp rx=0 tx=0).stop 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 shutdown_connections 2024-09-10T06:24:41.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/850833552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbba780 0x55e09bbc1b20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 >> 172.21.15.117:0/850833552 conn(0x55e09bac0610 msgr2=0x55e09bbb5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 shutdown_connections 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/850833552 wait complete. 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 msgr2=0x7f1ef803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 0x7f1ef803bf80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001d00 tx=0x7f20ac001260 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 msgr2=0x55e09bbdb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f20a80abc40 tx=0x7f20a80b5750 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 shutdown_connections 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1ef8039ac0 0x7f1ef803bf80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/939951952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09bbdb470 0x55e09bbdb890 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 >> 172.21.15.117:0/939951952 conn(0x55e09bbd0a50 msgr2=0x55e09bbd0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 shutdown_connections 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/939951952 wait complete. 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 msgr2=0x55e09bbe3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 0x55e09bbe3270 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 msgr2=0x55e09bbe7ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 0x55e09bbe7ed0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 msgr2=0x7f1fa003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 0x7f1fa003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f20a80c0fd0 tx=0x7f20a80b5f70 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 msgr2=0x55e09bbadae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f20a8018eb0 tx=0x7f20a8018020 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 shutdown_connections 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55e09bbe5a60 0x55e09bbe7ed0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55e09bbe0e20 0x55e09bbe3270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1fa0039a70 0x7f1fa003bf30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 --2- 172.21.15.117:0/1062058790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e09babd4d0 0x55e09bbadae0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 >> 172.21.15.117:0/1062058790 conn(0x55e09bab8ff0 msgr2=0x55e09bba0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 shutdown_connections 2024-09-10T06:24:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.730+0000 7f20bac459c0 1 -- 172.21.15.117:0/1062058790 wait complete. 2024-09-10T06:24:41.744 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T06:24:41.744 DEBUG:tasks.util.rgw: json result: {'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T06:24:41.744 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T06:24:41.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T06:24:41.744 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T06:24:41.827 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.828 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76f5c39c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55a8daaf8020 0x55a8daaf8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76f5c39c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8daa379c0 con 0x55a8dab86390 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76f5c39c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55a8daa876d0 con 0x55a8daaf8020 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76d0c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55a8daaf8020 0x55a8daaf8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe767fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55a8dab86390 0x55a8dab887b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54376/0 (socket says 172.21.15.117:54376) 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76d0c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55a8daaf8020 0x55a8daaf8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45644/0 (socket says 172.21.15.117:45644) 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe767fff640 1 -- 172.21.15.117:0/1556811382 learned_addr learned my addr 172.21.15.117:0/1556811382 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76d0c9640 1 -- 172.21.15.117:0/1556811382 >> v1:172.21.15.84:6789/0 conn(0x55a8dab86390 legacy=0x55a8dab887b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.826+0000 7fe76d0c9640 1 -- 172.21.15.117:0/1556811382 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8daa2bca0 con 0x55a8daaf8020 2024-09-10T06:24:41.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/1556811382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daaf8020 0x55a8daaf8400 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a480 tx=0x7fe76001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32abcf6290ca113f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76c8c8640 1 -- 172.21.15.117:0/1556811382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600b0070 con 0x55a8daaf8020 2024-09-10T06:24:41.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76c8c8640 1 -- 172.21.15.117:0/1556811382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600ab540 con 0x55a8daaf8020 2024-09-10T06:24:41.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76c8c8640 1 -- 172.21.15.117:0/1556811382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600ab840 con 0x55a8daaf8020 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1556811382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daaf8020 msgr2=0x55a8daaf8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1556811382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daaf8020 0x55a8daaf8400 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a480 tx=0x7fe76001b280 comp rx=0 tx=0).stop 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1556811382 shutdown_connections 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1556811382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daaf8020 0x55a8daaf8400 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1556811382 >> 172.21.15.117:0/1556811382 conn(0x55a8dab7df30 msgr2=0x55a8dab80350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1556811382 shutdown_connections 2024-09-10T06:24:41.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.830+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1556811382 wait complete. 2024-09-10T06:24:41.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76f5c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76f5c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a8daa8b680 con 0x55a8dab86390 2024-09-10T06:24:41.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45654/0 (socket says 172.21.15.117:45654) 2024-09-10T06:24:41.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76d0c9640 1 -- 172.21.15.117:0/598856979 learned_addr learned my addr 172.21.15.117:0/598856979 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76d0c9640 1 -- 172.21.15.117:0/598856979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8daa06da0 con 0x55a8dab86390 2024-09-10T06:24:41.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/598856979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe76001b2c0 tx=0x7fe760003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e429dedee12a03fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe65b606640 1 -- 172.21.15.117:0/598856979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600b0040 con 0x55a8dab86390 2024-09-10T06:24:41.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe65b606640 1 -- 172.21.15.117:0/598856979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76000a300 con 0x55a8dab86390 2024-09-10T06:24:41.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.846+0000 7fe65b606640 1 -- 172.21.15.117:0/598856979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600ab860 con 0x55a8dab86390 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/598856979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 msgr2=0x55a8dac6eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/598856979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe76001b2c0 tx=0x7fe760003030 comp rx=0 tx=0).stop 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/598856979 shutdown_connections 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/598856979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac6eb00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/598856979 >> 172.21.15.117:0/598856979 conn(0x55a8dab7df30 msgr2=0x55a8dac6a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/598856979 shutdown_connections 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/598856979 wait complete. 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a8daa2da50 con 0x55a8dab86390 2024-09-10T06:24:41.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45656/0 (socket says 172.21.15.117:45656) 2024-09-10T06:24:41.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d0c9640 1 -- 172.21.15.117:0/2265227185 learned_addr learned my addr 172.21.15.117:0/2265227185 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d0c9640 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dac76510 con 0x55a8dab86390 2024-09-10T06:24:41.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe7600ab510 tx=0x7fe760018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 -- 172.21.15.117:0/2265227185 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600b0040 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 -- 172.21.15.117:0/2265227185 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600c6070 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8dac767a0 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 -- 172.21.15.117:0/2265227185 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600b67b0 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dac770b0 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76f5c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a8daa98450 con 0x55a8dac833a0 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d8ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 -- 172.21.15.117:0/2265227185 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7600b6950 con 0x55a8dab86390 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d8ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45662/0 (socket says 172.21.15.117:45662) 2024-09-10T06:24:41.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe76d8ca640 1 -- 172.21.15.117:0/2438945273 learned_addr learned my addr 172.21.15.117:0/2438945273 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 0x7fe65403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.850+0000 7fe659e03640 1 -- 172.21.15.117:0/2265227185 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe7600bb070 con 0x55a8dab86390 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 0x7fe65403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 -- 172.21.15.117:0/2438945273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dac83d70 con 0x55a8dac833a0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/2438945273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe76800a430 tx=0x7fe76800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6407ad2cd809431 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 0x7fe65403bf80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe7600a3ee0 tx=0x7fe7600caf60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe6537fe640 1 -- 172.21.15.117:0/2438945273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76800f6e0 con 0x55a8dac833a0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe6537fe640 1 -- 172.21.15.117:0/2438945273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe768015070 con 0x55a8dac833a0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe6537fe640 1 -- 172.21.15.117:0/2438945273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76800fa10 con 0x55a8dac833a0 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2438945273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 msgr2=0x55a8dac837a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2438945273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe76800a430 tx=0x7fe76800a8f0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2438945273 shutdown_connections 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2438945273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac837a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2438945273 >> 172.21.15.117:0/2438945273 conn(0x55a8dac7e570 msgr2=0x55a8dac7f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2438945273 shutdown_connections 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2438945273 wait complete. 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a8dac84120 con 0x55a8dac833a0 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45676/0 (socket says 172.21.15.117:45676) 2024-09-10T06:24:41.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 -- 172.21.15.117:0/1715403469 learned_addr learned my addr 172.21.15.117:0/1715403469 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 -- 172.21.15.117:0/1715403469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dac8a8a0 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe76800adf0 tx=0x7fe768003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe651ffb640 1 -- 172.21.15.117:0/1715403469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe768010a10 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe651ffb640 1 -- 172.21.15.117:0/1715403469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe768020070 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8dac8ab30 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe651ffb640 1 -- 172.21.15.117:0/1715403469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe768010d40 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.854+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dac8b4e0 con 0x55a8dac833a0 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe651ffb640 1 -- 172.21.15.117:0/1715403469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe76801b420 con 0x55a8dac833a0 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 Processor -- start 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe651ffb640 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 0x7fe64403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 -- start start 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe651ffb640 1 -- 172.21.15.117:0/1715403469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe768050bd0 con 0x55a8dac833a0 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 0x7fe64403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a8dac6f270 con 0x55a8daca3c40 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 0x7fe64403bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe76801c920 tx=0x7fe76801c7b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d0c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45682/0 (socket says 172.21.15.117:45682) 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d0c9640 1 -- 172.21.15.117:0/3433795088 learned_addr learned my addr 172.21.15.117:0/3433795088 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d0c9640 1 -- 172.21.15.117:0/3433795088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8daca46a0 con 0x55a8daca3c40 2024-09-10T06:24:41.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe76001b0b0 tx=0x7fe7600e9a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe631fe3640 1 -- 172.21.15.117:0/3433795088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760009bb0 con 0x55a8daca3c40 2024-09-10T06:24:41.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe631fe3640 1 -- 172.21.15.117:0/3433795088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760009d50 con 0x55a8daca3c40 2024-09-10T06:24:41.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8daca4ea0 con 0x55a8daca3c40 2024-09-10T06:24:41.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe631fe3640 1 -- 172.21.15.117:0/3433795088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7600c1480 con 0x55a8daca3c40 2024-09-10T06:24:41.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8daca5410 con 0x55a8daca3c40 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.858+0000 7fe631fe3640 1 -- 172.21.15.117:0/3433795088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7600f2060 con 0x55a8daca3c40 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe631fe3640 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 0x7fe5b003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe631fe3640 1 -- 172.21.15.117:0/3433795088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe7600a8070 con 0x55a8daca3c40 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe767fff640 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 0x7fe5b003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe5ab7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 0x55a8dacabc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8dacac2f0 con 0x55a8daca9760 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe767fff640 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 0x7fe5b003bee0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe758004180 tx=0x7fe7580012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 0x55a8dacabc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d8ca640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 0x55a8dacabc20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d8ca640 1 -- 172.21.15.117:0/2265227185 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe76800e070 con 0x55a8daca9760 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 0x55a8dacb04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:2 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a8dacb0ba0 con 0x55a8dacae0c0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 0x55a8dacb04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d0c9640 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 0x55a8dacb04b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76d0c9640 1 -- 172.21.15.117:0/2265227185 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(2 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fe7600b3040 con 0x55a8dacae0c0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.862+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a8dacb5df0 con 0x55a8dacae0c0 2024-09-10T06:24:41.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76d0c9640 1 -- 172.21.15.117:0/2265227185 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fe7600b3040 con 0x55a8dacae0c0 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 msgr2=0x7fe64403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 0x7fe64403bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe76801c920 tx=0x7fe76801c7b0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 msgr2=0x55a8dac8a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe76800adf0 tx=0x7fe768003380 comp rx=0 tx=0).stop 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 shutdown_connections 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe644039a70 0x7fe64403bf30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/1715403469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dac833a0 0x55a8dac8a340 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 >> 172.21.15.117:0/1715403469 conn(0x55a8dac7e570 msgr2=0x55a8dac7f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 shutdown_connections 2024-09-10T06:24:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/1715403469 wait complete. 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 msgr2=0x7fe5b003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 0x7fe5b003bee0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe758004180 tx=0x7fe7580012c0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 msgr2=0x55a8daca4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe76001b0b0 tx=0x7fe7600e9a70 comp rx=0 tx=0).stop 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 shutdown_connections 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe5b0039a20 0x7fe5b003bee0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/3433795088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8daca3c40 0x55a8daca4060 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 >> 172.21.15.117:0/3433795088 conn(0x55a8dac99270 msgr2=0x55a8dac99650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 shutdown_connections 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/3433795088 wait complete. 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 msgr2=0x55a8dacabc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 0x55a8dacabc20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 msgr2=0x55a8dacb04b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 0x55a8dacb04b0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 msgr2=0x7fe65403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 0x7fe65403bf80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe7600a3ee0 tx=0x7fe7600caf60 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 msgr2=0x55a8dac75fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe7600ab510 tx=0x7fe760018020 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 shutdown_connections 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55a8dacae0c0 0x55a8dacb04b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55a8daca9760 0x55a8dacabc20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe654039ac0 0x7fe65403bf80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 --2- 172.21.15.117:0/2265227185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a8dab86390 0x55a8dac75fb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 >> 172.21.15.117:0/2265227185 conn(0x55a8dab7df30 msgr2=0x55a8dac69190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 shutdown_connections 2024-09-10T06:24:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.866+0000 7fe76f5c39c0 1 -- 172.21.15.117:0/2265227185 wait complete. 2024-09-10T06:24:41.880 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T06:24:41.881 DEBUG:tasks.util.rgw: json result: {'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T06:24:41.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-10T06:24:41.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-10T06:24:41.881 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-10T06:24:41.951 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:41.952 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:41.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdec13699c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f0da484790 0x55f0da513140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdec13699c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0da3c49c0 con 0x55f0da513680 2024-09-10T06:24:41.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdec13699c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55f0da4146d0 con 0x55f0da484790 2024-09-10T06:24:41.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdebee6f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f0da484790 0x55f0da513140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdebe66e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55f0da513680 0x55f0da515a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54390/0 (socket says 172.21.15.117:54390) 2024-09-10T06:24:41.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdebe66e640 1 -- 172.21.15.117:0/4048993494 learned_addr learned my addr 172.21.15.117:0/4048993494 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:41.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdebee6f640 1 -- 172.21.15.117:0/4048993494 >> v1:172.21.15.84:6789/0 conn(0x55f0da513680 legacy=0x55f0da515a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.950+0000 7fdebee6f640 1 -- 172.21.15.117:0/4048993494 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da3b8ca0 con 0x55f0da484790 2024-09-10T06:24:41.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdebee6f640 1 --2- 172.21.15.117:0/4048993494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da513140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000a420 tx=0x7fdeb001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5b5e4933abac25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdebde6d640 1 -- 172.21.15.117:0/4048993494 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00b0070 con 0x55f0da484790 2024-09-10T06:24:41.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdebde6d640 1 -- 172.21.15.117:0/4048993494 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb00a3dc0 con 0x55f0da484790 2024-09-10T06:24:41.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdebde6d640 1 -- 172.21.15.117:0/4048993494 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00ab570 con 0x55f0da484790 2024-09-10T06:24:41.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 -- 172.21.15.117:0/4048993494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 msgr2=0x55f0da513140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 --2- 172.21.15.117:0/4048993494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da513140 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000a420 tx=0x7fdeb001afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 -- 172.21.15.117:0/4048993494 shutdown_connections 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 --2- 172.21.15.117:0/4048993494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da513140 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 -- 172.21.15.117:0/4048993494 >> 172.21.15.117:0/4048993494 conn(0x55f0da50ae70 msgr2=0x55f0da50d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 -- 172.21.15.117:0/4048993494 shutdown_connections 2024-09-10T06:24:41.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.954+0000 7fdec13699c0 1 -- 172.21.15.117:0/4048993494 wait complete. 2024-09-10T06:24:41.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0da418680 con 0x55f0da484790 2024-09-10T06:24:41.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45696/0 (socket says 172.21.15.117:45696) 2024-09-10T06:24:41.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdebee6f640 1 -- 172.21.15.117:0/3661501974 learned_addr learned my addr 172.21.15.117:0/3661501974 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdebee6f640 1 -- 172.21.15.117:0/3661501974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da393da0 con 0x55f0da484790 2024-09-10T06:24:41.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdebee6f640 1 --2- 172.21.15.117:0/3661501974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00a3d90 tx=0x7fdeb00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2a37eb48d26e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fddace09640 1 -- 172.21.15.117:0/3661501974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00b0040 con 0x55f0da484790 2024-09-10T06:24:41.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fddace09640 1 -- 172.21.15.117:0/3661501974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb00ab6b0 con 0x55f0da484790 2024-09-10T06:24:41.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fddace09640 1 -- 172.21.15.117:0/3661501974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00ab990 con 0x55f0da484790 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- 172.21.15.117:0/3661501974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 msgr2=0x55f0da5fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 --2- 172.21.15.117:0/3661501974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00a3d90 tx=0x7fdeb00033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- 172.21.15.117:0/3661501974 shutdown_connections 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 --2- 172.21.15.117:0/3661501974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da5fb8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- 172.21.15.117:0/3661501974 >> 172.21.15.117:0/3661501974 conn(0x55f0da50ae70 msgr2=0x55f0da5f7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- 172.21.15.117:0/3661501974 shutdown_connections 2024-09-10T06:24:41.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.970+0000 7fdec13699c0 1 -- 172.21.15.117:0/3661501974 wait complete. 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0da3baa50 con 0x55f0da484790 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45710/0 (socket says 172.21.15.117:45710) 2024-09-10T06:24:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 -- 172.21.15.117:0/1631226200 learned_addr learned my addr 172.21.15.117:0/1631226200 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da6032f0 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0008030 tx=0x7fdeb0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 -- 172.21.15.117:0/1631226200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00b0040 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0da603580 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 -- 172.21.15.117:0/1631226200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb00b4770 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 -- 172.21.15.117:0/1631226200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00b4a50 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0da603fb0 con 0x55f0da484790 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdec13699c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0da425450 con 0x55f0da60fa90 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebf670640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebf670640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45716/0 (socket says 172.21.15.117:45716) 2024-09-10T06:24:41.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebf670640 1 -- 172.21.15.117:0/2527249108 learned_addr learned my addr 172.21.15.117:0/2527249108 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 -- 172.21.15.117:0/1631226200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdeb00b4c80 con 0x55f0da484790 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 0x7fdda403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebf670640 1 -- 172.21.15.117:0/2527249108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da610480 con 0x55f0da60fa90 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fddab606640 1 -- 172.21.15.117:0/1631226200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdeb00ea370 con 0x55f0da484790 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 0x7fdda403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.974+0000 7fdebf670640 1 --2- 172.21.15.117:0/2527249108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a440 tx=0x7fdeb800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310d561d00ec70ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 0x7fdda403bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00bd020 tx=0x7fdeb00b4f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda9602640 1 -- 172.21.15.117:0/2527249108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8008850 con 0x55f0da60fa90 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda9602640 1 -- 172.21.15.117:0/2527249108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb8008a10 con 0x55f0da60fa90 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda9602640 1 -- 172.21.15.117:0/2527249108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8008d30 con 0x55f0da60fa90 2024-09-10T06:24:41.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/2527249108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 msgr2=0x55f0da60fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 --2- 172.21.15.117:0/2527249108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a440 tx=0x7fdeb800a900 comp rx=0 tx=0).stop 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/2527249108 shutdown_connections 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 --2- 172.21.15.117:0/2527249108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da60fe90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/2527249108 >> 172.21.15.117:0/2527249108 conn(0x55f0da513680 msgr2=0x55f0da60b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/2527249108 shutdown_connections 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/2527249108 wait complete. 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0da610c70 con 0x55f0da60fa90 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebf670640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebf670640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45722/0 (socket says 172.21.15.117:45722) 2024-09-10T06:24:41.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebf670640 1 -- 172.21.15.117:0/490083842 learned_addr learned my addr 172.21.15.117:0/490083842 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebf670640 1 -- 172.21.15.117:0/490083842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da617400 con 0x55f0da60fa90 2024-09-10T06:24:41.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdebf670640 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f0da610990 tx=0x7fdeb8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda37fe640 1 -- 172.21.15.117:0/490083842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8013a70 con 0x55f0da60fa90 2024-09-10T06:24:41.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda37fe640 1 -- 172.21.15.117:0/490083842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb8023070 con 0x55f0da60fa90 2024-09-10T06:24:41.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0da617690 con 0x55f0da60fa90 2024-09-10T06:24:41.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdda37fe640 1 -- 172.21.15.117:0/490083842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8013d80 con 0x55f0da60fa90 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.978+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0da618040 con 0x55f0da60fa90 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdda37fe640 1 -- 172.21.15.117:0/490083842 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdeb8028460 con 0x55f0da60fa90 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 Processor -- start 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdda37fe640 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 0x7fdd9803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdda37fe640 1 -- 172.21.15.117:0/490083842 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdeb8050600 con 0x55f0da60fa90 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 -- start start 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebf670640 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 0x7fdd9803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0da5fc080 con 0x55f0da632a20 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebf670640 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 0x7fdd9803bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8005800 tx=0x7fdeb8022fa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebee6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45724/0 (socket says 172.21.15.117:45724) 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebee6f640 1 -- 172.21.15.117:0/1725197803 learned_addr learned my addr 172.21.15.117:0/1725197803 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebee6f640 1 -- 172.21.15.117:0/1725197803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0da633480 con 0x55f0da632a20 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00bbcd0 tx=0x7fdeb00e87a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdd7effd640 1 -- 172.21.15.117:0/1725197803 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00aaeb0 con 0x55f0da632a20 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0da633c20 con 0x55f0da632a20 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdd7effd640 1 -- 172.21.15.117:0/1725197803 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb00bb8b0 con 0x55f0da632a20 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdd7effd640 1 -- 172.21.15.117:0/1725197803 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb00ad090 con 0x55f0da632a20 2024-09-10T06:24:41.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0da634190 con 0x55f0da632a20 2024-09-10T06:24:41.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.982+0000 7fdd7effd640 1 -- 172.21.15.117:0/1725197803 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdeb00dc040 con 0x55f0da632a20 2024-09-10T06:24:41.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdd7effd640 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 0x7fdcf803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdd7effd640 1 -- 172.21.15.117:0/1725197803 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fdeb00d3040 con 0x55f0da632a20 2024-09-10T06:24:41.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebe66e640 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 0x7fdcf803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdd7cff9640 20 reqs_thread_entry: start 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 0x55f0da63a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f0da63aee0 con 0x55f0da6383f0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebe66e640 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 0x7fdcf803bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdea8004180 tx=0x7fdea80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebf670640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 0x55f0da63a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebf670640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 0x55f0da63a860 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebf670640 1 -- 172.21.15.117:0/1631226200 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdeb801e7a0 con 0x55f0da6383f0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f0da63b400 con 0x55f0da6383f0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebf670640 1 -- 172.21.15.117:0/1631226200 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdeb801e7a0 con 0x55f0da6383f0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 0x55f0da63f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:3 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f0da63fc80 con 0x55f0da63d1f0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 0x55f0da63f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebee6f640 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 0x55f0da63f5e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:41.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdebee6f640 1 -- 172.21.15.117:0/1631226200 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(3 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdeb00f1070 con 0x55f0da63d1f0 2024-09-10T06:24:41.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 msgr2=0x7fdd9803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 0x7fdd9803bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8005800 tx=0x7fdeb8022fa0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 msgr2=0x55f0da616ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f0da610990 tx=0x7fdeb8003000 comp rx=0 tx=0).stop 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 shutdown_connections 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdd98039a70 0x7fdd9803bf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/490083842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da60fa90 0x55f0da616ea0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 >> 172.21.15.117:0/490083842 conn(0x55f0da513680 msgr2=0x55f0da60afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 shutdown_connections 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/490083842 wait complete. 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 msgr2=0x7fdcf803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 0x7fdcf803bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdea8004180 tx=0x7fdea80012c0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 msgr2=0x55f0da632e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00bbcd0 tx=0x7fdeb00e87a0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 shutdown_connections 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdcf8039a70 0x7fdcf803bf30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1725197803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da632a20 0x55f0da632e40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.986+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 >> 172.21.15.117:0/1725197803 conn(0x55f0da50f030 msgr2=0x55f0da50f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 shutdown_connections 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1725197803 wait complete. 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 msgr2=0x55f0da63a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 0x55f0da63a860 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 msgr2=0x55f0da63f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 0x55f0da63f5e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 msgr2=0x7fdda403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 0x7fdda403bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00bd020 tx=0x7fdeb00b4f70 comp rx=0 tx=0).stop 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 msgr2=0x55f0da602d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:41.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0008030 tx=0x7fdeb0017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 shutdown_connections 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f0da63d1f0 0x55f0da63f5e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f0da6383f0 0x55f0da63a860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fdda4039a70 0x7fdda403bf30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 --2- 172.21.15.117:0/1631226200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0da484790 0x55f0da602d90 secure :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0008030 tx=0x7fdeb0017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 >> 172.21.15.117:0/1631226200 conn(0x55f0da50ae70 msgr2=0x55f0da5f6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 shutdown_connections 2024-09-10T06:24:41.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:41.990+0000 7fdec13699c0 1 -- 172.21.15.117:0/1631226200 wait complete. 2024-09-10T06:24:42.002 INFO:teuthology.orchestra.run.smithi117.stdout:{"id":"1f11ec0c-dab3-4c88-849a-c22a32f07424","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"be621638-e902-4133-b94d-0397be1b6a7c","zones":[{"id":"be621638-e902-4133-b94d-0397be1b6a7c","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-10T06:24:42.002 DEBUG:tasks.util.rgw: json result: {'id': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'be621638-e902-4133-b94d-0397be1b6a7c', 'zones': [{'id': 'be621638-e902-4133-b94d-0397be1b6a7c', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-10T06:24:42.005 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-10T06:24:42.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T06:24:42.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T06:24:42.022 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-10T06:24:42.093 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:42.094 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:42.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.090+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.090+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.090+0000 7f5ce96e39c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55830a817c10 0x55830a81a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.090+0000 7f5ce96e39c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55830a6c99c0 con 0x55830a81a540 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.090+0000 7f5ce96e39c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55830a7196d0 con 0x55830a817c10 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.094+0000 7f5ce71e9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55830a817c10 0x55830a81a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.094+0000 7f5ce69e8640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55830a81a540 0x55830a81c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54406/0 (socket says 172.21.15.117:54406) 2024-09-10T06:24:42.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.094+0000 7f5ce69e8640 1 -- 172.21.15.117:0/956646529 learned_addr learned my addr 172.21.15.117:0/956646529 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:42.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.094+0000 7f5ce71e9640 1 -- 172.21.15.117:0/956646529 >> v1:172.21.15.84:6789/0 conn(0x55830a81a540 legacy=0x55830a81c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.094+0000 7f5ce71e9640 1 -- 172.21.15.117:0/956646529 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a6bdca0 con 0x55830a817c10 2024-09-10T06:24:42.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/956646529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a81a000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000a420 tx=0x7f5ce001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f709b363611793 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce61e7640 1 -- 172.21.15.117:0/956646529 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00af070 con 0x55830a817c10 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce61e7640 1 -- 172.21.15.117:0/956646529 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00aa530 con 0x55830a817c10 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce61e7640 1 -- 172.21.15.117:0/956646529 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00aa850 con 0x55830a817c10 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/956646529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 msgr2=0x55830a81a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/956646529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a81a000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000a420 tx=0x7f5ce001afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/956646529 shutdown_connections 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/956646529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a81a000 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/956646529 >> 172.21.15.117:0/956646529 conn(0x55830a78afa0 msgr2=0x55830a78b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/956646529 shutdown_connections 2024-09-10T06:24:42.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.098+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/956646529 wait complete. 2024-09-10T06:24:42.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.110+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.110+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.110+0000 7f5ce96e39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.110+0000 7f5ce96e39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55830a71d680 con 0x55830a817c10 2024-09-10T06:24:42.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45742/0 (socket says 172.21.15.117:45742) 2024-09-10T06:24:42.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 -- 172.21.15.117:0/231065495 learned_addr learned my addr 172.21.15.117:0/231065495 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 -- 172.21.15.117:0/231065495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a698da0 con 0x55830a817c10 2024-09-10T06:24:42.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/231065495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0017be0 tx=0x7f5ce00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52d1b9ef4302696 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5bd560a640 1 -- 172.21.15.117:0/231065495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00af040 con 0x55830a817c10 2024-09-10T06:24:42.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5bd560a640 1 -- 172.21.15.117:0/231065495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00abb00 con 0x55830a817c10 2024-09-10T06:24:42.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5bd560a640 1 -- 172.21.15.117:0/231065495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00abe00 con 0x55830a817c10 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/231065495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 msgr2=0x55830a902b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/231065495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0017be0 tx=0x7f5ce00033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/231065495 shutdown_connections 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/231065495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a902b10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/231065495 >> 172.21.15.117:0/231065495 conn(0x55830a78afa0 msgr2=0x55830a8fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/231065495 shutdown_connections 2024-09-10T06:24:42.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/231065495 wait complete. 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a909fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce96e39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55830a6bfa50 con 0x55830a817c10 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a909fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a909fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45748/0 (socket says 172.21.15.117:45748) 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 -- 172.21.15.117:0/566931195 learned_addr learned my addr 172.21.15.117:0/566931195 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.114+0000 7f5ce71e9640 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a90a520 con 0x55830a817c10 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a909fc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0017be0 tx=0x7f5ce0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 -- 172.21.15.117:0/566931195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00b57b0 con 0x55830a817c10 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 -- 172.21.15.117:0/566931195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00c6070 con 0x55830a817c10 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55830a90a7b0 con 0x55830a817c10 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 -- 172.21.15.117:0/566931195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00b5a80 con 0x55830a817c10 2024-09-10T06:24:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830a90b110 con 0x55830a817c10 2024-09-10T06:24:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 -- 172.21.15.117:0/566931195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ce00b5cb0 con 0x55830a817c10 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bcc039a70 0x7f5bcc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5bd3e07640 1 -- 172.21.15.117:0/566931195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5ce00bb070 con 0x55830a817c10 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bcc039a70 0x7f5bcc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a81a540 0x55830a9110e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a911620 con 0x55830a81a540 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a81a540 0x55830a9110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bcc039a70 0x7f5bcc03bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc004180 tx=0x7f5cdc001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a81a540 0x55830a9110e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce79ea640 1 -- 172.21.15.117:0/566931195 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a81a540 2024-09-10T06:24:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a911a00 con 0x55830a81a540 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce79ea640 1 -- 172.21.15.117:0/566931195 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a81a540 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a913810 0x55830a915c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a9162d0 con 0x55830a913810 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.118+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a913810 0x55830a915c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a913810 0x55830a915c00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 -- 172.21.15.117:0/566931195 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a913810 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a9126b0 con 0x55830a81a540 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce79ea640 1 -- 172.21.15.117:0/566931195 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a81a540 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a917710 0x55830a919b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a91a290 con 0x55830a917710 2024-09-10T06:24:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a917710 0x55830a919b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a917710 0x55830a919b00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce69e8640 1 -- 172.21.15.117:0/566931195 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a917710 2024-09-10T06:24:42.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55830a72a450 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45762/0 (socket says 172.21.15.117:45762) 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 -- 172.21.15.117:0/987718593 learned_addr learned my addr 172.21.15.117:0/987718593 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 -- 172.21.15.117:0/987718593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a9287b0 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00b3cd0 tx=0x7f5ce00c0f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5bd1602640 1 -- 172.21.15.117:0/987718593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00d71e0 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5bd1602640 1 -- 172.21.15.117:0/987718593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00e83c0 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55830a929010 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5bd1602640 1 -- 172.21.15.117:0/987718593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00e86c0 con 0x55830a927d50 2024-09-10T06:24:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.122+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830a929580 con 0x55830a927d50 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bd1602640 1 -- 172.21.15.117:0/987718593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ce00be3d0 con 0x55830a927d50 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bd1602640 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 0x7f5bc003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bd1602640 1 -- 172.21.15.117:0/987718593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5ce00de070 con 0x55830a927d50 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 0x7f5bc003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55830a903280 con 0x55830a935540 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 0x7f5bc003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55830a91a690 tx=0x7f5cdc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45764/0 (socket says 172.21.15.117:45764) 2024-09-10T06:24:42.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce71e9640 1 -- 172.21.15.117:0/2556749464 learned_addr learned my addr 172.21.15.117:0/2556749464 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce71e9640 1 -- 172.21.15.117:0/2556749464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a935ef0 con 0x55830a935540 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/2556749464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00e7fd0 tx=0x7f5ce00e2c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28c32b13a7af4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bcaffd640 1 -- 172.21.15.117:0/2556749464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00cc470 con 0x55830a935540 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bcaffd640 1 -- 172.21.15.117:0/2556749464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00e8860 con 0x55830a935540 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5bcaffd640 1 -- 172.21.15.117:0/2556749464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00be7f0 con 0x55830a935540 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/2556749464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 msgr2=0x55830a935920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/2556749464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00e7fd0 tx=0x7f5ce00e2c20 comp rx=0 tx=0).stop 2024-09-10T06:24:42.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/2556749464 shutdown_connections 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/2556749464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a935920 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/2556749464 >> 172.21.15.117:0/2556749464 conn(0x55830a930900 msgr2=0x55830a92eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/2556749464 shutdown_connections 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.126+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/2556749464 wait complete. 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 Processor -- start 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 -- start start 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55830a9342b0 con 0x55830a935540 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce71e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45776/0 (socket says 172.21.15.117:45776) 2024-09-10T06:24:42.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 learned_addr learned my addr 172.21.15.117:0/13932580 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a93bd20 con 0x55830a935540 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00d8960 tx=0x7f5ce00deea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 -- 172.21.15.117:0/13932580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00cc650 con 0x55830a935540 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 -- 172.21.15.117:0/13932580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce010d070 con 0x55830a935540 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55830a93bd20 con 0x55830a935540 2024-09-10T06:24:42.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 -- 172.21.15.117:0/13932580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce00cc960 con 0x55830a935540 2024-09-10T06:24:42.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830a93bd20 con 0x55830a935540 2024-09-10T06:24:42.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 -- 172.21.15.117:0/13932580 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5ce0105030 con 0x55830a935540 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bb0039a70 0x7f5bb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5bc97fa640 1 -- 172.21.15.117:0/13932580 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5ce00d9070 con 0x55830a935540 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bb0039a70 0x7f5bb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a9469b0 0x55830a948e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a9495c0 con 0x55830a9469b0 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.130+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a9469b0 0x55830a948e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bb0039a70 0x7f5bb003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c010 tx=0x7f5cdc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a9469b0 0x55830a948e70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 realm 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a9499d0 con 0x55830a9469b0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a2a0 con 0x55830a9469b0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a94b3a0 0x55830a94d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94dda0 con 0x55830a94b3a0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a94b3a0 0x55830a94d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a94b3a0 0x55830a94d790 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 20 searching for the correct realm 2024-09-10T06:24:42.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a94fcf0 0x55830a952100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a952780 con 0x55830a94fcf0 2024-09-10T06:24:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a94fcf0 0x55830a952100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce69e8640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a94fcf0 0x55830a952100 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a952780 con 0x55830a94b3a0 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5ce00e1020 0x7f5ce00d8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a952780 con 0x7f5ce00e1020 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.134+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5ce00e1020 0x7f5ce00d8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5ce00e1020 0x7f5ce00d8a30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94b3a0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.138+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94b3a0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.142+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94b3a0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94b3a0 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94fcf0 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x7f5ce00e1020 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.146+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a9469b0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55830a94a640 con 0x55830a94b3a0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94e660 con 0x55830a9469b0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94ea50 con 0x55830a9469b0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a94ea50 con 0x55830a94fcf0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 zone default found 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 4 Realm: () 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 zonegroup default 2024-09-10T06:24:42.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a952c00 con 0x7f5ce00e1020 2024-09-10T06:24:42.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a9546f0 con 0x55830a94fcf0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a954bf0 con 0x55830a94fcf0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 started sync module instance, tier type = 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.150+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a953a90 con 0x55830a94b3a0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021306629760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a9536f0 con 0x55830a94b3a0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a955b20 con 0x55830a9469b0 2024-09-10T06:24:42.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021306629760] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021306634320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a955b20 con 0x55830a9469b0 2024-09-10T06:24:42.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.154+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a9564e0 con 0x55830a94fcf0 2024-09-10T06:24:42.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021306634320] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021306635888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a955a90 con 0x55830a94fcf0 2024-09-10T06:24:42.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a957240 con 0x55830a94b3a0 2024-09-10T06:24:42.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021306641712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a957ae0 con 0x55830a94b3a0 2024-09-10T06:24:42.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a9584e0 con 0x55830a9469b0 2024-09-10T06:24:42.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021306635888] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.158+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021306641712] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021306640512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a957630 con 0x55830a9469b0 2024-09-10T06:24:42.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a958d80 con 0x7f5ce00e1020 2024-09-10T06:24:42.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021306640512] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021306646512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a957630 con 0x7f5ce00e1020 2024-09-10T06:24:42.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.162+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a959250 con 0x7f5ce00e1020 2024-09-10T06:24:42.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021306646512] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021306649920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a959210 con 0x7f5ce00e1020 2024-09-10T06:24:42.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a959c10 con 0x7f5ce00e1020 2024-09-10T06:24:42.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021306652448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a95a050 con 0x7f5ce00e1020 2024-09-10T06:24:42.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=0 2024-09-10T06:24:42.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=1 2024-09-10T06:24:42.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=2 2024-09-10T06:24:42.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=3 2024-09-10T06:24:42.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=4 2024-09-10T06:24:42.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=5 2024-09-10T06:24:42.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021306649920] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.166+0000 7f5ce96e39c0 20 add_watcher() i=6 2024-09-10T06:24:42.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021306652448] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 add_watcher() i=7 2024-09-10T06:24:42.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:42.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a958720 con 0x55830a9469b0 2024-09-10T06:24:42.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021306648272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a95a560 con 0x55830a9469b0 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021306648272] v32'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 5 note: GC not initialized 2024-09-10T06:24:42.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5b9cfe1640 20 reqs_thread_entry: start 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 Filter name: none 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5b167fc640 20 reqs_thread_entry: start 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.170+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a980790 con 0x7f5ce00e1020 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a97ee30 con 0x55830a9469b0 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T06:24:42.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a983d80 con 0x7f5ce00e1020 2024-09-10T06:24:42.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:42.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:42.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.174+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94021306822000 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a984650 con 0x55830a9469b0 2024-09-10T06:24:42.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== watch-notify(notify (1) cookie 94021306640512 notify 137438953495 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55830a97fbc0 con 0x55830a9469b0 2024-09-10T06:24:42.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bcaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94021306640512 notifier 4827 bl.length()=649 2024-09-10T06:24:42.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bcaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bcaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify cookie 94021306822000 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bcaffd640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5bac003eb0 con 0x55830a9469b0 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== watch-notify(notify_complete (2) cookie 94021306822000 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55830a97f420 con 0x55830a9469b0 2024-09-10T06:24:42.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a982210 con 0x55830a9469b0 2024-09-10T06:24:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T06:24:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T06:24:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-10T06:24:42.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94021306817888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55830a982180 con 0x55830a94fcf0 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== watch-notify(notify (1) cookie 94021306635888 notify 137438953480 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55830a6c99c0 con 0x55830a94fcf0 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94021306635888 notifier 4827 bl.length()=177 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(68 notify.2 [notify cookie 94021306817888 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5bca7fc640 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5b1c003410 con 0x55830a94fcf0 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== watch-notify(notify_complete (2) cookie 94021306817888 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5cdc038740 con 0x55830a94fcf0 2024-09-10T06:24:42.183 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:42.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.178+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021306648272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x55830a9469b0 2024-09-10T06:24:42.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94021306648272] v32'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021306629760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x55830a94b3a0 2024-09-10T06:24:42.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94021306629760] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce96e39c0 20 remove_watcher() i=0 2024-09-10T06:24:42.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce96e39c0 2 removed watcher, disabling cache 2024-09-10T06:24:42.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.182+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021306634320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x55830a9469b0 2024-09-10T06:24:42.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94021306634320] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 20 remove_watcher() i=1 2024-09-10T06:24:42.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021306635888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x55830a94fcf0 2024-09-10T06:24:42.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce69e8640 1 -- 172.21.15.117:0/13932580 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94021306635888] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cdc00e6c0 con 0x55830a94fcf0 2024-09-10T06:24:42.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 20 remove_watcher() i=2 2024-09-10T06:24:42.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021306641712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x55830a94b3a0 2024-09-10T06:24:42.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce71e9640 1 -- 172.21.15.117:0/13932580 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94021306641712] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ce00e5040 con 0x55830a94b3a0 2024-09-10T06:24:42.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 20 remove_watcher() i=3 2024-09-10T06:24:42.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.186+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021306640512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a956d30 con 0x55830a9469b0 2024-09-10T06:24:42.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.190+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94021306640512] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x55830a9469b0 2024-09-10T06:24:42.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.190+0000 7f5ce96e39c0 20 remove_watcher() i=4 2024-09-10T06:24:42.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.190+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021306646512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a97e430 con 0x7f5ce00e1020 2024-09-10T06:24:42.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.190+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94021306646512] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.190+0000 7f5ce96e39c0 20 remove_watcher() i=5 2024-09-10T06:24:42.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021306649920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a956880 con 0x7f5ce00e1020 2024-09-10T06:24:42.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94021306649920] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce96e39c0 20 remove_watcher() i=6 2024-09-10T06:24:42.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021306652448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55830a956d30 con 0x7f5ce00e1020 2024-09-10T06:24:42.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94021306652448] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd80083f0 con 0x7f5ce00e1020 2024-09-10T06:24:42.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.194+0000 7f5ce96e39c0 20 remove_watcher() i=7 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5ce00e1020 msgr2=0x7f5ce00d8a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f5ce00e1020 0x7f5ce00d8a30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a9469b0 msgr2=0x55830a948e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a9469b0 0x55830a948e70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a94b3a0 msgr2=0x55830a94d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a94b3a0 0x55830a94d790 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a94fcf0 msgr2=0x55830a952100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a94fcf0 0x55830a952100 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bb0039a70 msgr2=0x7f5bb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bb0039a70 0x7f5bb003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c010 tx=0x7f5cdc010000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 msgr2=0x55830a93b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce79ea640 1 -- 172.21.15.117:0/13932580 reap_dead start 2024-09-10T06:24:42.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00d8960 tx=0x7f5ce00deea0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 shutdown_connections 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/13932580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a935540 0x55830a93b7c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 >> 172.21.15.117:0/13932580 conn(0x55830a930900 msgr2=0x55830a92eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 shutdown_connections 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/13932580 wait complete. 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 msgr2=0x7f5bc003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 0x7f5bc003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55830a91a690 tx=0x7f5cdc00f000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 msgr2=0x55830a928170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00b3cd0 tx=0x7f5ce00c0f80 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 shutdown_connections 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bc0039a70 0x7f5bc003bf30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/987718593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a927d50 0x55830a928170 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 >> 172.21.15.117:0/987718593 conn(0x55830a91d700 msgr2=0x55830a91dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 shutdown_connections 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/987718593 wait complete. 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a81a540 msgr2=0x55830a9110e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55830a81a540 0x55830a9110e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a913810 msgr2=0x55830a915c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55830a913810 0x55830a915c00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a917710 msgr2=0x55830a919b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55830a917710 0x55830a919b00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bcc039a70 msgr2=0x7f5bcc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5bcc039a70 0x7f5bcc03bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc004180 tx=0x7f5cdc001340 comp rx=0 tx=0).stop 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 msgr2=0x55830a909fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 --2- 172.21.15.117:0/566931195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55830a817c10 0x55830a909fc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0017be0 tx=0x7f5ce0017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce79ea640 1 -- 172.21.15.117:0/566931195 reap_dead start 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 shutdown_connections 2024-09-10T06:24:42.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 >> 172.21.15.117:0/566931195 conn(0x55830a78afa0 msgr2=0x55830a8fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 shutdown_connections 2024-09-10T06:24:42.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.198+0000 7f5ce96e39c0 1 -- 172.21.15.117:0/566931195 wait complete. 2024-09-10T06:24:42.211 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.211 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.212 ERROR:root:0 2024-09-10T06:24:42.212 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:42.218 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002cd9be4ae35213fb-0066dfe62a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:24:42.219 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-10T06:24:42.233 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:42.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-10T06:24:42.250 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-10T06:24:42.251 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-10T06:24:42.273 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T06:24:42.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T06:24:42.284 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-10T06:24:42.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:42.287 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:42.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-10T06:24:42.292 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:42.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:42.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:42.293 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-10T06:24:42.328 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:42.328 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:42.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc9911cb9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c9f00f47b0 0x55c9f0185560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc9911cb9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9f00349c0 con 0x55c9f00f4b90 2024-09-10T06:24:42.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc9911cb9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c9f00846d0 con 0x55c9f00f47b0 2024-09-10T06:24:42.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98ecd1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c9f00f47b0 0x55c9f0185560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98ecd1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c9f00f47b0 0x55c9f0185560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45782/0 (socket says 172.21.15.117:45782) 2024-09-10T06:24:42.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98ecd1640 1 -- 172.21.15.117:0/2240717972 learned_addr learned my addr 172.21.15.117:0/2240717972 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98e4d0640 1 --1- 172.21.15.117:0/2240717972 >> v1:172.21.15.84:6789/0 conn(0x55c9f00f4b90 0x55c9f0187ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54412/0 (socket says 172.21.15.117:54412) 2024-09-10T06:24:42.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98ecd1640 1 -- 172.21.15.117:0/2240717972 >> v1:172.21.15.84:6789/0 conn(0x55c9f00f4b90 legacy=0x55c9f0187ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.326+0000 7fc98ecd1640 1 -- 172.21.15.117:0/2240717972 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f0028ca0 con 0x55c9f00f47b0 2024-09-10T06:24:42.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/2240717972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0185560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc98000a4e0 tx=0x7fc98001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98b43d1e5f9e2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc98dccf640 1 -- 172.21.15.117:0/2240717972 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800aa540 con 0x55c9f00f47b0 2024-09-10T06:24:42.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc98dccf640 1 -- 172.21.15.117:0/2240717972 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800aa6e0 con 0x55c9f00f47b0 2024-09-10T06:24:42.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc98dccf640 1 -- 172.21.15.117:0/2240717972 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800aaa40 con 0x55c9f00f47b0 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2240717972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 msgr2=0x55c9f0185560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/2240717972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0185560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc98000a4e0 tx=0x7fc98001b090 comp rx=0 tx=0).stop 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2240717972 shutdown_connections 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/2240717972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0185560 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2240717972 >> 172.21.15.117:0/2240717972 conn(0x55c9f017ae90 msgr2=0x55c9f017d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2240717972 shutdown_connections 2024-09-10T06:24:42.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.330+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2240717972 wait complete. 2024-09-10T06:24:42.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc9911cb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc9911cb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9f0088680 con 0x55c9f00f47b0 2024-09-10T06:24:42.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45794/0 (socket says 172.21.15.117:45794) 2024-09-10T06:24:42.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc98ecd1640 1 -- 172.21.15.117:0/1867458008 learned_addr learned my addr 172.21.15.117:0/1867458008 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.346+0000 7fc98ecd1640 1 -- 172.21.15.117:0/1867458008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f0003da0 con 0x55c9f00f47b0 2024-09-10T06:24:42.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/1867458008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc980018cc0 tx=0x7fc9800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c435740c11dead8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87ce09640 1 -- 172.21.15.117:0/1867458008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800b9070 con 0x55c9f00f47b0 2024-09-10T06:24:42.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87ce09640 1 -- 172.21.15.117:0/1867458008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800aaa80 con 0x55c9f00f47b0 2024-09-10T06:24:42.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87ce09640 1 -- 172.21.15.117:0/1867458008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800aad60 con 0x55c9f00f47b0 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1867458008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 msgr2=0x55c9f026da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1867458008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc980018cc0 tx=0x7fc9800033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1867458008 shutdown_connections 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1867458008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f026da60 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1867458008 >> 172.21.15.117:0/1867458008 conn(0x55c9f017ae90 msgr2=0x55c9f02696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1867458008 shutdown_connections 2024-09-10T06:24:42.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1867458008 wait complete. 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0274f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9f002aa50 con 0x55c9f00f47b0 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0274f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0274f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45800/0 (socket says 172.21.15.117:45800) 2024-09-10T06:24:42.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 -- 172.21.15.117:0/1140953094 learned_addr learned my addr 172.21.15.117:0/1140953094 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f0275480 con 0x55c9f00f47b0 2024-09-10T06:24:42.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0274f20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc980018cc0 tx=0x7fc980017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87b606640 1 -- 172.21.15.117:0/1140953094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800b9070 con 0x55c9f00f47b0 2024-09-10T06:24:42.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87b606640 1 -- 172.21.15.117:0/1140953094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800b5b10 con 0x55c9f00f47b0 2024-09-10T06:24:42.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9f0275710 con 0x55c9f00f47b0 2024-09-10T06:24:42.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc87b606640 1 -- 172.21.15.117:0/1140953094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800b5df0 con 0x55c9f00f47b0 2024-09-10T06:24:42.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.350+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f02760c0 con 0x55c9f00f47b0 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc87b606640 1 -- 172.21.15.117:0/1140953094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9800b3040 con 0x55c9f00f47b0 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc87b606640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc874039a70 0x7fc87403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc87b606640 1 -- 172.21.15.117:0/1140953094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc9800c4070 con 0x55c9f00f47b0 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc874039a70 0x7fc87403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f00f4b90 0x55c9f027c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f027c5d0 con 0x55c9f00f4b90 2024-09-10T06:24:42.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f00f4b90 0x55c9f027c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc874039a70 0x7fc87403bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc978001e90 tx=0x7fc9780013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f00f4b90 0x55c9f027c090 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98f4d2640 1 -- 172.21.15.117:0/1140953094 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f00f4b90 2024-09-10T06:24:42.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f0276480 con 0x55c9f00f4b90 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98f4d2640 1 -- 172.21.15.117:0/1140953094 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f00f4b90 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f027e870 0x55c9f0280c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02813a0 con 0x55c9f027e870 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f027e870 0x55c9f0280c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f027e870 0x55c9f0280c60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc98ecd1640 1 -- 172.21.15.117:0/1140953094 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9800cd060 con 0x55c9f027e870 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.354+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f027d6e0 con 0x55c9f00f4b90 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98f4d2640 1 -- 172.21.15.117:0/1140953094 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f00f4b90 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02827e0 0x55c9f0284bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02852c0 con 0x55c9f02827e0 2024-09-10T06:24:42.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02827e0 0x55c9f0284bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02827e0 0x55c9f0284bd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98e4d0640 1 -- 172.21.15.117:0/1140953094 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc97800f6e0 con 0x55c9f02827e0 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9f0095450 con 0x55c9f0292dc0 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45810/0 (socket says 172.21.15.117:45810) 2024-09-10T06:24:42.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98ecd1640 1 -- 172.21.15.117:0/3008285586 learned_addr learned my addr 172.21.15.117:0/3008285586 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98ecd1640 1 -- 172.21.15.117:0/3008285586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f0293820 con 0x55c9f0292dc0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b2cd0 tx=0x7fc9800b29f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc878e01640 1 -- 172.21.15.117:0/3008285586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800c64a0 con 0x55c9f0292dc0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc878e01640 1 -- 172.21.15.117:0/3008285586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800a93c0 con 0x55c9f0292dc0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9f0294080 con 0x55c9f0292dc0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc878e01640 1 -- 172.21.15.117:0/3008285586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800a96a0 con 0x55c9f0292dc0 2024-09-10T06:24:42.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.358+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f02945f0 con 0x55c9f0292dc0 2024-09-10T06:24:42.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc878e01640 1 -- 172.21.15.117:0/3008285586 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9800e1ec0 con 0x55c9f0292dc0 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc878e01640 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 0x7fc86803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc878e01640 1 -- 172.21.15.117:0/3008285586 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc980004610 con 0x55c9f0292dc0 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 0x7fc86803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 0x7fc86803bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55c9f0276820 tx=0x7fc97800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9f026e1f0 con 0x55c9f02a05c0 2024-09-10T06:24:42.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45816/0 (socket says 172.21.15.117:45816) 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98ecd1640 1 -- 172.21.15.117:0/2426923908 learned_addr learned my addr 172.21.15.117:0/2426923908 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98ecd1640 1 -- 172.21.15.117:0/2426923908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f02a0f90 con 0x55c9f02a05c0 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/2426923908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc9800abc20 tx=0x7fc9800e29f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c641cfe17c69d789 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc8727fc640 1 -- 172.21.15.117:0/2426923908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800e2b30 con 0x55c9f02a05c0 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc8727fc640 1 -- 172.21.15.117:0/2426923908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800b4740 con 0x55c9f02a05c0 2024-09-10T06:24:42.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc8727fc640 1 -- 172.21.15.117:0/2426923908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800ea1a0 con 0x55c9f02a05c0 2024-09-10T06:24:42.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2426923908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 msgr2=0x55c9f02a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/2426923908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc9800abc20 tx=0x7fc9800e29f0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2426923908 shutdown_connections 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/2426923908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a09a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2426923908 >> 172.21.15.117:0/2426923908 conn(0x55c9f029b980 msgr2=0x55c9f0299bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2426923908 shutdown_connections 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/2426923908 wait complete. 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 Processor -- start 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.362+0000 7fc9911cb9c0 1 -- start start 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9f029f330 con 0x55c9f02a05c0 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98ecd1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45830/0 (socket says 172.21.15.117:45830) 2024-09-10T06:24:42.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 learned_addr learned my addr 172.21.15.117:0/893276336 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f02a6d50 con 0x55c9f02a05c0 2024-09-10T06:24:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b4540 tx=0x7fc9800c7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 -- 172.21.15.117:0/893276336 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc98010d020 con 0x55c9f02a05c0 2024-09-10T06:24:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 -- 172.21.15.117:0/893276336 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800b4740 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9f02a6d50 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 -- 172.21.15.117:0/893276336 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9800ab190 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f02a6d50 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 -- 172.21.15.117:0/893276336 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc980110020 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc858039ac0 0x7fc85803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc870ff9640 1 -- 172.21.15.117:0/893276336 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc980105050 con 0x55c9f02a05c0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc858039ac0 0x7fc85803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f02b19d0 0x55c9f02b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b45e0 con 0x55c9f02b19d0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f02b19d0 0x55c9f02b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.366+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc858039ac0 0x7fc85803bf80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c9f02856c0 tx=0x7fc978010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f02b19d0 0x55c9f02b3e90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 realm 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b49f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b52c0 con 0x55c9f02b19d0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f02b63c0 0x55c9f02b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b8d70 con 0x55c9f02b63c0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f02b63c0 0x55c9f02b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f02b63c0 0x55c9f02b87b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 20 searching for the correct realm 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02bacc0 0x55c9f02bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bd7a0 con 0x55c9f02bacc0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02bacc0 0x55c9f02bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98e4d0640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02bacc0 0x55c9f02bd0d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bd7a0 con 0x55c9f02b63c0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc980112020 0x7fc9800bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bd7a0 con 0x7fc980112020 2024-09-10T06:24:42.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.370+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc980112020 0x7fc9800bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc980112020 0x7fc9800bd5d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9880083f0 con 0x7fc980112020 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9880083f0 con 0x55c9f02b19d0 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b63c0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.374+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b63c0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.378+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b63c0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b63c0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02bacc0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.382+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x7fc980112020 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b19d0 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b5660 con 0x55c9f02b63c0 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:42.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b9630 con 0x55c9f02b19d0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b9a20 con 0x55c9f02b19d0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02b9a20 con 0x55c9f02bacc0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 zone default found 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 4 Realm: () 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 zonegroup default 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bdc20 con 0x7fc980112020 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bf710 con 0x55c9f02bacc0 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02bfc10 con 0x55c9f02bacc0 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 started sync module instance, tier type = 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:42.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.386+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02beab0 con 0x55c9f02b63c0 2024-09-10T06:24:42.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94325806198432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02be710 con 0x55c9f02b63c0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c0b40 con 0x55c9f02b19d0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94325806204560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c0f60 con 0x55c9f02b19d0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c1a50 con 0x55c9f02bacc0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.390+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94325806198432] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94325806204560] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94325806202992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c0f60 con 0x55c9f02bacc0 2024-09-10T06:24:42.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c22f0 con 0x55c9f02b63c0 2024-09-10T06:24:42.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94325806210896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c2a20 con 0x55c9f02b63c0 2024-09-10T06:24:42.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c3520 con 0x55c9f02b19d0 2024-09-10T06:24:42.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.394+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94325806202992] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94325806210896] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94325806215184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c34e0 con 0x55c9f02b19d0 2024-09-10T06:24:42.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c3df0 con 0x7fc980112020 2024-09-10T06:24:42.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94325806215184] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94325806205616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c34e0 con 0x7fc980112020 2024-09-10T06:24:42.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.398+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c42b0 con 0x7fc980112020 2024-09-10T06:24:42.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.402+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94325806205616] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.402+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.402+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94325806217456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c4270 con 0x7fc980112020 2024-09-10T06:24:42.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.402+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c4c90 con 0x7fc980112020 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.402+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94325806217456] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94325806221184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c4c50 con 0x7fc980112020 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=0 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=1 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=2 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=3 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=4 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=5 2024-09-10T06:24:42.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=6 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94325806221184] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 20 add_watcher() i=7 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c8080 con 0x55c9f02b19d0 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94325806218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c55d0 con 0x55c9f02b19d0 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94325806218512] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc988026040 con 0x55c9f02b19d0 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.406+0000 7fc8457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 5 note: GC not initialized 2024-09-10T06:24:42.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc7bffff640 20 reqs_thread_entry: start 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 Filter name: none 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc7bdffb640 20 reqs_thread_entry: start 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02eb780 con 0x7fc980112020 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T06:24:42.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:42.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:42.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.410+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02f2490 con 0x7fc980112020 2024-09-10T06:24:42.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc988026040 con 0x7fc980112020 2024-09-10T06:24:42.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc9911cb9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:42.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc9911cb9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc9911cb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94325806407424 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02edb60 con 0x55c9f02b19d0 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94325806215184 notify 137438953497 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fc988010040 con 0x55c9f02b19d0 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc8727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94325806215184 notifier 4834 bl.length()=636 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc8727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc8727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94325806407424 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc98803d020 con 0x55c9f02b19d0 2024-09-10T06:24:42.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc8727fc640 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc854003eb0 con 0x55c9f02b19d0 2024-09-10T06:24:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x55c9f02b19d0 2024-09-10T06:24:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94325806407424 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc98800ab50 con 0x55c9f02b19d0 2024-09-10T06:24:42.417 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc8457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.414+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94325806218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02e9480 con 0x55c9f02b19d0 2024-09-10T06:24:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94325806218512] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x55c9f02b19d0 2024-09-10T06:24:42.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94325806198432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02e9480 con 0x55c9f02b63c0 2024-09-10T06:24:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94325806198432] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 20 remove_watcher() i=0 2024-09-10T06:24:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 2 removed watcher, disabling cache 2024-09-10T06:24:42.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94325806204560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02beea0 con 0x55c9f02b19d0 2024-09-10T06:24:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94325806204560] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x55c9f02b19d0 2024-09-10T06:24:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 20 remove_watcher() i=1 2024-09-10T06:24:42.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.418+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94325806202992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02e9480 con 0x55c9f02bacc0 2024-09-10T06:24:42.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc98e4d0640 1 -- 172.21.15.117:0/893276336 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94325806202992] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc978037040 con 0x55c9f02bacc0 2024-09-10T06:24:42.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc9911cb9c0 20 remove_watcher() i=2 2024-09-10T06:24:42.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94325806210896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c0690 con 0x55c9f02b63c0 2024-09-10T06:24:42.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc98ecd1640 1 -- 172.21.15.117:0/893276336 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94325806210896] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9800f1070 con 0x55c9f02b63c0 2024-09-10T06:24:42.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc9911cb9c0 20 remove_watcher() i=3 2024-09-10T06:24:42.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.422+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94325806215184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02beea0 con 0x55c9f02b19d0 2024-09-10T06:24:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94325806215184] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x55c9f02b19d0 2024-09-10T06:24:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc9911cb9c0 20 remove_watcher() i=4 2024-09-10T06:24:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94325806205616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c0070 con 0x7fc980112020 2024-09-10T06:24:42.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94325806205616] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x7fc980112020 2024-09-10T06:24:42.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc9911cb9c0 20 remove_watcher() i=5 2024-09-10T06:24:42.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.426+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94325806217456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02beea0 con 0x7fc980112020 2024-09-10T06:24:42.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.430+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94325806217456] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x7fc980112020 2024-09-10T06:24:42.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.430+0000 7fc9911cb9c0 20 remove_watcher() i=6 2024-09-10T06:24:42.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.430+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94325806221184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9f02c3d80 con 0x7fc980112020 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94325806221184] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803d020 con 0x7fc980112020 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 20 remove_watcher() i=7 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc980112020 msgr2=0x7fc9800bd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fc980112020 0x7fc9800bd5d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f02b19d0 msgr2=0x55c9f02b3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f02b19d0 0x55c9f02b3e90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f02b63c0 msgr2=0x55c9f02b87b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f02b63c0 0x55c9f02b87b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02bacc0 msgr2=0x55c9f02bd0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02bacc0 0x55c9f02bd0d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc858039ac0 msgr2=0x7fc85803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc858039ac0 0x7fc85803bf80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55c9f02856c0 tx=0x7fc978010000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 msgr2=0x55c9f02a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc98f4d2640 1 -- 172.21.15.117:0/893276336 reap_dead start 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b4540 tx=0x7fc9800c7f90 comp rx=0 tx=0).stop 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 shutdown_connections 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/893276336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f02a05c0 0x55c9f02a67f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 >> 172.21.15.117:0/893276336 conn(0x55c9f029b980 msgr2=0x55c9f0299b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 shutdown_connections 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/893276336 wait complete. 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 msgr2=0x7fc86803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 0x7fc86803bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55c9f0276820 tx=0x7fc97800f000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 msgr2=0x55c9f02931e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc9800b2cd0 tx=0x7fc9800b29f0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 shutdown_connections 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc868039ac0 0x7fc86803bf80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/3008285586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f0292dc0 0x55c9f02931e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 >> 172.21.15.117:0/3008285586 conn(0x55c9f0288770 msgr2=0x55c9f0288b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 shutdown_connections 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/3008285586 wait complete. 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f00f4b90 msgr2=0x55c9f027c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c9f00f4b90 0x55c9f027c090 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f027e870 msgr2=0x55c9f0280c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c9f027e870 0x55c9f0280c60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02827e0 msgr2=0x55c9f0284bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c9f02827e0 0x55c9f0284bd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc874039a70 msgr2=0x7fc87403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc874039a70 0x7fc87403bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc978001e90 tx=0x7fc9780013f0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 msgr2=0x55c9f0274f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 --2- 172.21.15.117:0/1140953094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c9f00f47b0 0x55c9f0274f20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc980018cc0 tx=0x7fc980017e30 comp rx=0 tx=0).stop 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc98f4d2640 1 -- 172.21.15.117:0/1140953094 reap_dead start 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 shutdown_connections 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 >> 172.21.15.117:0/1140953094 conn(0x55c9f017ae90 msgr2=0x55c9f0268130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 shutdown_connections 2024-09-10T06:24:42.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.434+0000 7fc9911cb9c0 1 -- 172.21.15.117:0/1140953094 wait complete. 2024-09-10T06:24:42.449 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.449 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.449 ERROR:root:0 2024-09-10T06:24:42.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T06:24:42.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T06:24:42.450 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-10T06:24:42.538 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:42.538 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:42.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbd9a59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5617d343ef20 0x5617d34cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbd9a59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617d337e9c0 con 0x5617d34cd6c0 2024-09-10T06:24:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbd9a59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5617d33ce6d0 con 0x5617d343ef20 2024-09-10T06:24:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbb4ab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5617d343ef20 0x5617d34cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbb4ab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5617d343ef20 0x5617d34cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45840/0 (socket says 172.21.15.117:45840) 2024-09-10T06:24:42.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbb4ab640 1 -- 172.21.15.117:0/3257804468 learned_addr learned my addr 172.21.15.117:0/3257804468 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbacaa640 1 --1- 172.21.15.117:0/3257804468 >> v1:172.21.15.84:6789/0 conn(0x5617d34cd6c0 0x5617d34cfab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54416/0 (socket says 172.21.15.117:54416) 2024-09-10T06:24:42.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbb4ab640 1 -- 172.21.15.117:0/3257804468 >> v1:172.21.15.84:6789/0 conn(0x5617d34cd6c0 legacy=0x5617d34cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.538+0000 7facbb4ab640 1 -- 172.21.15.117:0/3257804468 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d3372ca0 con 0x5617d343ef20 2024-09-10T06:24:42.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbb4ab640 1 --2- 172.21.15.117:0/3257804468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d34cd180 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7facac00a4e0 tx=0x7facac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc0c519ea991bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facba4a9640 1 -- 172.21.15.117:0/3257804468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0aa540 con 0x5617d343ef20 2024-09-10T06:24:42.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facba4a9640 1 -- 172.21.15.117:0/3257804468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0aa6e0 con 0x5617d343ef20 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facba4a9640 1 -- 172.21.15.117:0/3257804468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0aaa40 con 0x5617d343ef20 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3257804468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 msgr2=0x5617d34cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3257804468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d34cd180 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7facac00a4e0 tx=0x7facac01b090 comp rx=0 tx=0).stop 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3257804468 shutdown_connections 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3257804468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d34cd180 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3257804468 >> 172.21.15.117:0/3257804468 conn(0x5617d34c4e70 msgr2=0x5617d34c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3257804468 shutdown_connections 2024-09-10T06:24:42.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.542+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3257804468 wait complete. 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5617d33d2680 con 0x5617d343ef20 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45854/0 (socket says 172.21.15.117:45854) 2024-09-10T06:24:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbb4ab640 1 -- 172.21.15.117:0/974685030 learned_addr learned my addr 172.21.15.117:0/974685030 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbb4ab640 1 -- 172.21.15.117:0/974685030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d334dda0 con 0x5617d343ef20 2024-09-10T06:24:42.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbb4ab640 1 --2- 172.21.15.117:0/974685030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7facac019740 tx=0x7facac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e537a077b989e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7faba960a640 1 -- 172.21.15.117:0/974685030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b9070 con 0x5617d343ef20 2024-09-10T06:24:42.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7faba960a640 1 -- 172.21.15.117:0/974685030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0aaa90 con 0x5617d343ef20 2024-09-10T06:24:42.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7faba960a640 1 -- 172.21.15.117:0/974685030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0aad70 con 0x5617d343ef20 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- 172.21.15.117:0/974685030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 msgr2=0x5617d35b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/974685030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7facac019740 tx=0x7facac0033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- 172.21.15.117:0/974685030 shutdown_connections 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/974685030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35b58c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- 172.21.15.117:0/974685030 >> 172.21.15.117:0/974685030 conn(0x5617d34c4e70 msgr2=0x5617d35b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- 172.21.15.117:0/974685030 shutdown_connections 2024-09-10T06:24:42.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- 172.21.15.117:0/974685030 wait complete. 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.558+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5617d3374a50 con 0x5617d343ef20 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35bcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45864/0 (socket says 172.21.15.117:45864) 2024-09-10T06:24:42.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbb4ab640 1 -- 172.21.15.117:0/3432094837 learned_addr learned my addr 172.21.15.117:0/3432094837 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbb4ab640 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d35bd270 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbb4ab640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35bcd10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7facac018cc0 tx=0x7facac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 -- 172.21.15.117:0/3432094837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b9070 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617d35bd500 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 -- 172.21.15.117:0/3432094837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0b5b10 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 -- 172.21.15.117:0/3432094837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b5df0 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d35bdeb0 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 -- 172.21.15.117:0/3432094837 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7facac0b3040 con 0x5617d343ef20 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faba0039a70 0x7faba003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7faba7e07640 1 -- 172.21.15.117:0/3432094837 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facac0c4070 con 0x5617d343ef20 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d34cd6c0 0x5617d35c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35c43c0 con 0x5617d34cd6c0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbacaa640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faba0039a70 0x7faba003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbbcac640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d34cd6c0 0x5617d35c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbbcac640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d34cd6c0 0x5617d35c3e80 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.562+0000 7facbacaa640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faba0039a70 0x7faba003bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faca4001e90 tx=0x7faca40013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbbcac640 1 -- 172.21.15.117:0/3432094837 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb40083f0 con 0x5617d34cd6c0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35be1f0 con 0x5617d34cd6c0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbbcac640 1 -- 172.21.15.117:0/3432094837 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facb40083f0 con 0x5617d34cd6c0 2024-09-10T06:24:42.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d35c6630 0x5617d35c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35c9110 con 0x5617d35c6630 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d35c6630 0x5617d35c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d35c6630 0x5617d35c8a20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 -- 172.21.15.117:0/3432094837 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d35c6630 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35c5500 con 0x5617d34cd6c0 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbbcac640 1 -- 172.21.15.117:0/3432094837 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facb40083f0 con 0x5617d34cd6c0 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d35ca570 0x5617d35cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35cd050 con 0x5617d35ca570 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbacaa640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d35ca570 0x5617d35cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbacaa640 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d35ca570 0x5617d35cc960 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbacaa640 1 -- 172.21.15.117:0/3432094837 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faca400f6e0 con 0x5617d35ca570 2024-09-10T06:24:42.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbd9a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5617d33df450 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45876/0 (socket says 172.21.15.117:45876) 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.566+0000 7facbb4ab640 1 -- 172.21.15.117:0/3825130558 learned_addr learned my addr 172.21.15.117:0/3825130558 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 -- 172.21.15.117:0/3825130558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d35db590 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7facac0c6ae0 tx=0x7facac0c76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 -- 172.21.15.117:0/3825130558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b71d0 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 -- 172.21.15.117:0/3825130558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0e1070 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 -- 172.21.15.117:0/3825130558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b4bd0 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617d35dbdf0 con 0x5617d35dab30 2024-09-10T06:24:42.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d35dbdf0 con 0x5617d35dab30 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 -- 172.21.15.117:0/3825130558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7facac0b3330 con 0x5617d35dab30 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 0x7fab9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7faba5602640 1 -- 172.21.15.117:0/3825130558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facac0edbf0 con 0x5617d35dab30 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbacaa640 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 0x7fab9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbacaa640 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 0x7fab9403bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5617d35c4800 tx=0x7faca400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbd9a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5617d35b6030 con 0x5617d35e8090 2024-09-10T06:24:42.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45882/0 (socket says 172.21.15.117:45882) 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 -- 172.21.15.117:0/1344264815 learned_addr learned my addr 172.21.15.117:0/1344264815 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.570+0000 7facbb4ab640 1 -- 172.21.15.117:0/1344264815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d35e8a60 con 0x5617d35e8090 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 --2- 172.21.15.117:0/1344264815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7facac0dcd50 tx=0x7facac0edf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7c3900ab1565d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9effd640 1 -- 172.21.15.117:0/1344264815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0f1030 con 0x5617d35e8090 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9effd640 1 -- 172.21.15.117:0/1344264815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0e9db0 con 0x5617d35e8090 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9effd640 1 -- 172.21.15.117:0/1344264815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0b4d70 con 0x5617d35e8090 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/1344264815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 msgr2=0x5617d35e8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/1344264815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7facac0dcd50 tx=0x7facac0edf30 comp rx=0 tx=0).stop 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/1344264815 shutdown_connections 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/1344264815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d35e8470 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/1344264815 >> 172.21.15.117:0/1344264815 conn(0x5617d35e3450 msgr2=0x5617d35e1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/1344264815 shutdown_connections 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/1344264815 wait complete. 2024-09-10T06:24:42.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 Processor -- start 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- start start 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d34ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5617d35e6e00 con 0x5617d35e8090 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d34ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d34ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45898/0 (socket says 172.21.15.117:45898) 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 learned_addr learned my addr 172.21.15.117:0/814303077 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d34cadc0 con 0x5617d35e8090 2024-09-10T06:24:42.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbb4ab640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d34ca860 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7facac0dcd50 tx=0x7facac0b9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9d7fa640 1 -- 172.21.15.117:0/814303077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac111070 con 0x5617d35e8090 2024-09-10T06:24:42.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617d34cadc0 con 0x5617d35e8090 2024-09-10T06:24:42.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9d7fa640 1 -- 172.21.15.117:0/814303077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac0b4e40 con 0x5617d35e8090 2024-09-10T06:24:42.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d34cadc0 con 0x5617d35e8090 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.574+0000 7fab9d7fa640 1 -- 172.21.15.117:0/814303077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facac0c9620 con 0x5617d35e8090 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7fab9d7fa640 1 -- 172.21.15.117:0/814303077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7facac0dc790 con 0x5617d35e8090 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7fab9d7fa640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab84039a20 0x7fab8403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7fab9d7fa640 1 -- 172.21.15.117:0/814303077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7facac109070 con 0x5617d35e8090 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbacaa640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab84039a20 0x7fab8403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d35fb700 0x5617d35fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35fe310 con 0x5617d35fb700 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d35fb700 0x5617d35fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbacaa640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab84039a20 0x7fab8403bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5617d35cd430 tx=0x7faca4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d35fb700 0x5617d35fdbc0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb40083f0 con 0x5617d35fb700 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 realm 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35fe720 con 0x5617d35fb700 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb40083f0 con 0x5617d35fb700 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35feff0 con 0x5617d35fb700 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb40083f0 con 0x5617d35fb700 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facb40083f0 con 0x5617d35fb700 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d36000f0 0x5617d36024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3602ab0 con 0x5617d36000f0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbb4ab640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d36000f0 0x5617d36024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbb4ab640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d36000f0 0x5617d36024e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 20 searching for the correct realm 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d3604a00 0x5617d3606e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d36074b0 con 0x5617d3604a00 2024-09-10T06:24:42.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbacaa640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d3604a00 0x5617d3606e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.578+0000 7facbacaa640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d3604a00 0x5617d3606e30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d36074b0 con 0x5617d36000f0 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbb4ab640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7facac0e2270 0x7facac0ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d36074b0 con 0x7facac0e2270 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7facac0e2270 0x7facac0ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7facac0e2270 0x7facac0ed050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb40083f0 con 0x7facac0e2270 2024-09-10T06:24:42.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb40083f0 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d36000f0 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.582+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d36000f0 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.586+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d36000f0 2024-09-10T06:24:42.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d36000f0 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.590+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d3604a00 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x7facac0e2270 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d35fb700 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617d35ff390 con 0x5617d36000f0 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:42.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3603370 con 0x5617d35fb700 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3603760 con 0x5617d35fb700 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3603760 con 0x5617d3604a00 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:42.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 zone default found 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 4 Realm: () 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 zonegroup default 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3607930 con 0x7facac0e2270 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3609450 con 0x5617d3604a00 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.594+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3609960 con 0x5617d3604a00 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 20 started sync module instance, tier type = 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d36087c0 con 0x5617d36000f0 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94660330556336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3608420 con 0x5617d36000f0 2024-09-10T06:24:42.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360a890 con 0x5617d35fb700 2024-09-10T06:24:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94660330556336] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94660330560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360a890 con 0x5617d35fb700 2024-09-10T06:24:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.598+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360b250 con 0x5617d3604a00 2024-09-10T06:24:42.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94660330565024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360baa0 con 0x5617d3604a00 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360c4c0 con 0x5617d36000f0 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94660330560960] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94660330569648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360c8b0 con 0x5617d36000f0 2024-09-10T06:24:42.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.602+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360d270 con 0x5617d35fb700 2024-09-10T06:24:42.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94660330565024] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94660330569648] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94660330562528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360cdc0 con 0x5617d35fb700 2024-09-10T06:24:42.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360d610 con 0x7facac0e2270 2024-09-10T06:24:42.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94660330562528] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.606+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94660330573248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360d690 con 0x7facac0e2270 2024-09-10T06:24:42.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360dee0 con 0x7facac0e2270 2024-09-10T06:24:42.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94660330573248] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94660330574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360dd70 con 0x7facac0e2270 2024-09-10T06:24:42.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.610+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360e870 con 0x7facac0e2270 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94660330574784] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94660330578784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360e830 con 0x7facac0e2270 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=0 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=1 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=2 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=3 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=4 2024-09-10T06:24:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=5 2024-09-10T06:24:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=6 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94660330578784] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 20 add_watcher() i=7 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3611cc0 con 0x5617d35fb700 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.614+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94660330575840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d360f170 con 0x5617d35fb700 2024-09-10T06:24:42.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94660330575840] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7fab71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 5 note: GC not initialized 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7fab70fe1640 20 reqs_thread_entry: start 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 Filter name: none 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7faaea7fc640 20 reqs_thread_entry: start 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3635380 con 0x7facac0e2270 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3633a20 con 0x5617d3604a00 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-10T06:24:42.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T06:24:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T06:24:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T06:24:42.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.618+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3638970 con 0x7facac0e2270 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94660330748256 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3638270 con 0x5617d36000f0 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== watch-notify(notify (1) cookie 94660330556336 notify 137438953505 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5617d35db590 con 0x5617d36000f0 2024-09-10T06:24:42.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7fab9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94660330556336 notifier 4841 bl.length()=533 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7fab9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7fab9effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(65 notify.0 [notify cookie 94660330748256 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7fab9effd640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fab80003eb0 con 0x5617d36000f0 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== watch-notify(notify_complete (2) cookie 94660330748256 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7facac0e8040 con 0x5617d36000f0 2024-09-10T06:24:42.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3636950 con 0x5617d3604a00 2024-09-10T06:24:42.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T06:24:42.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.622+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94660330751648 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617d3636950 con 0x5617d35fb700 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94660330560960 notify 137438953498 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5617d3638d10 con 0x5617d35fb700 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7fab9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94660330560960 notifier 4841 bl.length()=176 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7fab9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7fab9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(68 notify.1 [notify cookie 94660330751648 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7fab9e7fc640 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faaf0003410 con 0x5617d35fb700 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94660330751648 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5617d3634040 con 0x5617d35fb700 2024-09-10T06:24:42.629 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-10T06:24:42.622221Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.622203Z","tags":[],"group_ids":[]} 2024-09-10T06:24:42.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7fab71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94660330575840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3633080 con 0x5617d35fb700 2024-09-10T06:24:42.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94660330575840] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.626+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94660330556336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3633080 con 0x5617d36000f0 2024-09-10T06:24:42.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94660330556336] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbd9a59c0 20 remove_watcher() i=0 2024-09-10T06:24:42.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbd9a59c0 2 removed watcher, disabling cache 2024-09-10T06:24:42.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94660330560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3608bb0 con 0x5617d35fb700 2024-09-10T06:24:42.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94660330560960] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbd9a59c0 20 remove_watcher() i=1 2024-09-10T06:24:42.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.630+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94660330565024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3633080 con 0x5617d3604a00 2024-09-10T06:24:42.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbacaa640 1 -- 172.21.15.117:0/814303077 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94660330565024] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faca4037040 con 0x5617d3604a00 2024-09-10T06:24:42.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbd9a59c0 20 remove_watcher() i=2 2024-09-10T06:24:42.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94660330569648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3609dc0 con 0x5617d36000f0 2024-09-10T06:24:42.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbb4ab640 1 -- 172.21.15.117:0/814303077 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94660330569648] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facac0c6d80 con 0x5617d36000f0 2024-09-10T06:24:42.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbd9a59c0 20 remove_watcher() i=3 2024-09-10T06:24:42.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94660330562528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3608bb0 con 0x5617d35fb700 2024-09-10T06:24:42.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.634+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94660330562528] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x5617d35fb700 2024-09-10T06:24:42.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.638+0000 7facbd9a59c0 20 remove_watcher() i=4 2024-09-10T06:24:42.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.638+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94660330573248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3633080 con 0x7facac0e2270 2024-09-10T06:24:42.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.638+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94660330573248] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.638+0000 7facbd9a59c0 20 remove_watcher() i=5 2024-09-10T06:24:42.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.638+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94660330574784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3609dc0 con 0x7facac0e2270 2024-09-10T06:24:42.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94660330574784] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 20 remove_watcher() i=6 2024-09-10T06:24:42.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94660330578784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617d3608bb0 con 0x7facac0e2270 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94660330578784] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb4027040 con 0x7facac0e2270 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 20 remove_watcher() i=7 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7facac0e2270 msgr2=0x7facac0ed050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7facac0e2270 0x7facac0ed050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d35fb700 msgr2=0x5617d35fdbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d35fb700 0x5617d35fdbc0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d36000f0 msgr2=0x5617d36024e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d36000f0 0x5617d36024e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d3604a00 msgr2=0x5617d3606e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d3604a00 0x5617d3606e30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab84039a20 msgr2=0x7fab8403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab84039a20 0x7fab8403bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5617d35cd430 tx=0x7faca4010000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 msgr2=0x5617d34ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/814303077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35e8090 0x5617d34ca860 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7facac0dcd50 tx=0x7facac0b9f60 comp rx=0 tx=0).stop 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 reap_dead start 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbbcac640 1 -- 172.21.15.117:0/814303077 reap_dead start 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 shutdown_connections 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 >> 172.21.15.117:0/814303077 conn(0x5617d35e3450 msgr2=0x5617d35e1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 shutdown_connections 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.642+0000 7facbd9a59c0 1 -- 172.21.15.117:0/814303077 wait complete. 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 msgr2=0x7fab9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 0x7fab9403bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5617d35c4800 tx=0x7faca400f000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 msgr2=0x5617d35daf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7facac0c6ae0 tx=0x7facac0c76c0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 shutdown_connections 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fab94039a70 0x7fab9403bf30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3825130558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d35dab30 0x5617d35daf50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 >> 172.21.15.117:0/3825130558 conn(0x5617d35d04e0 msgr2=0x5617d35d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 shutdown_connections 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3825130558 wait complete. 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d34cd6c0 msgr2=0x5617d35c3e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5617d34cd6c0 0x5617d35c3e80 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d35c6630 msgr2=0x5617d35c8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5617d35c6630 0x5617d35c8a20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d35ca570 msgr2=0x5617d35cc960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5617d35ca570 0x5617d35cc960 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faba0039a70 msgr2=0x7faba003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7faba0039a70 0x7faba003bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faca4001e90 tx=0x7faca40013f0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 msgr2=0x5617d35bcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 --2- 172.21.15.117:0/3432094837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5617d343ef20 0x5617d35bcd10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7facac018cc0 tx=0x7facac017e30 comp rx=0 tx=0).stop 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbbcac640 1 -- 172.21.15.117:0/3432094837 reap_dead start 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 shutdown_connections 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 >> 172.21.15.117:0/3432094837 conn(0x5617d34c4e70 msgr2=0x5617d35afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 shutdown_connections 2024-09-10T06:24:42.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.646+0000 7facbd9a59c0 1 -- 172.21.15.117:0/3432094837 wait complete. 2024-09-10T06:24:42.658 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T06:24:42.622221Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.622203Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.659 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T06:24:42.622221Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.622203Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:42.659 ERROR:root:0 2024-09-10T06:24:42.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:42.664 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:42.664 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-10T06:24:42.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-10T06:24:42.664 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-10T06:24:42.738 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:42.739 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:42.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0689b139c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563ca8d4a6f0 0x563ca8d4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0689b139c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ca8c009c0 con 0x563ca8d4b040 2024-09-10T06:24:42.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0689b139c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x563ca8c506d0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0687619640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x563ca8d4a6f0 0x563ca8d4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0686e18640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x563ca8d4b040 0x563ca8d51a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54420/0 (socket says 172.21.15.117:54420) 2024-09-10T06:24:42.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0686e18640 1 -- 172.21.15.117:0/1077932714 learned_addr learned my addr 172.21.15.117:0/1077932714 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:42.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0687619640 1 -- 172.21.15.117:0/1077932714 >> v1:172.21.15.84:6789/0 conn(0x563ca8d4b040 legacy=0x563ca8d51a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.738+0000 7f0687619640 1 -- 172.21.15.117:0/1077932714 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8bf4ca0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0687619640 1 --2- 172.21.15.117:0/1077932714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8d4aad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f067800a480 tx=0x7f067801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff1a35dc273abc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0686617640 1 -- 172.21.15.117:0/1077932714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b0070 con 0x563ca8d4a6f0 2024-09-10T06:24:42.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0686617640 1 -- 172.21.15.117:0/1077932714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780ab540 con 0x563ca8d4a6f0 2024-09-10T06:24:42.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0686617640 1 -- 172.21.15.117:0/1077932714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780ab840 con 0x563ca8d4a6f0 2024-09-10T06:24:42.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 -- 172.21.15.117:0/1077932714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 msgr2=0x563ca8d4aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1077932714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8d4aad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f067800a480 tx=0x7f067801b280 comp rx=0 tx=0).stop 2024-09-10T06:24:42.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 -- 172.21.15.117:0/1077932714 shutdown_connections 2024-09-10T06:24:42.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1077932714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8d4aad0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 -- 172.21.15.117:0/1077932714 >> 172.21.15.117:0/1077932714 conn(0x563ca8d46640 msgr2=0x563ca8d48a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 -- 172.21.15.117:0/1077932714 shutdown_connections 2024-09-10T06:24:42.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.742+0000 7f0689b139c0 1 -- 172.21.15.117:0/1077932714 wait complete. 2024-09-10T06:24:42.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ca8c54680 con 0x563ca8d4a6f0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45914/0 (socket says 172.21.15.117:45914) 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 -- 172.21.15.117:0/285410620 learned_addr learned my addr 172.21.15.117:0/285410620 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 -- 172.21.15.117:0/285410620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8bcfda0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 --2- 172.21.15.117:0/285410620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f06780ae040 tx=0x7f0678003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa886b463a5afcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f057560a640 1 -- 172.21.15.117:0/285410620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b0070 con 0x563ca8d4a6f0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f057560a640 1 -- 172.21.15.117:0/285410620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780b1040 con 0x563ca8d4a6f0 2024-09-10T06:24:42.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f057560a640 1 -- 172.21.15.117:0/285410620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780ab6f0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- 172.21.15.117:0/285410620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 msgr2=0x563ca8e377a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 --2- 172.21.15.117:0/285410620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f06780ae040 tx=0x7f0678003030 comp rx=0 tx=0).stop 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- 172.21.15.117:0/285410620 shutdown_connections 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 --2- 172.21.15.117:0/285410620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e377a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- 172.21.15.117:0/285410620 >> 172.21.15.117:0/285410620 conn(0x563ca8d46640 msgr2=0x563ca8e33440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- 172.21.15.117:0/285410620 shutdown_connections 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- 172.21.15.117:0/285410620 wait complete. 2024-09-10T06:24:42.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e3ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0689b139c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ca8bf6a50 con 0x563ca8d4a6f0 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e3ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e3ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45922/0 (socket says 172.21.15.117:45922) 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.758+0000 7f0687619640 1 -- 172.21.15.117:0/1417586194 learned_addr learned my addr 172.21.15.117:0/1417586194 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687619640 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8e3f240 con 0x563ca8d4a6f0 2024-09-10T06:24:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687619640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e3ece0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f06780ab510 tx=0x7f0678018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 -- 172.21.15.117:0/1417586194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b75b0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 -- 172.21.15.117:0/1417586194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780b7750 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 -- 172.21.15.117:0/1417586194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b7a30 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ca8e3f4d0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca8e3fe80 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 -- 172.21.15.117:0/1417586194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06780b7bd0 con 0x563ca8d4a6f0 2024-09-10T06:24:42.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f056c039a70 0x7f056c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0573e07640 1 -- 172.21.15.117:0/1417586194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f06780bc070 con 0x563ca8d4a6f0 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0686e18640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f056c039a70 0x7f056c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8d4b040 0x563ca8e45e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e46390 con 0x563ca8d4b040 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687e1a640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8d4b040 0x563ca8e45e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0686e18640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f056c039a70 0x7f056c03bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f067c004180 tx=0x7f067c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687e1a640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8d4b040 0x563ca8e45e50 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687e1a640 1 -- 172.21.15.117:0/1417586194 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8d4b040 2024-09-10T06:24:42.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e46790 con 0x563ca8d4b040 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.762+0000 7f0687e1a640 1 -- 172.21.15.117:0/1417586194 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8d4b040 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e485a0 0x563ca8e4a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e4b060 con 0x563ca8e485a0 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e485a0 0x563ca8e4a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e485a0 0x563ca8e4a990 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 -- 172.21.15.117:0/1417586194 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06780cf070 con 0x563ca8e485a0 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e47440 con 0x563ca8d4b040 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687e1a640 1 -- 172.21.15.117:0/1417586194 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8d4b040 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e4c4a0 0x563ca8e4e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e4f020 con 0x563ca8e4c4a0 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0686e18640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e4c4a0 0x563ca8e4e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0686e18640 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e4c4a0 0x563ca8e4e890 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0686e18640 1 -- 172.21.15.117:0/1417586194 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e4c4a0 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0689b139c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ca8c61450 con 0x563ca8e5cae0 2024-09-10T06:24:42.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45924/0 (socket says 172.21.15.117:45924) 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 -- 172.21.15.117:0/597271841 learned_addr learned my addr 172.21.15.117:0/597271841 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 -- 172.21.15.117:0/597271841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8e5d540 con 0x563ca8e5cae0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.766+0000 7f0687619640 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f06780b6950 tx=0x7f06780aa760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 -- 172.21.15.117:0/597271841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b5750 con 0x563ca8e5cae0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ca8e5dda0 con 0x563ca8e5cae0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 -- 172.21.15.117:0/597271841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780e9a60 con 0x563ca8e5cae0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 -- 172.21.15.117:0/597271841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780b58f0 con 0x563ca8e5cae0 2024-09-10T06:24:42.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca8e5e310 con 0x563ca8e5cae0 2024-09-10T06:24:42.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 -- 172.21.15.117:0/597271841 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f06780e9d40 con 0x563ca8e5cae0 2024-09-10T06:24:42.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0571602640 1 -- 172.21.15.117:0/597271841 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f06780db070 con 0x563ca8e5cae0 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0686e18640 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0686e18640 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 0x7f056003bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563ca8e4f420 tx=0x7f067c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0689b139c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ca8e37f30 con 0x563ca8d4b9e0 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45938/0 (socket says 172.21.15.117:45938) 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0687619640 1 -- 172.21.15.117:0/3270071765 learned_addr learned my addr 172.21.15.117:0/3270071765 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0687619640 1 -- 172.21.15.117:0/3270071765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8d4c390 con 0x563ca8d4b9e0 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f0687619640 1 --2- 172.21.15.117:0/3270071765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f06780c3fd0 tx=0x7f06780c9890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf4ae03b3f574f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f056affd640 1 -- 172.21.15.117:0/3270071765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780fb070 con 0x563ca8d4b9e0 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f056affd640 1 -- 172.21.15.117:0/3270071765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780c9630 con 0x563ca8d4b9e0 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.770+0000 7f056affd640 1 -- 172.21.15.117:0/3270071765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780aad30 con 0x563ca8d4b9e0 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/3270071765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 msgr2=0x563ca8d4bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 --2- 172.21.15.117:0/3270071765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f06780c3fd0 tx=0x7f06780c9890 comp rx=0 tx=0).stop 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/3270071765 shutdown_connections 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 --2- 172.21.15.117:0/3270071765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8d4bdc0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/3270071765 >> 172.21.15.117:0/3270071765 conn(0x563ca8e65690 msgr2=0x563ca8e638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/3270071765 shutdown_connections 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/3270071765 wait complete. 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 Processor -- start 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- start start 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8e72780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ca8d4c8f0 con 0x563ca8d4b9e0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8e72780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0687619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8e72780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45952/0 (socket says 172.21.15.117:45952) 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 learned_addr learned my addr 172.21.15.117:0/80858682 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca8e72ce0 con 0x563ca8d4b9e0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0687619640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8e72780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f06780c98d0 tx=0x7f06780f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 -- 172.21.15.117:0/80858682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067810f070 con 0x563ca8d4b9e0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ca8e72ce0 con 0x563ca8d4b9e0 2024-09-10T06:24:42.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 -- 172.21.15.117:0/80858682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06780c9630 con 0x563ca8d4b9e0 2024-09-10T06:24:42.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 -- 172.21.15.117:0/80858682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06780aa810 con 0x563ca8d4b9e0 2024-09-10T06:24:42.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca8e72ce0 con 0x563ca8d4b9e0 2024-09-10T06:24:42.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 -- 172.21.15.117:0/80858682 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0678112070 con 0x563ca8d4b9e0 2024-09-10T06:24:42.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0550039a70 0x7f055003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.774+0000 7f05697fa640 1 -- 172.21.15.117:0/80858682 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0678107050 con 0x563ca8d4b9e0 2024-09-10T06:24:42.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0550039a70 0x7f055003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8e7d940 0x563ca8e7fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e80520 con 0x563ca8e7d940 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8e7d940 0x563ca8e7fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0550039a70 0x7f055003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c010 tx=0x7f067c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8e7d940 0x563ca8e7fdd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 realm 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e80930 con 0x563ca8e7d940 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e81200 con 0x563ca8e7d940 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e82300 0x563ca8e846f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e84cc0 con 0x563ca8e82300 2024-09-10T06:24:42.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e82300 0x563ca8e846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e82300 0x563ca8e846f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 20 searching for the correct realm 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e86c10 0x563ca8e89040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e896c0 con 0x563ca8e86c10 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e86c10 0x563ca8e89040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e86c10 0x563ca8e89040 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e896c0 con 0x563ca8e82300 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0678114060 0x7f0678100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.778+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e896c0 con 0x7f0678114060 2024-09-10T06:24:42.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0678114060 0x7f0678100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0678114060 0x7f0678100a40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e82300 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.782+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e82300 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e82300 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.786+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e82300 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e86c10 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x7f0678114060 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e7d940 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e815a0 con 0x563ca8e82300 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.790+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e85580 con 0x563ca8e7d940 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e85970 con 0x563ca8e7d940 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e85970 con 0x563ca8e86c10 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 zone default found 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 4 Realm: () 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 zonegroup default 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e89b40 con 0x7f0678114060 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8b630 con 0x563ca8e86c10 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8bb20 con 0x563ca8e86c10 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 started sync module instance, tier type = 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8a9d0 con 0x563ca8e82300 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94818531847616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8a630 con 0x563ca8e82300 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.794+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8ca50 con 0x563ca8e7d940 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.798+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94818531847616] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.798+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.798+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94818531853728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8ce70 con 0x563ca8e7d940 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.798+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8d830 con 0x563ca8e86c10 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.798+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94818531853728] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94818531854784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8cde0 con 0x563ca8e86c10 2024-09-10T06:24:42.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8e530 con 0x563ca8e82300 2024-09-10T06:24:42.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94818531862816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8f1f0 con 0x563ca8e82300 2024-09-10T06:24:42.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8fbb0 con 0x563ca8e7d940 2024-09-10T06:24:42.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94818531862816] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94818531854784] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94818531863872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e8fbb0 con 0x563ca8e7d940 2024-09-10T06:24:42.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.802+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e90450 con 0x7f0678114060 2024-09-10T06:24:42.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94818531863872] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94818531866640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e901e0 con 0x7f0678114060 2024-09-10T06:24:42.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e90cd0 con 0x7f0678114060 2024-09-10T06:24:42.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94818531866640] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94818531870624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e90c90 con 0x7f0678114060 2024-09-10T06:24:42.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.806+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e91690 con 0x7f0678114060 2024-09-10T06:24:42.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94818531870624] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94818531867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e91650 con 0x7f0678114060 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=0 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=1 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=2 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=3 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=4 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=5 2024-09-10T06:24:42.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=6 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94818531867696] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 20 add_watcher() i=7 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.810+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e94ab0 con 0x563ca8e7d940 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94818531873648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e92000 con 0x563ca8e7d940 2024-09-10T06:24:42.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94818531873648] v32'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f053dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0689b139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:42.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0689b139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:42.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9d430 con 0x563ca8e7d940 2024-09-10T06:24:42.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.814+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9da40 con 0x7f0678114060 2024-09-10T06:24:42.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9dfb0 con 0x563ca8e86c10 2024-09-10T06:24:42.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9e460 con 0x563ca8e7d940 2024-09-10T06:24:42.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'247 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.818+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9b1b0 con 0x563ca8e82300 2024-09-10T06:24:42.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9b150 con 0x563ca8e86c10 2024-09-10T06:24:42.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9efc0 con 0x563ca8e7d940 2024-09-10T06:24:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.822+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9f050 con 0x7f0678114060 2024-09-10T06:24:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.826+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.826+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9f050 con 0x563ca8e82300 2024-09-10T06:24:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.826+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.826+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9f500 con 0x563ca8e86c10 2024-09-10T06:24:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.830+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.830+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a140 con 0x563ca8e82300 2024-09-10T06:24:42.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.830+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.830+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a140 con 0x7f0678114060 2024-09-10T06:24:42.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a140 con 0x563ca8e82300 2024-09-10T06:24:42.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a140 con 0x7f0678114060 2024-09-10T06:24:42.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.834+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a790 con 0x563ca8e7d940 2024-09-10T06:24:42.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'248 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e82300 2024-09-10T06:24:42.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.838+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a270 con 0x563ca8e7d940 2024-09-10T06:24:42.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9a270 con 0x563ca8e7d940 2024-09-10T06:24:42.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'249 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.842+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e82300 2024-09-10T06:24:42.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.846+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.850+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x7f0678114060 2024-09-10T06:24:42.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.854+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.854+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.854+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.854+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x7f0678114060 2024-09-10T06:24:42.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.858+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.858+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x563ca8e86c10 2024-09-10T06:24:42.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.858+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.858+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99ac0 con 0x7f0678114060 2024-09-10T06:24:42.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e99b30 con 0x563ca8e82300 2024-09-10T06:24:42.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f053cfe1640 20 reqs_thread_entry: start 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 20 Filter name: none 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f04b67fc640 20 reqs_thread_entry: start 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:42.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.862+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9c5b0 con 0x7f0678114060 2024-09-10T06:24:42.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-10T06:24:42.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-10T06:24:42.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T06:24:42.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:42.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8ebd270 con 0x7f0678114060 2024-09-10T06:24:42.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 removing key index: system_akey 2024-09-10T06:24:42.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8ebd270 con 0x563ca8e86c10 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94818531917712 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8ebdb30 con 0x563ca8e7d940 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== watch-notify(notify (1) cookie 94818531853728 notify 137438953499 ret 0) ==== 203+0+0 (crc 0 0 0) 0x563ca8e9ab80 con 0x563ca8e7d940 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f056affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94818531853728 notifier 4848 bl.length()=161 2024-09-10T06:24:42.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(97 notify.1 [notify cookie 94818531917712 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f056affd640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f054c003d70 con 0x563ca8e7d940 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== watch-notify(notify_complete (2) cookie 94818531917712 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563ca8e9ce90 con 0x563ca8e7d940 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 removing email index: 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 10 removing user buckets index 2024-09-10T06:24:42.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.866+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x7f0678114060 2024-09-10T06:24:42.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0689b139c0 10 removing user index: system_user 2024-09-10T06:24:42.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x7f0678114060 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0689b139c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0689b139c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94818532045344 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e82300 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== watch-notify(notify (1) cookie 94818531847616 notify 137438953506 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563ca8e9a8a0 con 0x563ca8e82300 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(101 notify.0 [notify cookie 94818532045344 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f056a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94818531847616 notifier 4848 bl.length()=160 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.870+0000 7f056a7fc640 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f04bc0032d0 con 0x563ca8e82300 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== watch-notify(notify_complete (2) cookie 94818532045344 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563ca8e5d540 con 0x563ca8e82300 2024-09-10T06:24:42.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f053dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:42.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94818531873648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e7d940 2024-09-10T06:24:42.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94818531873648] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94818531847616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e82300 2024-09-10T06:24:42.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94818531847616] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0689b139c0 20 remove_watcher() i=0 2024-09-10T06:24:42.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0689b139c0 2 removed watcher, disabling cache 2024-09-10T06:24:42.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.874+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94818531853728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e7d940 2024-09-10T06:24:42.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.878+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94818531853728] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.878+0000 7f0689b139c0 20 remove_watcher() i=1 2024-09-10T06:24:42.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.878+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94818531854784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e86c10 2024-09-10T06:24:42.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0686e18640 1 -- 172.21.15.117:0/80858682 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94818531854784] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c00e6c0 con 0x563ca8e86c10 2024-09-10T06:24:42.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 20 remove_watcher() i=2 2024-09-10T06:24:42.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94818531862816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e82300 2024-09-10T06:24:42.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0687619640 1 -- 172.21.15.117:0/80858682 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94818531862816] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0678111030 con 0x563ca8e82300 2024-09-10T06:24:42.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 20 remove_watcher() i=3 2024-09-10T06:24:42.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94818531863872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x563ca8e7d940 2024-09-10T06:24:42.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94818531863872] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x563ca8e7d940 2024-09-10T06:24:42.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 20 remove_watcher() i=4 2024-09-10T06:24:42.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.882+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94818531866640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x7f0678114060 2024-09-10T06:24:42.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94818531866640] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0689b139c0 20 remove_watcher() i=5 2024-09-10T06:24:42.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94818531870624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x7f0678114060 2024-09-10T06:24:42.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94818531870624] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0689b139c0 20 remove_watcher() i=6 2024-09-10T06:24:42.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.886+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94818531867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563ca8e9bf90 con 0x7f0678114060 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94818531867696] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068000a4d0 con 0x7f0678114060 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 20 remove_watcher() i=7 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0678114060 msgr2=0x7f0678100a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f0678114060 0x7f0678100a40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8e7d940 msgr2=0x563ca8e7fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8e7d940 0x563ca8e7fdd0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e82300 msgr2=0x563ca8e846f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e82300 0x563ca8e846f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e86c10 msgr2=0x563ca8e89040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e86c10 0x563ca8e89040 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0550039a70 msgr2=0x7f055003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0550039a70 0x7f055003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c010 tx=0x7f067c010000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 msgr2=0x563ca8e72780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/80858682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4b9e0 0x563ca8e72780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f06780c98d0 tx=0x7f06780f5000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 reap_dead start 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0687e1a640 1 -- 172.21.15.117:0/80858682 reap_dead start 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 shutdown_connections 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 >> 172.21.15.117:0/80858682 conn(0x563ca8e65690 msgr2=0x563ca8e638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 shutdown_connections 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/80858682 wait complete. 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 msgr2=0x7f056003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 0x7f056003bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563ca8e4f420 tx=0x7f067c00f000 comp rx=0 tx=0).stop 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 msgr2=0x563ca8e5cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f06780b6950 tx=0x7f06780aa760 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 shutdown_connections 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/597271841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8e5cae0 0x563ca8e5cf00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 >> 172.21.15.117:0/597271841 conn(0x563ca8e52490 msgr2=0x563ca8e52870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 shutdown_connections 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/597271841 wait complete. 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8d4b040 msgr2=0x563ca8e45e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x563ca8d4b040 0x563ca8e45e50 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e485a0 msgr2=0x563ca8e4a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x563ca8e485a0 0x563ca8e4a990 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e4c4a0 msgr2=0x563ca8e4e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x563ca8e4c4a0 0x563ca8e4e890 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f056c039a70 msgr2=0x7f056c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f056c039a70 0x7f056c03bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f067c004180 tx=0x7f067c001340 comp rx=0 tx=0).stop 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 msgr2=0x563ca8e3ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 --2- 172.21.15.117:0/1417586194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ca8d4a6f0 0x563ca8e3ece0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f06780ab510 tx=0x7f0678018020 comp rx=0 tx=0).stop 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0687e1a640 1 -- 172.21.15.117:0/1417586194 reap_dead start 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 shutdown_connections 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 >> 172.21.15.117:0/1417586194 conn(0x563ca8d46640 msgr2=0x563ca8e31ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 shutdown_connections 2024-09-10T06:24:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.890+0000 7f0689b139c0 1 -- 172.21.15.117:0/1417586194 wait complete. 2024-09-10T06:24:42.906 ERROR:root:None 2024-09-10T06:24:42.907 ERROR:root:0 2024-09-10T06:24:42.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T06:24:42.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T06:24:42.907 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-10T06:24:42.994 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:42.994 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.990+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891f3f79c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x560561571300 0x5605615716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891f3f79c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605614269c0 con 0x5605615744e0 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891f3f79c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5605614766d0 con 0x560561571300 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891cefd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x560561571300 0x5605615716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891c6fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5605615744e0 0x5605615768d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54432/0 (socket says 172.21.15.117:54432) 2024-09-10T06:24:42.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891c6fc640 1 -- 172.21.15.117:0/1076661652 learned_addr learned my addr 172.21.15.117:0/1076661652 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:42.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891cefd640 1 -- 172.21.15.117:0/1076661652 >> v1:172.21.15.84:6789/0 conn(0x5605615744e0 legacy=0x5605615768d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891cefd640 1 -- 172.21.15.117:0/1076661652 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56056141aca0 con 0x560561571300 2024-09-10T06:24:42.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891cefd640 1 --2- 172.21.15.117:0/1076661652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x5605615716e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f891400a420 tx=0x7f891401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a07a708b0cb4de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:42.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.994+0000 7f891befb640 1 -- 172.21.15.117:0/1076661652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140af070 con 0x560561571300 2024-09-10T06:24:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891befb640 1 -- 172.21.15.117:0/1076661652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140aa530 con 0x560561571300 2024-09-10T06:24:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891befb640 1 -- 172.21.15.117:0/1076661652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140aa850 con 0x560561571300 2024-09-10T06:24:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 -- 172.21.15.117:0/1076661652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 msgr2=0x5605615716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/1076661652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x5605615716e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f891400a420 tx=0x7f891401afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:42.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 -- 172.21.15.117:0/1076661652 shutdown_connections 2024-09-10T06:24:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/1076661652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x5605615716e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 -- 172.21.15.117:0/1076661652 >> 172.21.15.117:0/1076661652 conn(0x56056156ce20 msgr2=0x56056156f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 -- 172.21.15.117:0/1076661652 shutdown_connections 2024-09-10T06:24:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:42.998+0000 7f891f3f79c0 1 -- 172.21.15.117:0/1076661652 wait complete. 2024-09-10T06:24:43.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:43.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:43.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891f3f79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891f3f79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56056147a680 con 0x560561571300 2024-09-10T06:24:43.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45966/0 (socket says 172.21.15.117:45966) 2024-09-10T06:24:43.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891cefd640 1 -- 172.21.15.117:0/4125025774 learned_addr learned my addr 172.21.15.117:0/4125025774 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891cefd640 1 -- 172.21.15.117:0/4125025774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605613f5da0 con 0x560561571300 2024-09-10T06:24:43.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f891cefd640 1 --2- 172.21.15.117:0/4125025774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8914018c00 tx=0x7f89140033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a8e3c2b761bd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f880ae0d640 1 -- 172.21.15.117:0/4125025774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140af040 con 0x560561571300 2024-09-10T06:24:43.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f880ae0d640 1 -- 172.21.15.117:0/4125025774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140aaa00 con 0x560561571300 2024-09-10T06:24:43.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.010+0000 7f880ae0d640 1 -- 172.21.15.117:0/4125025774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140aace0 con 0x560561571300 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4125025774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 msgr2=0x56056165d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4125025774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8914018c00 tx=0x7f89140033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4125025774 shutdown_connections 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4125025774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x56056165d870 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4125025774 >> 172.21.15.117:0/4125025774 conn(0x56056156ce20 msgr2=0x5605614e6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4125025774 shutdown_connections 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4125025774 wait complete. 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x560561664d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56056141ca50 con 0x560561571300 2024-09-10T06:24:43.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x560561664d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x560561664d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45974/0 (socket says 172.21.15.117:45974) 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891cefd640 1 -- 172.21.15.117:0/2059055540 learned_addr learned my addr 172.21.15.117:0/2059055540 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891cefd640 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560561665280 con 0x560561571300 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891cefd640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x560561664d20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8914018c00 tx=0x7f8914017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f880960a640 1 -- 172.21.15.117:0/2059055540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140c5070 con 0x560561571300 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f880960a640 1 -- 172.21.15.117:0/2059055540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140c1690 con 0x560561571300 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560561665510 con 0x560561571300 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f880960a640 1 -- 172.21.15.117:0/2059055540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140c19b0 con 0x560561571300 2024-09-10T06:24:43.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560561665f40 con 0x560561571300 2024-09-10T06:24:43.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.014+0000 7f880960a640 1 -- 172.21.15.117:0/2059055540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f89140b5470 con 0x560561571300 2024-09-10T06:24:43.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f880960a640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8804039ac0 0x7f880403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f880960a640 1 -- 172.21.15.117:0/2059055540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f89140bb070 con 0x560561571300 2024-09-10T06:24:43.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891c6fc640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8804039ac0 0x7f880403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605615744e0 0x56056166be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56056166c3d0 con 0x5605615744e0 2024-09-10T06:24:43.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891d6fe640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605615744e0 0x56056166be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891c6fc640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8804039ac0 0x7f880403bf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8910001d80 tx=0x7f89100012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891d6fe640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605615744e0 0x56056166be90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891d6fe640 1 -- 172.21.15.117:0/2059055540 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890c0083f0 con 0x5605615744e0 2024-09-10T06:24:43.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560561666280 con 0x5605615744e0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891d6fe640 1 -- 172.21.15.117:0/2059055540 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f890c0083f0 con 0x5605615744e0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56056166e690 0x560561670a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560561671150 con 0x56056166e690 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891cefd640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56056166e690 0x560561670a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891cefd640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56056166e690 0x560561670a80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891cefd640 1 -- 172.21.15.117:0/2059055540 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89140c7070 con 0x56056166e690 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56056166d500 con 0x5605615744e0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891d6fe640 1 -- 172.21.15.117:0/2059055540 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f890c0083f0 con 0x5605615744e0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560561672590 0x560561674980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616750f0 con 0x560561672590 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891c6fc640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560561672590 0x560561674980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891c6fc640 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560561672590 0x560561674980 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891c6fc640 1 -- 172.21.15.117:0/2059055540 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f891000e620 con 0x560561672590 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.018+0000 7f891f3f79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560561487450 con 0x560561682b70 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45982/0 (socket says 172.21.15.117:45982) 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 -- 172.21.15.117:0/3070753166 learned_addr learned my addr 172.21.15.117:0/3070753166 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 -- 172.21.15.117:0/3070753166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605616835d0 con 0x560561682b70 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f89140e96e0 tx=0x7f89140bfe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 -- 172.21.15.117:0/3070753166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140de020 con 0x560561682b70 2024-09-10T06:24:43.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560561683e30 con 0x560561682b70 2024-09-10T06:24:43.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 -- 172.21.15.117:0/3070753166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140b5940 con 0x560561682b70 2024-09-10T06:24:43.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 -- 172.21.15.117:0/3070753166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140b5c40 con 0x560561682b70 2024-09-10T06:24:43.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605616843a0 con 0x560561682b70 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 -- 172.21.15.117:0/3070753166 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f89140e2550 con 0x560561682b70 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 0x7f87f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f88027fc640 1 -- 172.21.15.117:0/3070753166 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f89140d7050 con 0x560561682b70 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891c6fc640 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 0x7f87f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:43.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891c6fc640 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 0x7f87f403bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f891000bf50 tx=0x7f891000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891f3f79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56056165e000 con 0x560561657ec0 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:45992/0 (socket says 172.21.15.117:45992) 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 -- 172.21.15.117:0/236292758 learned_addr learned my addr 172.21.15.117:0/236292758 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.022+0000 7f891cefd640 1 -- 172.21.15.117:0/236292758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560561658800 con 0x560561657ec0 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 --2- 172.21.15.117:0/236292758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89140b48a0 tx=0x7f89140b43d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d73357797c5ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f3fff640 1 -- 172.21.15.117:0/236292758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140b4590 con 0x560561657ec0 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f3fff640 1 -- 172.21.15.117:0/236292758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140eaee0 con 0x560561657ec0 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f3fff640 1 -- 172.21.15.117:0/236292758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140c0510 con 0x560561657ec0 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/236292758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 msgr2=0x5605616582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/236292758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89140b48a0 tx=0x7f89140b43d0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/236292758 shutdown_connections 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/236292758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x5605616582c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/236292758 >> 172.21.15.117:0/236292758 conn(0x56056168b6f0 msgr2=0x560561689930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/236292758 shutdown_connections 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/236292758 wait complete. 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 Processor -- start 2024-09-10T06:24:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- start start 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560561658dd0 con 0x560561657ec0 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46006/0 (socket says 172.21.15.117:46006) 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 learned_addr learned my addr 172.21.15.117:0/4262518388 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560561698d80 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891cefd640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89140e84b0 tx=0x7f89140eb1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f27fc640 1 -- 172.21.15.117:0/4262518388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891410e020 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560561698d80 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f27fc640 1 -- 172.21.15.117:0/4262518388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89140c0760 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560561698d80 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.026+0000 7f87f27fc640 1 -- 172.21.15.117:0/4262518388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140c0a40 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f87f27fc640 1 -- 172.21.15.117:0/4262518388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8914111020 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f87f27fc640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87e8039a20 0x7f87e803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f87f27fc640 1 -- 172.21.15.117:0/4262518388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8914114bb0 con 0x560561657ec0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87e8039a20 0x7f87e803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605616a3a60 0x5605616a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616a6640 con 0x5605616a3a60 2024-09-10T06:24:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605616a3a60 0x5605616a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87e8039a20 0x7f87e803bee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5605616754d0 tx=0x7f8910010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605616a3a60 0x5605616a5ef0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890c0083f0 con 0x5605616a3a60 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 realm 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616a6a50 con 0x5605616a3a60 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890c0083f0 con 0x5605616a3a60 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616a7320 con 0x5605616a3a60 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890c0083f0 con 0x5605616a3a60 2024-09-10T06:24:43.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f890c0083f0 con 0x5605616a3a60 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5605616a8420 0x5605616aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616aae20 con 0x5605616a8420 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5605616a8420 0x5605616aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5605616a8420 0x5605616aa810 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 20 searching for the correct realm 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5605616acd00 0x5605616af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616af7b0 con 0x5605616acd00 2024-09-10T06:24:43.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5605616acd00 0x5605616af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5605616acd00 0x5605616af130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616af7b0 con 0x5605616a8420 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8914113020 0x7f89140a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.030+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616af7b0 con 0x7f8914113020 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8914113020 0x7f89140a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8914113020 0x7f89140a9540 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c0083f0 con 0x7f8914113020 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c0083f0 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a8420 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.034+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a8420 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a8420 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.038+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a8420 2024-09-10T06:24:43.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616acd00 2024-09-10T06:24:43.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x7f8914113020 2024-09-10T06:24:43.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a3a60 2024-09-10T06:24:43.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605616a76c0 con 0x5605616a8420 2024-09-10T06:24:43.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616ab670 con 0x5605616a3a60 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.042+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616aba60 con 0x5605616a3a60 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616aba60 con 0x5605616acd00 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 zone default found 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 4 Realm: () 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 zonegroup default 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616afc30 con 0x7f8914113020 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616b1750 con 0x5605616acd00 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616b1be0 con 0x5605616acd00 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 started sync module instance, tier type = 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0ac0 con 0x5605616a8420 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581109231552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0ac0 con 0x5605616a8420 2024-09-10T06:24:43.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.046+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b2720 con 0x5605616a3a60 2024-09-10T06:24:43.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581109231552] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581109236240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0ac0 con 0x5605616a3a60 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b3130 con 0x5605616acd00 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581109236240] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581109229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0a30 con 0x5605616acd00 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.050+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b3e90 con 0x5605616a8420 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581109242240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b4730 con 0x5605616a8420 2024-09-10T06:24:43.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b5150 con 0x5605616a3a60 2024-09-10T06:24:43.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581109242240] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581109229072] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581109247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b4280 con 0x5605616a3a60 2024-09-10T06:24:43.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.054+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b59f0 con 0x7f8914113020 2024-09-10T06:24:43.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581109247040] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581109241040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b4280 con 0x7f8914113020 2024-09-10T06:24:43.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b5e80 con 0x7f8914113020 2024-09-10T06:24:43.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581109250384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b62f0 con 0x7f8914113020 2024-09-10T06:24:43.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b6de0 con 0x7f8914113020 2024-09-10T06:24:43.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.058+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581109241040] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581109250384] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581109254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b5e40 con 0x7f8914113020 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=0 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=1 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=2 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=3 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=4 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=5 2024-09-10T06:24:43.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=6 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581109254320] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 add_watcher() i=7 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616b9ee0 con 0x5605616a3a60 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581109248736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b7360 con 0x5605616a3a60 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581109248736] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f87d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.062+0000 7f891f3f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 5 note: GC not initialized 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87d1fe3640 20 reqs_thread_entry: start 2024-09-10T06:24:43.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 Filter name: none 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87437fe640 20 reqs_thread_entry: start 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616dd2f0 con 0x5605616acd00 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616db990 con 0x5605616acd00 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-10T06:24:43.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T06:24:43.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T06:24:43.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T06:24:43.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616dc580 con 0x5605616acd00 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94581109407856 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616e10d0 con 0x5605616acd00 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== watch-notify(notify (1) cookie 94581109229072 notify 137438953481 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5605616e08e0 con 0x5605616acd00 2024-09-10T06:24:43.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94581109229072 notifier 4855 bl.length()=542 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87f3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f87f3fff640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f87e0003eb0 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(65 notify.2 [notify cookie 94581109407856 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== watch-notify(notify_complete (2) cookie 94581109407856 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5605616dbd80 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616dc070 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.066+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891f3f79c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891f3f79c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891f3f79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94581109407856 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605616e1500 con 0x7f8914113020 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== watch-notify(notify (1) cookie 94581109241040 notify 137438953516 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f890c010040 con 0x7f8914113020 2024-09-10T06:24:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f87f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94581109241040 notifier 4855 bl.length()=175 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f87f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f87f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f87f37fe640 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8750003410 con 0x7f8914113020 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(68 notify.5 [notify cookie 94581109407856 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== watch-notify(notify_complete (2) cookie 94581109407856 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f890c00ad60 con 0x7f8914113020 2024-09-10T06:24:43.074 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-10T06:24:43.068491Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:43.068481Z","tags":[],"group_ids":[]} 2024-09-10T06:24:43.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f87d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581109248736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616daff0 con 0x5605616a3a60 2024-09-10T06:24:43.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.070+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94581109248736] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581109231552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616daff0 con 0x5605616a8420 2024-09-10T06:24:43.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94581109231552] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 20 remove_watcher() i=0 2024-09-10T06:24:43.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 2 removed watcher, disabling cache 2024-09-10T06:24:43.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581109236240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0fc0 con 0x5605616a3a60 2024-09-10T06:24:43.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94581109236240] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 20 remove_watcher() i=1 2024-09-10T06:24:43.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.074+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581109229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616daff0 con 0x5605616acd00 2024-09-10T06:24:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891c6fc640 1 -- 172.21.15.117:0/4262518388 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94581109229072] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891000e620 con 0x5605616acd00 2024-09-10T06:24:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 20 remove_watcher() i=2 2024-09-10T06:24:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581109242240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b2210 con 0x5605616a8420 2024-09-10T06:24:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891cefd640 1 -- 172.21.15.117:0/4262518388 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94581109242240] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89140e0020 con 0x5605616a8420 2024-09-10T06:24:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 20 remove_watcher() i=3 2024-09-10T06:24:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581109247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0fc0 con 0x5605616a3a60 2024-09-10T06:24:43.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94581109247040] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x5605616a3a60 2024-09-10T06:24:43.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 20 remove_watcher() i=4 2024-09-10T06:24:43.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.078+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581109241040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b0610 con 0x7f8914113020 2024-09-10T06:24:43.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94581109241040] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891f3f79c0 20 remove_watcher() i=5 2024-09-10T06:24:43.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581109250384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616daff0 con 0x7f8914113020 2024-09-10T06:24:43.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94581109250384] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891f3f79c0 20 remove_watcher() i=6 2024-09-10T06:24:43.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.082+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581109254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605616b2210 con 0x7f8914113020 2024-09-10T06:24:43.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94581109254320] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f890c026040 con 0x7f8914113020 2024-09-10T06:24:43.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 20 remove_watcher() i=7 2024-09-10T06:24:43.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8914113020 msgr2=0x7f89140a9540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f8914113020 0x7f89140a9540 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605616a3a60 msgr2=0x5605616a5ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605616a3a60 0x5605616a5ef0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5605616a8420 msgr2=0x5605616aa810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5605616a8420 0x5605616aa810 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5605616acd00 msgr2=0x5605616af130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5605616acd00 0x5605616af130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87e8039a20 msgr2=0x7f87e803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87e8039a20 0x7f87e803bee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5605616754d0 tx=0x7f8910010000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891d6fe640 1 -- 172.21.15.117:0/4262518388 reap_dead start 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 msgr2=0x560561698820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89140e84b0 tx=0x7f89140eb1a0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 shutdown_connections 2024-09-10T06:24:43.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/4262518388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561657ec0 0x560561698820 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 >> 172.21.15.117:0/4262518388 conn(0x56056168b6f0 msgr2=0x560561689900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 shutdown_connections 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/4262518388 wait complete. 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 msgr2=0x7f87f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 0x7f87f403bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f891000bf50 tx=0x7f891000f000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 msgr2=0x560561682f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f89140e96e0 tx=0x7f89140bfe50 comp rx=0 tx=0).stop 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 shutdown_connections 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f87f4039a70 0x7f87f403bf30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/3070753166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561682b70 0x560561682f90 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 >> 172.21.15.117:0/3070753166 conn(0x560561678520 msgr2=0x560561678900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 shutdown_connections 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/3070753166 wait complete. 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605615744e0 msgr2=0x56056166be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5605615744e0 0x56056166be90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56056166e690 msgr2=0x560561670a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56056166e690 0x560561670a80 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560561672590 msgr2=0x560561674980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x560561672590 0x560561674980 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8804039ac0 msgr2=0x7f880403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8804039ac0 0x7f880403bf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8910001d80 tx=0x7f89100012e0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 msgr2=0x560561664d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 --2- 172.21.15.117:0/2059055540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560561571300 0x560561664d20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8914018c00 tx=0x7f8914017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891d6fe640 1 -- 172.21.15.117:0/2059055540 reap_dead start 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 shutdown_connections 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 >> 172.21.15.117:0/2059055540 conn(0x56056156ce20 msgr2=0x560561656dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 shutdown_connections 2024-09-10T06:24:43.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.086+0000 7f891f3f79c0 1 -- 172.21.15.117:0/2059055540 wait complete. 2024-09-10T06:24:43.099 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T06:24:43.068491Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:43.068481Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.099 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T06:24:43.068491Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:43.068481Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.099 ERROR:root:0 2024-09-10T06:24:43.100 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:43.104 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:43.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-10T06:24:43.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-10T06:24:43.104 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-10T06:24:43.172 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:43.172 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba7f449c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f5ebee5590 0x55f5ebee4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba7f449c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5ebe229c0 con 0x55f5ebee5060 2024-09-10T06:24:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba7f449c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55f5ebe726d0 con 0x55f5ebee5590 2024-09-10T06:24:43.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba5249640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55f5ebee5590 0x55f5ebee4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba5a4a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55f5ebee5060 0x55f5ebee3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54444/0 (socket says 172.21.15.117:54444) 2024-09-10T06:24:43.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/967944365 learned_addr learned my addr 172.21.15.117:0/967944365 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:43.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba5249640 1 -- 172.21.15.117:0/967944365 >> v1:172.21.15.84:6789/0 conn(0x55f5ebee5060 legacy=0x55f5ebee3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.170+0000 7f6ba5249640 1 -- 172.21.15.117:0/967944365 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ebe16ca0 con 0x55f5ebee5590 2024-09-10T06:24:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba5249640 1 --2- 172.21.15.117:0/967944365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5590 0x55f5ebee4110 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00a480 tx=0x7f6b9c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a248027f421a695c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba4a48640 1 -- 172.21.15.117:0/967944365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c0af070 con 0x55f5ebee5590 2024-09-10T06:24:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba4a48640 1 -- 172.21.15.117:0/967944365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0aa570 con 0x55f5ebee5590 2024-09-10T06:24:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba4a48640 1 -- 172.21.15.117:0/967944365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b9c0aa8b0 con 0x55f5ebee5590 2024-09-10T06:24:43.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/967944365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5590 msgr2=0x55f5ebee4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/967944365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5590 0x55f5ebee4110 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00a480 tx=0x7f6b9c01b220 comp rx=0 tx=0).stop 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/967944365 shutdown_connections 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/967944365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5590 0x55f5ebee4110 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/967944365 >> 172.21.15.117:0/967944365 conn(0x55f5ebf6a040 msgr2=0x55f5ebf6c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/967944365 shutdown_connections 2024-09-10T06:24:43.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.174+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/967944365 wait complete. 2024-09-10T06:24:43.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ebe76680 con 0x55f5ebee5060 2024-09-10T06:24:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46026/0 (socket says 172.21.15.117:46026) 2024-09-10T06:24:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/2205651523 learned_addr learned my addr 172.21.15.117:0/2205651523 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/2205651523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ebdf1da0 con 0x55f5ebee5060 2024-09-10T06:24:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/2205651523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001810 tx=0x7f6ba0001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983d27964cf1dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6a93e07640 1 -- 172.21.15.117:0/2205651523 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0004530 con 0x55f5ebee5060 2024-09-10T06:24:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6a93e07640 1 -- 172.21.15.117:0/2205651523 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00046d0 con 0x55f5ebee5060 2024-09-10T06:24:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6a93e07640 1 -- 172.21.15.117:0/2205651523 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00049f0 con 0x55f5ebee5060 2024-09-10T06:24:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/2205651523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 msgr2=0x55f5ec05bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/2205651523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001810 tx=0x7f6ba0001cd0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/2205651523 shutdown_connections 2024-09-10T06:24:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/2205651523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec05bd00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/2205651523 >> 172.21.15.117:0/2205651523 conn(0x55f5ebf6a040 msgr2=0x55f5ec0579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/2205651523 shutdown_connections 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/2205651523 wait complete. 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec063300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba7f449c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ebe18a50 con 0x55f5ebee5060 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec063300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46040/0 (socket says 172.21.15.117:46040) 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.190+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1312424034 learned_addr learned my addr 172.21.15.117:0/1312424034 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ec063860 con 0x55f5ebee5060 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec063300 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001d10 tx=0x7f6ba0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 -- 172.21.15.117:0/1312424034 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0013760 con 0x55f5ebee5060 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ec063af0 con 0x55f5ebee5060 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 -- 172.21.15.117:0/1312424034 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0013900 con 0x55f5ebee5060 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 -- 172.21.15.117:0/1312424034 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0013c20 con 0x55f5ebee5060 2024-09-10T06:24:43.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ec0644a0 con 0x55f5ebee5060 2024-09-10T06:24:43.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 -- 172.21.15.117:0/1312424034 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba0010070 con 0x55f5ebee5060 2024-09-10T06:24:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a8c039a70 0x7f6a8c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6a92604640 1 -- 172.21.15.117:0/1312424034 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ba0018070 con 0x55f5ebee5060 2024-09-10T06:24:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a8c039a70 0x7f6a8c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ebee5590 0x55f5ec06a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec06a9b0 con 0x55f5ebee5590 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ebee5590 0x55f5ec06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a8c039a70 0x7f6a8c03bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ac000 tx=0x7f6b9c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ebee5590 0x55f5ec06a470 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba624b640 1 -- 172.21.15.117:0/1312424034 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ebee5590 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec064880 con 0x55f5ebee5590 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba624b640 1 -- 172.21.15.117:0/1312424034 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ebee5590 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec06cc20 0x55f5ec06f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec06f6e0 con 0x55f5ec06cc20 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec06cc20 0x55f5ec06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.194+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec06cc20 0x55f5ec06f010 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1312424034 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec06cc20 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec06bac0 con 0x55f5ebee5590 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba624b640 1 -- 172.21.15.117:0/1312424034 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ebee5590 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec070b40 0x55f5ec072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec073620 con 0x55f5ec070b40 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec070b40 0x55f5ec072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec070b40 0x55f5ec072f30 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5249640 1 -- 172.21.15.117:0/1312424034 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b9c0a8070 con 0x55f5ec070b40 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ebe83450 con 0x55f5ec081080 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46048/0 (socket says 172.21.15.117:46048) 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/3196745736 learned_addr learned my addr 172.21.15.117:0/3196745736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/3196745736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ec081ae0 con 0x55f5ec081080 2024-09-10T06:24:43.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6ba004ea10 tx=0x7f6ba0043ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6a8b7fe640 1 -- 172.21.15.117:0/3196745736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0041af0 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ec082340 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6a8b7fe640 1 -- 172.21.15.117:0/3196745736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0041c90 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6a8b7fe640 1 -- 172.21.15.117:0/3196745736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0028ab0 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.198+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ec0828b0 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a8b7fe640 1 -- 172.21.15.117:0/3196745736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba0029d10 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a8b7fe640 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a8b7fe640 1 -- 172.21.15.117:0/3196745736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ba002a2b0 con 0x55f5ec081080 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5249640 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5249640 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c018eb0 tx=0x7f6b9c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ec05c530 con 0x55f5ec08e810 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46054/0 (socket says 172.21.15.117:46054) 2024-09-10T06:24:43.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1152428578 learned_addr learned my addr 172.21.15.117:0/1152428578 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1152428578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ec08f200 con 0x55f5ec08e810 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1152428578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6ba004d730 tx=0x7f6ba0045070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f4f60af2b98803 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a897fa640 1 -- 172.21.15.117:0/1152428578 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0057040 con 0x55f5ec08e810 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a897fa640 1 -- 172.21.15.117:0/1152428578 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0060070 con 0x55f5ec08e810 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6a897fa640 1 -- 172.21.15.117:0/1152428578 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba002bd80 con 0x55f5ec08e810 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1152428578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 msgr2=0x55f5ec08ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1152428578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6ba004d730 tx=0x7f6ba0045070 comp rx=0 tx=0).stop 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1152428578 shutdown_connections 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1152428578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec08ec10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1152428578 >> 172.21.15.117:0/1152428578 conn(0x55f5ec089c30 msgr2=0x55f5ec087e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1152428578 shutdown_connections 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1152428578 wait complete. 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 Processor -- start 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- start start 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba7f449c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5ec08d5e0 con 0x55f5ec08e810 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46066/0 (socket says 172.21.15.117:46066) 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.202+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 learned_addr learned my addr 172.21.15.117:0/1545410878 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ec095120 con 0x55f5ec08e810 2024-09-10T06:24:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0029860 tx=0x7f6ba0044ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 -- 172.21.15.117:0/1545410878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba004ea90 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ec095120 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 -- 172.21.15.117:0/1545410878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0069070 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 -- 172.21.15.117:0/1545410878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba001da10 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ec0956f0 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 -- 172.21.15.117:0/1545410878 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6ba001dbb0 con 0x55f5ec08e810 2024-09-10T06:24:43.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a70039a70 0x7f6a7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6a777fe640 1 -- 172.21.15.117:0/1545410878 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6ba0071120 con 0x55f5ec08e810 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a70039a70 0x7f6a7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ec09fd70 0x55f5ec0a2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a2950 con 0x55f5ec09fd70 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ec09fd70 0x55f5ec0a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a70039a70 0x7f6a7003bf30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f5ec073a20 tx=0x7f6b9c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ec09fd70 0x55f5ec0a2200 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 realm 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a2d60 con 0x55f5ec09fd70 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a3630 con 0x55f5ec09fd70 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.206+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec0a4730 0x55f5ec0a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a70f0 con 0x55f5ec0a4730 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec0a4730 0x55f5ec0a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec0a4730 0x55f5ec0a6b20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 20 searching for the correct realm 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec0a9040 0x55f5ec0ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0abaf0 con 0x55f5ec0a9040 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec0a9040 0x55f5ec0ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5249640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec0a9040 0x55f5ec0ab470 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0abaf0 con 0x55f5ec0a4730 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba0053130 0x7f6ba0050690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0abaf0 con 0x7f6ba0053130 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba0053130 0x7f6ba0050690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba0053130 0x7f6ba0050690 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b980083f0 con 0x7f6ba0053130 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b980083f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.210+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.214+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.218+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x7f6ba0053130 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec09fd70 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a39d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a79b0 con 0x55f5ec09fd70 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a7da0 con 0x55f5ec09fd70 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0a7da0 con 0x55f5ec0a9040 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 zone default found 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 4 Realm: () 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 zonegroup default 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0abf70 con 0x7f6ba0053130 2024-09-10T06:24:43.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ada60 con 0x55f5ec0a9040 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0adea0 con 0x55f5ec0a9040 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 started sync module instance, tier type = 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:43.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.222+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ace00 con 0x55f5ec0a4730 2024-09-10T06:24:43.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514715480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ace00 con 0x55f5ec0a4730 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ae9a0 con 0x55f5ec09fd70 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514715480864] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514715485312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ace00 con 0x55f5ec09fd70 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.226+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0af3b0 con 0x55f5ec0a9040 2024-09-10T06:24:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514715485312] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514715478352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0acd70 con 0x55f5ec0a9040 2024-09-10T06:24:43.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b0100 con 0x55f5ec0a4730 2024-09-10T06:24:43.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514715491712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b09d0 con 0x55f5ec0a4730 2024-09-10T06:24:43.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b1390 con 0x55f5ec09fd70 2024-09-10T06:24:43.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.230+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514715478352] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514715491712] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514715493664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b0ee0 con 0x55f5ec09fd70 2024-09-10T06:24:43.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b18a0 con 0x7f6ba0053130 2024-09-10T06:24:43.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514715493664] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514715490208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b18a0 con 0x7f6ba0053130 2024-09-10T06:24:43.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.234+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b2130 con 0x7f6ba0053130 2024-09-10T06:24:43.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514715498656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b27e0 con 0x7f6ba0053130 2024-09-10T06:24:43.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b3070 con 0x7f6ba0053130 2024-09-10T06:24:43.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514715490208] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514715497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b3250 con 0x7f6ba0053130 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=0 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=1 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=2 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=3 2024-09-10T06:24:43.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=4 2024-09-10T06:24:43.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.238+0000 7f6ba7f449c0 20 add_watcher() i=5 2024-09-10T06:24:43.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514715498656] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 20 add_watcher() i=6 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514715497456] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 20 add_watcher() i=7 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b6170 con 0x55f5ec09fd70 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514715501520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0b35f0 con 0x55f5ec09fd70 2024-09-10T06:24:43.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514715501520] v32'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6a577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:43.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:43.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.242+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be860 con 0x55f5ec09fd70 2024-09-10T06:24:43.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be860 con 0x7f6ba0053130 2024-09-10T06:24:43.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bf320 con 0x55f5ec0a9040 2024-09-10T06:24:43.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.246+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bfd40 con 0x55f5ec09fd70 2024-09-10T06:24:43.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'254 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bcec0 con 0x55f5ec0a4730 2024-09-10T06:24:43.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'80 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bcec0 con 0x55f5ec0a9040 2024-09-10T06:24:43.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.250+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bcec0 con 0x55f5ec09fd70 2024-09-10T06:24:43.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.254+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.254+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0c08a0 con 0x7f6ba0053130 2024-09-10T06:24:43.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.254+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.254+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0c08a0 con 0x55f5ec0a4730 2024-09-10T06:24:43.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0c08a0 con 0x55f5ec0a9040 2024-09-10T06:24:43.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bcaa0 con 0x55f5ec0a4730 2024-09-10T06:24:43.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'81 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.258+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be260 con 0x7f6ba0053130 2024-09-10T06:24:43.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.262+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.262+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec0a4730 2024-09-10T06:24:43.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.262+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.262+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be700 con 0x7f6ba0053130 2024-09-10T06:24:43.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec09fd70 2024-09-10T06:24:43.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'255 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be700 con 0x55f5ec0a9040 2024-09-10T06:24:43.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.266+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec0a4730 2024-09-10T06:24:43.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'82 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be700 con 0x55f5ec0a9040 2024-09-10T06:24:43.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be320 con 0x55f5ec09fd70 2024-09-10T06:24:43.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.270+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec09fd70 2024-09-10T06:24:43.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'256 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec0a9040 2024-09-10T06:24:43.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0b0 con 0x55f5ec0a4730 2024-09-10T06:24:43.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.274+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be0f0 con 0x55f5ec0a9040 2024-09-10T06:24:43.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.279 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be130 con 0x55f5ec0a9040 2024-09-10T06:24:43.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be170 con 0x55f5ec0a9040 2024-09-10T06:24:43.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be1a0 con 0x55f5ec0a9040 2024-09-10T06:24:43.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.278+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be650 con 0x7f6ba0053130 2024-09-10T06:24:43.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.282+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.282+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0bdbc0 con 0x55f5ec0a9040 2024-09-10T06:24:43.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.282+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.282+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be6c0 con 0x7f6ba0053130 2024-09-10T06:24:43.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.286+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.286+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be620 con 0x55f5ec0a9040 2024-09-10T06:24:43.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.286+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.286+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be620 con 0x7f6ba0053130 2024-09-10T06:24:43.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'62 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0be620 con 0x55f5ec0a4730 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6a567fc640 20 reqs_thread_entry: start 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 20 Filter name: none 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f69c7fff640 20 reqs_thread_entry: start 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T06:24:43.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0dc0a0 con 0x55f5ec0a9040 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.290+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0deb30 con 0x55f5ec0a9040 2024-09-10T06:24:43.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 10 removing key index: true_admin_akey 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0dcb10 con 0x55f5ec0a9040 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(96 true_admin_akey [delete] v32'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94514715678240 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0df060 con 0x7f6ba0053130 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== watch-notify(notify (1) cookie 94514715490208 notify 137438953517 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55f5ec0bd590 con 0x7f6ba0053130 2024-09-10T06:24:43.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6a897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 94514715490208 notifier 4862 bl.length()=165 2024-09-10T06:24:43.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6a897fa640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a68003d70 con 0x7f6ba0053130 2024-09-10T06:24:43.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(97 notify.5 [notify cookie 94514715678240 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== watch-notify(notify_complete (2) cookie 94514715678240 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f5ec0bee70 con 0x7f6ba0053130 2024-09-10T06:24:43.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 10 removing email index: 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 10 removing user buckets index 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.294+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x55f5ec0a9040 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(99 a_user.buckets [delete] v32'5 uv4 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 10 removing user index: a_user 2024-09-10T06:24:43.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x55f5ec0a9040 2024-09-10T06:24:43.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(100 a_user [call,call,delete] v32'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-10T06:24:43.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T06:24:43.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94514715684832 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0dd620 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== watch-notify(notify (1) cookie 94514715478352 notify 137438953482 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55f5ec0bcff0 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6a88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94514715478352 notifier 4862 bl.length()=155 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6a88ff9640 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f69d00032d0 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(101 notify.2 [notify cookie 94514715684832 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== watch-notify(notify_complete (2) cookie 94514715684832 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f5ec0bd260 con 0x55f5ec0a9040 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6a577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.298+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514715501520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x55f5ec09fd70 2024-09-10T06:24:43.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94514715501520] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514715480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x55f5ec0a4730 2024-09-10T06:24:43.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94514715480864] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba7f449c0 20 remove_watcher() i=0 2024-09-10T06:24:43.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba7f449c0 2 removed watcher, disabling cache 2024-09-10T06:24:43.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.302+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514715485312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ad320 con 0x55f5ec09fd70 2024-09-10T06:24:43.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94514715485312] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 20 remove_watcher() i=1 2024-09-10T06:24:43.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514715478352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x55f5ec0a9040 2024-09-10T06:24:43.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba5249640 1 -- 172.21.15.117:0/1545410878 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94514715478352] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9c0d9070 con 0x55f5ec0a9040 2024-09-10T06:24:43.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 20 remove_watcher() i=2 2024-09-10T06:24:43.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514715491712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ae480 con 0x55f5ec0a4730 2024-09-10T06:24:43.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba5a4a640 1 -- 172.21.15.117:0/1545410878 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94514715491712] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba001b030 con 0x55f5ec0a4730 2024-09-10T06:24:43.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 20 remove_watcher() i=3 2024-09-10T06:24:43.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.306+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514715493664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ad320 con 0x55f5ec09fd70 2024-09-10T06:24:43.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.310+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94514715493664] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x55f5ec09fd70 2024-09-10T06:24:43.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.310+0000 7f6ba7f449c0 20 remove_watcher() i=4 2024-09-10T06:24:43.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.310+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514715490208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ac950 con 0x7f6ba0053130 2024-09-10T06:24:43.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94514715490208] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba7f449c0 20 remove_watcher() i=5 2024-09-10T06:24:43.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514715498656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0defe0 con 0x7f6ba0053130 2024-09-10T06:24:43.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94514715498656] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba7f449c0 20 remove_watcher() i=6 2024-09-10T06:24:43.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.314+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514715497456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ec0ae480 con 0x7f6ba0053130 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94514715497456] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b98026040 con 0x7f6ba0053130 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 20 remove_watcher() i=7 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba0053130 msgr2=0x7f6ba0050690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f6ba0053130 0x7f6ba0050690 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ec09fd70 msgr2=0x55f5ec0a2200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ec09fd70 0x55f5ec0a2200 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec0a4730 msgr2=0x55f5ec0a6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec0a4730 0x55f5ec0a6b20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec0a9040 msgr2=0x55f5ec0ab470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec0a9040 0x55f5ec0ab470 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a70039a70 msgr2=0x7f6a7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a70039a70 0x7f6a7003bf30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f5ec073a20 tx=0x7f6b9c0a7000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 msgr2=0x55f5ec094bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba624b640 1 -- 172.21.15.117:0/1545410878 reap_dead start 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0029860 tx=0x7f6ba0044ed0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 shutdown_connections 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1545410878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec08e810 0x55f5ec094bc0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 >> 172.21.15.117:0/1545410878 conn(0x55f5ec089c30 msgr2=0x55f5ec087e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 shutdown_connections 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1545410878 wait complete. 2024-09-10T06:24:43.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 msgr2=0x7f6a8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c018eb0 tx=0x7f6b9c005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 msgr2=0x55f5ec0814a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6ba004ea10 tx=0x7f6ba0043ee0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 shutdown_connections 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a80039a70 0x7f6a8003bf30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/3196745736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ec081080 0x55f5ec0814a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 >> 172.21.15.117:0/3196745736 conn(0x55f5ec076a30 msgr2=0x55f5ec076e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 shutdown_connections 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/3196745736 wait complete. 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ebee5590 msgr2=0x55f5ec06a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55f5ebee5590 0x55f5ec06a470 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec06cc20 msgr2=0x55f5ec06f010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55f5ec06cc20 0x55f5ec06f010 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec070b40 msgr2=0x55f5ec072f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55f5ec070b40 0x55f5ec072f30 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a8c039a70 msgr2=0x7f6a8c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6a8c039a70 0x7f6a8c03bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0ac000 tx=0x7f6b9c0a5000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 msgr2=0x55f5ec063300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 --2- 172.21.15.117:0/1312424034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5ebee5060 0x55f5ec063300 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001d10 tx=0x7f6ba0001260 comp rx=0 tx=0).stop 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba624b640 1 -- 172.21.15.117:0/1312424034 reap_dead start 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 shutdown_connections 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 >> 172.21.15.117:0/1312424034 conn(0x55f5ebf6a040 msgr2=0x55f5ec056430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 shutdown_connections 2024-09-10T06:24:43.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.318+0000 7f6ba7f449c0 1 -- 172.21.15.117:0/1312424034 wait complete. 2024-09-10T06:24:43.331 ERROR:root:None 2024-09-10T06:24:43.331 ERROR:root:0 2024-09-10T06:24:43.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T06:24:43.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T06:24:43.331 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-10T06:24:43.410 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:43.410 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:43.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb2ba89c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c76b0276f0 0x55c76b027ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb2ba89c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c76aedd9c0 con 0x55c76b028040 2024-09-10T06:24:43.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb2ba89c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55c76af2d6d0 con 0x55c76b0276f0 2024-09-10T06:24:43.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb06ae640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55c76b0276f0 0x55c76b027ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fafead640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55c76b028040 0x55c76b02ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54446/0 (socket says 172.21.15.117:54446) 2024-09-10T06:24:43.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fafead640 1 -- 172.21.15.117:0/3901228927 learned_addr learned my addr 172.21.15.117:0/3901228927 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:43.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb06ae640 1 -- 172.21.15.117:0/3901228927 >> v1:172.21.15.84:6789/0 conn(0x55c76b028040 legacy=0x55c76b02ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.410+0000 7f4fb06ae640 1 -- 172.21.15.117:0/3901228927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76aed1ca0 con 0x55c76b0276f0 2024-09-10T06:24:43.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/3901228927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b027ad0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800a480 tx=0x7f4fa801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2ff420a5cd4855 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4faf6ac640 1 -- 172.21.15.117:0/3901228927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b0070 con 0x55c76b0276f0 2024-09-10T06:24:43.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4faf6ac640 1 -- 172.21.15.117:0/3901228927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80ab540 con 0x55c76b0276f0 2024-09-10T06:24:43.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4faf6ac640 1 -- 172.21.15.117:0/3901228927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80ab840 con 0x55c76b0276f0 2024-09-10T06:24:43.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3901228927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 msgr2=0x55c76b027ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/3901228927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b027ad0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800a480 tx=0x7f4fa801b280 comp rx=0 tx=0).stop 2024-09-10T06:24:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3901228927 shutdown_connections 2024-09-10T06:24:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/3901228927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b027ad0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3901228927 >> 172.21.15.117:0/3901228927 conn(0x55c76b023640 msgr2=0x55c76b025a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3901228927 shutdown_connections 2024-09-10T06:24:43.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.414+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3901228927 wait complete. 2024-09-10T06:24:43.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb2ba89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb2ba89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c76af31680 con 0x55c76b0276f0 2024-09-10T06:24:43.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46084/0 (socket says 172.21.15.117:46084) 2024-09-10T06:24:43.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb06ae640 1 -- 172.21.15.117:0/3932489493 learned_addr learned my addr 172.21.15.117:0/3932489493 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb06ae640 1 -- 172.21.15.117:0/3932489493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76aeacda0 con 0x55c76b0276f0 2024-09-10T06:24:43.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.426+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/3932489493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80ae040 tx=0x7f4fa8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291fc823a69ab23e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9e60c640 1 -- 172.21.15.117:0/3932489493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b0070 con 0x55c76b0276f0 2024-09-10T06:24:43.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9e60c640 1 -- 172.21.15.117:0/3932489493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80b1040 con 0x55c76b0276f0 2024-09-10T06:24:43.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9e60c640 1 -- 172.21.15.117:0/3932489493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80ab6f0 con 0x55c76b0276f0 2024-09-10T06:24:43.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3932489493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 msgr2=0x55c76b114860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/3932489493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80ae040 tx=0x7f4fa8003030 comp rx=0 tx=0).stop 2024-09-10T06:24:43.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3932489493 shutdown_connections 2024-09-10T06:24:43.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/3932489493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b114860 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3932489493 >> 172.21.15.117:0/3932489493 conn(0x55c76b023640 msgr2=0x55c76b110500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3932489493 shutdown_connections 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/3932489493 wait complete. 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b11be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c76aed3a50 con 0x55c76b0276f0 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b11be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b11be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46086/0 (socket says 172.21.15.117:46086) 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb06ae640 1 -- 172.21.15.117:0/209617184 learned_addr learned my addr 172.21.15.117:0/209617184 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb06ae640 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76b11c3d0 con 0x55c76b0276f0 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b11be70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80ae040 tx=0x7f4fa8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9ce09640 1 -- 172.21.15.117:0/209617184 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b75b0 con 0x55c76b0276f0 2024-09-10T06:24:43.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c76b11c660 con 0x55c76b0276f0 2024-09-10T06:24:43.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9ce09640 1 -- 172.21.15.117:0/209617184 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80b7750 con 0x55c76b0276f0 2024-09-10T06:24:43.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4e9ce09640 1 -- 172.21.15.117:0/209617184 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b7a30 con 0x55c76b0276f0 2024-09-10T06:24:43.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.430+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c76b11d010 con 0x55c76b0276f0 2024-09-10T06:24:43.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4e9ce09640 1 -- 172.21.15.117:0/209617184 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4fa80b7bd0 con 0x55c76b0276f0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4e9ce09640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e98039a70 0x7f4e9803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4e9ce09640 1 -- 172.21.15.117:0/209617184 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4fa80bc070 con 0x55c76b0276f0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fafead640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e98039a70 0x7f4e9803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b028040 0x55c76b122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b123520 con 0x55c76b028040 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b028040 0x55c76b122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fafead640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e98039a70 0x7f4e9803bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4001650 tx=0x7f4fa4006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b028040 0x55c76b122fe0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/209617184 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b028040 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b123990 con 0x55c76b028040 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/209617184 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b028040 2024-09-10T06:24:43.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b1257a0 0x55c76b127b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b128260 con 0x55c76b1257a0 2024-09-10T06:24:43.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b1257a0 0x55c76b127b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b1257a0 0x55c76b127b90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb06ae640 1 -- 172.21.15.117:0/209617184 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b1257a0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b124640 con 0x55c76b028040 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/209617184 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b028040 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b1296a0 0x55c76b12ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b12c1d0 con 0x55c76b1296a0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fafead640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b1296a0 0x55c76b12ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fafead640 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b1296a0 0x55c76b12ba90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.434+0000 7f4fafead640 1 -- 172.21.15.117:0/209617184 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b1296a0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c76af3e450 con 0x55c76b02a160 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46094/0 (socket says 172.21.15.117:46094) 2024-09-10T06:24:43.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb06ae640 1 -- 172.21.15.117:0/211162596 learned_addr learned my addr 172.21.15.117:0/211162596 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb06ae640 1 -- 172.21.15.117:0/211162596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76b02a680 con 0x55c76b02a160 2024-09-10T06:24:43.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80eb010 tx=0x7f4fa80b5ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 -- 172.21.15.117:0/211162596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b6960 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c76b028f40 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 -- 172.21.15.117:0/211162596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80e50e0 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c76b0294b0 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 -- 172.21.15.117:0/211162596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b5c70 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 -- 172.21.15.117:0/211162596 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4fa80aa3b0 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 0x7f4e8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4e95ffb640 1 -- 172.21.15.117:0/211162596 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4fa80db070 con 0x55c76b02a160 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fafead640 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 0x7f4e8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fafead640 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 0x7f4e8803bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55c76b12c5d0 tx=0x7f4fa400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.438+0000 7f4fb2ba89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c76b114fd0 con 0x55c76b149660 2024-09-10T06:24:43.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46110/0 (socket says 172.21.15.117:46110) 2024-09-10T06:24:43.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 -- 172.21.15.117:0/1782554053 learned_addr learned my addr 172.21.15.117:0/1782554053 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 -- 172.21.15.117:0/1782554053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76b14a050 con 0x55c76b149660 2024-09-10T06:24:43.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/1782554053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80aafc0 tx=0x7f4fa80e5f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a804f7d31c43d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8f7fe640 1 -- 172.21.15.117:0/1782554053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80b5e10 con 0x55c76b149660 2024-09-10T06:24:43.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8f7fe640 1 -- 172.21.15.117:0/1782554053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80d3de0 con 0x55c76b149660 2024-09-10T06:24:43.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8f7fe640 1 -- 172.21.15.117:0/1782554053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80cbcf0 con 0x55c76b149660 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/1782554053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 msgr2=0x55c76b149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/1782554053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80aafc0 tx=0x7f4fa80e5f30 comp rx=0 tx=0).stop 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/1782554053 shutdown_connections 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/1782554053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b149a60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/1782554053 >> 172.21.15.117:0/1782554053 conn(0x55c76b144a80 msgr2=0x55c76b142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/1782554053 shutdown_connections 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/1782554053 wait complete. 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 Processor -- start 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- start start 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c76b148430 con 0x55c76b149660 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46116/0 (socket says 172.21.15.117:46116) 2024-09-10T06:24:43.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 learned_addr learned my addr 172.21.15.117:0/28981169 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c76b14feb0 con 0x55c76b149660 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80f0040 tx=0x7f4fa80ddef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8dffb640 1 -- 172.21.15.117:0/28981169 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa8105040 con 0x55c76b149660 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c76b14feb0 con 0x55c76b149660 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8dffb640 1 -- 172.21.15.117:0/28981169 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80e8170 con 0x55c76b149660 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4e8dffb640 1 -- 172.21.15.117:0/28981169 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80e8320 con 0x55c76b149660 2024-09-10T06:24:43.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.442+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c76b14feb0 con 0x55c76b149660 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4e8dffb640 1 -- 172.21.15.117:0/28981169 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4fa8112030 con 0x55c76b149660 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4e8dffb640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e80039a20 0x7f4e8003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4e8dffb640 1 -- 172.21.15.117:0/28981169 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4fa8110020 con 0x55c76b149660 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fafead640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e80039a20 0x7f4e8003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b15ab90 0x55c76b15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15d770 con 0x55c76b15ab90 2024-09-10T06:24:43.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b15ab90 0x55c76b15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fafead640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e80039a20 0x7f4e8003bee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004fd0 tx=0x7f4fa4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b15ab90 0x55c76b15d020 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b15ab90 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 realm 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15db80 con 0x55c76b15ab90 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b15ab90 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e450 con 0x55c76b15ab90 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b15ab90 2024-09-10T06:24:43.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b15ab90 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b15f550 0x55c76b161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b161f50 con 0x55c76b15f550 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b15f550 0x55c76b161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b15f550 0x55c76b161940 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 20 searching for the correct realm 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b163e30 0x55c76b166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1668e0 con 0x55c76b163e30 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fafead640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b163e30 0x55c76b166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.446+0000 7f4fafead640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b163e30 0x55c76b166260 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1668e0 con 0x55c76b15f550 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb06ae640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4fa80ab030 0x7f4fa80f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1668e0 con 0x7f4fa80ab030 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4fa80ab030 0x7f4fa80f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4fa80ab030 0x7f4fa80f7a40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa00083f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa00083f0 con 0x55c76b15ab90 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15f550 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.450+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15f550 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.454+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15f550 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15f550 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b163e30 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15ab90 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.458+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c76b15e7f0 con 0x55c76b15f550 2024-09-10T06:24:43.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1627a0 con 0x55c76b15ab90 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b162b90 con 0x55c76b15ab90 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b162b90 con 0x55c76b163e30 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 zone default found 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 4 Realm: () 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 zonegroup default 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b166d60 con 0x7f4fa80ab030 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1688a0 con 0x55c76b163e30 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b168d30 con 0x55c76b163e30 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 started sync module instance, tier type = 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b167bf0 con 0x55c76b15f550 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94314983489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b167850 con 0x55c76b15f550 2024-09-10T06:24:43.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.462+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b169c60 con 0x55c76b15ab90 2024-09-10T06:24:43.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.466+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94314983489504] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.466+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.466+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94314983495600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b169bd0 con 0x55c76b15ab90 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.466+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16a9f0 con 0x55c76b163e30 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.466+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94314983495600] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94314983497808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16ae10 con 0x55c76b163e30 2024-09-10T06:24:43.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16b7d0 con 0x55c76b15f550 2024-09-10T06:24:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314983504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16c490 con 0x55c76b15f550 2024-09-10T06:24:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16ce50 con 0x55c76b15ab90 2024-09-10T06:24:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94314983504832] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94314983497808] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94314983505888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16c400 con 0x55c76b15ab90 2024-09-10T06:24:43.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.470+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16d300 con 0x7f4fa80ab030 2024-09-10T06:24:43.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.474+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.474+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94314983509584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16d720 con 0x7f4fa80ab030 2024-09-10T06:24:43.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.474+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16e0e0 con 0x7f4fa80ab030 2024-09-10T06:24:43.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.474+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94314983505888] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.474+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94314983509584] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94314983510640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16d690 con 0x7f4fa80ab030 2024-09-10T06:24:43.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16e590 con 0x7f4fa80ab030 2024-09-10T06:24:43.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94314983510640] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94314983513136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16e500 con 0x7f4fa80ab030 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=0 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=1 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=2 2024-09-10T06:24:43.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=3 2024-09-10T06:24:43.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=4 2024-09-10T06:24:43.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=5 2024-09-10T06:24:43.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.478+0000 7f4fb2ba89c0 20 add_watcher() i=6 2024-09-10T06:24:43.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94314983513136] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 add_watcher() i=7 2024-09-10T06:24:43.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:43.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b171930 con 0x55c76b15ab90 2024-09-10T06:24:43.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94314983514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16eec0 con 0x55c76b15ab90 2024-09-10T06:24:43.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94314983514656] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4e667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 5 note: GC not initialized 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4e657e2640 20 reqs_thread_entry: start 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 Filter name: none 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4ddeffd640 20 reqs_thread_entry: start 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.482+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b194fa0 con 0x7f4fa80ab030 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:43.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b19b9f0 con 0x7f4fa80ab030 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94314983699552 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1970e0 con 0x55c76b15ab90 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94314983505888 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f4fa0010040 con 0x55c76b15ab90 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4e8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94314983505888 notifier 4869 bl.length()=666 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4e8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4e8f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94314983699552 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4e8f7fe640 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4e74003eb0 con 0x55c76b15ab90 2024-09-10T06:24:43.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.486+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94314983699552 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4fa000ab50 con 0x55c76b15ab90 2024-09-10T06:24:43.491 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:43.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4e667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94314983514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b192cd0 con 0x55c76b15ab90 2024-09-10T06:24:43.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94314983514656] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94314983489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b192cd0 con 0x55c76b15f550 2024-09-10T06:24:43.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94314983489504] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb2ba89c0 20 remove_watcher() i=0 2024-09-10T06:24:43.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb2ba89c0 2 removed watcher, disabling cache 2024-09-10T06:24:43.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.490+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94314983495600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b192cd0 con 0x55c76b15ab90 2024-09-10T06:24:43.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94314983495600] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 20 remove_watcher() i=1 2024-09-10T06:24:43.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94314983497808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b192cd0 con 0x55c76b163e30 2024-09-10T06:24:43.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fafead640 1 -- 172.21.15.117:0/28981169 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94314983497808] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa400f070 con 0x55c76b163e30 2024-09-10T06:24:43.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 20 remove_watcher() i=2 2024-09-10T06:24:43.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94314983504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b194280 con 0x55c76b15f550 2024-09-10T06:24:43.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb06ae640 1 -- 172.21.15.117:0/28981169 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94314983504832] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa80d0070 con 0x55c76b15f550 2024-09-10T06:24:43.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 20 remove_watcher() i=3 2024-09-10T06:24:43.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.494+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94314983505888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b194280 con 0x55c76b15ab90 2024-09-10T06:24:43.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94314983505888] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x55c76b15ab90 2024-09-10T06:24:43.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb2ba89c0 20 remove_watcher() i=4 2024-09-10T06:24:43.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94314983509584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1697b0 con 0x7f4fa80ab030 2024-09-10T06:24:43.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94314983509584] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb2ba89c0 20 remove_watcher() i=5 2024-09-10T06:24:43.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.498+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94314983510640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b16ce50 con 0x7f4fa80ab030 2024-09-10T06:24:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.502+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94314983510640] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.502+0000 7f4fb2ba89c0 20 remove_watcher() i=6 2024-09-10T06:24:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.502+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94314983513136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c76b1697b0 con 0x7f4fa80ab030 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.502+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94314983513136] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0026040 con 0x7f4fa80ab030 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.502+0000 7f4fb2ba89c0 20 remove_watcher() i=7 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4fa80ab030 msgr2=0x7f4fa80f7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f4fa80ab030 0x7f4fa80f7a40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b15ab90 msgr2=0x55c76b15d020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b15ab90 0x55c76b15d020 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b15f550 msgr2=0x55c76b161940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b15f550 0x55c76b161940 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b163e30 msgr2=0x55c76b166260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b163e30 0x55c76b166260 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e80039a20 msgr2=0x7f4e8003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e80039a20 0x7f4e8003bee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004fd0 tx=0x7f4fa4010000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 msgr2=0x55c76b14f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80f0040 tx=0x7f4fa80ddef0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/28981169 reap_dead start 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 shutdown_connections 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/28981169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b149660 0x55c76b14f950 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 >> 172.21.15.117:0/28981169 conn(0x55c76b144a80 msgr2=0x55c76b142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 shutdown_connections 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/28981169 wait complete. 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 msgr2=0x7f4e8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 0x7f4e8803bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55c76b12c5d0 tx=0x7f4fa400f000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 msgr2=0x55c76b028a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80eb010 tx=0x7f4fa80b5ab0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 shutdown_connections 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e88039a70 0x7f4e8803bf30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/211162596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b02a160 0x55c76b028a00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 >> 172.21.15.117:0/211162596 conn(0x55c76b12f640 msgr2=0x55c76b12fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 shutdown_connections 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/211162596 wait complete. 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b028040 msgr2=0x55c76b122fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55c76b028040 0x55c76b122fe0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b1257a0 msgr2=0x55c76b127b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55c76b1257a0 0x55c76b127b90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b1296a0 msgr2=0x55c76b12ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55c76b1296a0 0x55c76b12ba90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e98039a70 msgr2=0x7f4e9803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4e98039a70 0x7f4e9803bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4001650 tx=0x7f4fa4006720 comp rx=0 tx=0).stop 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 msgr2=0x55c76b11be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 --2- 172.21.15.117:0/209617184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c76b0276f0 0x55c76b11be70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80ae040 tx=0x7f4fa8018020 comp rx=0 tx=0).stop 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb0eaf640 1 -- 172.21.15.117:0/209617184 reap_dead start 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 shutdown_connections 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 >> 172.21.15.117:0/209617184 conn(0x55c76b023640 msgr2=0x55c76b10ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 shutdown_connections 2024-09-10T06:24:43.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.506+0000 7f4fb2ba89c0 1 -- 172.21.15.117:0/209617184 wait complete. 2024-09-10T06:24:43.517 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.517 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.518 ERROR:root:0 2024-09-10T06:24:43.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:43.522 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:43.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T06:24:43.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T06:24:43.523 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-10T06:24:43.588 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:43.588 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:43.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f88b059c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5563d02f34f0 0x5563d02f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f88b059c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563d01a79c0 con 0x5563d02f6630 2024-09-10T06:24:43.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f88b059c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x5563d01f76d0 con 0x5563d02f34f0 2024-09-10T06:24:43.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f8660b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5563d02f34f0 0x5563d02f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f85e0a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5563d02f6630 0x5563d02f8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54450/0 (socket says 172.21.15.117:54450) 2024-09-10T06:24:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f8660b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x5563d02f34f0 0x5563d02f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46120/0 (socket says 172.21.15.117:46120) 2024-09-10T06:24:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f85e0a640 1 -- 172.21.15.117:0/845064405 learned_addr learned my addr 172.21.15.117:0/845064405 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f8660b640 1 -- 172.21.15.117:0/845064405 >> v1:172.21.15.84:6789/0 conn(0x5563d02f6630 legacy=0x5563d02f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.586+0000 7f1f8660b640 1 -- 172.21.15.117:0/845064405 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d019bca0 con 0x5563d02f34f0 2024-09-10T06:24:43.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f8660b640 1 --2- 172.21.15.117:0/845064405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02f38d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000a420 tx=0x7f1f8001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abe77533220a2e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f85609640 1 -- 172.21.15.117:0/845064405 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800af070 con 0x5563d02f34f0 2024-09-10T06:24:43.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f85609640 1 -- 172.21.15.117:0/845064405 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800aa530 con 0x5563d02f34f0 2024-09-10T06:24:43.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f85609640 1 -- 172.21.15.117:0/845064405 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800aa850 con 0x5563d02f34f0 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 -- 172.21.15.117:0/845064405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 msgr2=0x5563d02f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/845064405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02f38d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000a420 tx=0x7f1f8001afd0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 -- 172.21.15.117:0/845064405 shutdown_connections 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/845064405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02f38d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 -- 172.21.15.117:0/845064405 >> 172.21.15.117:0/845064405 conn(0x5563d02ef010 msgr2=0x5563d02f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 -- 172.21.15.117:0/845064405 shutdown_connections 2024-09-10T06:24:43.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.590+0000 7f1f88b059c0 1 -- 172.21.15.117:0/845064405 wait complete. 2024-09-10T06:24:43.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.602+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.602+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.602+0000 7f1f88b059c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.602+0000 7f1f88b059c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563d01fb680 con 0x5563d02f34f0 2024-09-10T06:24:43.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46136/0 (socket says 172.21.15.117:46136) 2024-09-10T06:24:43.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 -- 172.21.15.117:0/1083122913 learned_addr learned my addr 172.21.15.117:0/1083122913 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 -- 172.21.15.117:0/1083122913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d0176da0 con 0x5563d02f34f0 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- 172.21.15.117:0/1083122913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1f80018c00 tx=0x7f1f800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859457e985e1c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1e74608640 1 -- 172.21.15.117:0/1083122913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800af040 con 0x5563d02f34f0 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1e74608640 1 -- 172.21.15.117:0/1083122913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800aaa00 con 0x5563d02f34f0 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1e74608640 1 -- 172.21.15.117:0/1083122913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800aace0 con 0x5563d02f34f0 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- 172.21.15.117:0/1083122913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 msgr2=0x5563d02697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/1083122913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1f80018c00 tx=0x7f1f800033b0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- 172.21.15.117:0/1083122913 shutdown_connections 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/1083122913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d02697a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- 172.21.15.117:0/1083122913 >> 172.21.15.117:0/1083122913 conn(0x5563d02ef010 msgr2=0x5563d03da490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- 172.21.15.117:0/1083122913 shutdown_connections 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- 172.21.15.117:0/1083122913 wait complete. 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d03e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f88b059c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563d019da50 con 0x5563d02f34f0 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d03e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d03e8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46152/0 (socket says 172.21.15.117:46152) 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 -- 172.21.15.117:0/2310077015 learned_addr learned my addr 172.21.15.117:0/2310077015 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d03e8570 con 0x5563d02f34f0 2024-09-10T06:24:43.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.606+0000 7f1f8660b640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d03e8010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1f80018c00 tx=0x7f1f80017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 -- 172.21.15.117:0/2310077015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800c5070 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d03e8800 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 -- 172.21.15.117:0/2310077015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800c1690 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d03e9190 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 -- 172.21.15.117:0/2310077015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800c1970 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 -- 172.21.15.117:0/2310077015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f800c1b10 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e6c039a70 0x7f1e6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1e72e05640 1 -- 172.21.15.117:0/2310077015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1f800bb070 con 0x5563d02f34f0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e6c039a70 0x7f1e6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d02f6630 0x5563d03ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d03ef620 con 0x5563d02f6630 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d02f6630 0x5563d03ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e6c039a70 0x7f1e6c03bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c001d80 tx=0x7f1f7c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d02f6630 0x5563d03ef0e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f86e0c640 1 -- 172.21.15.117:0/2310077015 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d02f6630 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d03efa60 con 0x5563d02f6630 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f86e0c640 1 -- 172.21.15.117:0/2310077015 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d02f6630 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d03f1870 0x5563d03f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d03f4330 con 0x5563d03f1870 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f8660b640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d03f1870 0x5563d03f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f8660b640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d03f1870 0x5563d03f3c60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f8660b640 1 -- 172.21.15.117:0/2310077015 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f800c7070 con 0x5563d03f1870 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d03f0710 con 0x5563d02f6630 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f86e0c640 1 -- 172.21.15.117:0/2310077015 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d02f6630 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d03f5770 0x5563d03f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.610+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d03f82d0 con 0x5563d03f5770 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d03f5770 0x5563d03f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d03f5770 0x5563d03f7b60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f85e0a640 1 -- 172.21.15.117:0/2310077015 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d03f5770 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563d0208450 con 0x5563d0405d70 2024-09-10T06:24:43.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46160/0 (socket says 172.21.15.117:46160) 2024-09-10T06:24:43.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f8660b640 1 -- 172.21.15.117:0/2498012736 learned_addr learned my addr 172.21.15.117:0/2498012736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f8660b640 1 -- 172.21.15.117:0/2498012736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d04067d0 con 0x5563d0405d70 2024-09-10T06:24:43.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f8660b640 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aafd0 tx=0x7f1f800a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 -- 172.21.15.117:0/2498012736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800d8070 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d0407030 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 -- 172.21.15.117:0/2498012736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800b3d00 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 -- 172.21.15.117:0/2498012736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800b3370 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d04075a0 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 -- 172.21.15.117:0/2498012736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f800b3510 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 0x7f1e6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1e6bfff640 1 -- 172.21.15.117:0/2498012736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1f800e4050 con 0x5563d0405d70 2024-09-10T06:24:43.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.614+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 0x7f1e6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 0x7f1e6003bf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00bf50 tx=0x7f1f7c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563d0269f30 con 0x5563d0412490 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46170/0 (socket says 172.21.15.117:46170) 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 -- 172.21.15.117:0/3542840649 learned_addr learned my addr 172.21.15.117:0/3542840649 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 -- 172.21.15.117:0/3542840649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d0412e60 con 0x5563d0412490 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- 172.21.15.117:0/3542840649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aaee0 tx=0x7f1f800cbf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7f96a706ff87c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1e69ffb640 1 -- 172.21.15.117:0/3542840649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800f9070 con 0x5563d0412490 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1e69ffb640 1 -- 172.21.15.117:0/3542840649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800d4d30 con 0x5563d0412490 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1e69ffb640 1 -- 172.21.15.117:0/3542840649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800ef030 con 0x5563d0412490 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- 172.21.15.117:0/3542840649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 msgr2=0x5563d0412870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/3542840649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aaee0 tx=0x7f1f800cbf70 comp rx=0 tx=0).stop 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- 172.21.15.117:0/3542840649 shutdown_connections 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/3542840649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d0412870 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- 172.21.15.117:0/3542840649 >> 172.21.15.117:0/3542840649 conn(0x5563d040e8c0 msgr2=0x5563d040cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- 172.21.15.117:0/3542840649 shutdown_connections 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- 172.21.15.117:0/3542840649 wait complete. 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 Processor -- start 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- start start 2024-09-10T06:24:43.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f88b059c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563d0413320 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46182/0 (socket says 172.21.15.117:46182) 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 learned_addr learned my addr 172.21.15.117:0/12974580 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563d0419d40 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.618+0000 7f1f8660b640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aaee0 tx=0x7f1f800f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 -- 172.21.15.117:0/12974580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800b57f0 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563d0419d40 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 -- 172.21.15.117:0/12974580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f800bd970 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 -- 172.21.15.117:0/12974580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f800b5990 con 0x5563d0412490 2024-09-10T06:24:43.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563d041a310 con 0x5563d0412490 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 -- 172.21.15.117:0/12974580 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f8010b020 con 0x5563d0412490 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e50039a70 0x7f1e5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1e57fff640 1 -- 172.21.15.117:0/12974580 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1f8010ebc0 con 0x5563d0412490 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e50039a70 0x7f1e5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d0424a00 0x5563d0426e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d04275e0 con 0x5563d0424a00 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d0424a00 0x5563d0426e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e50039a70 0x7f1e5003bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5563d03f86d0 tx=0x7f1f7c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d0424a00 0x5563d0426e90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 realm 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d04279f0 con 0x5563d0424a00 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d04282c0 con 0x5563d0424a00 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d04293c0 0x5563d042b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d042be00 con 0x5563d04293c0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f8660b640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d04293c0 0x5563d042b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.622+0000 7f1f8660b640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d04293c0 0x5563d042b7b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f88b059c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f88b059c0 20 searching for the correct realm 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d042dce0 0x5563d0430110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0430790 con 0x5563d042dce0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d042dce0 0x5563d0430110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f85e0a640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d042dce0 0x5563d0430110 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0430790 con 0x5563d04293c0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f8660b640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f800fe070 0x7f1f800f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0430790 con 0x7f1f800fe070 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f800fe070 0x7f1f800f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f800fe070 0x7f1f800f5480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.626+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d04293c0 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d04293c0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.630+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d04293c0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d04293c0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d042dce0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.634+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d0424a00 2024-09-10T06:24:43.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5563d0428660 con 0x5563d04293c0 2024-09-10T06:24:43.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:43.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d042c650 con 0x5563d0424a00 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d042ca40 con 0x5563d0424a00 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d042ca40 con 0x5563d042dce0 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 zone default found 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 4 Realm: () 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 zonegroup default 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d0430c10 con 0x7f1f800fe070 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d0432730 con 0x5563d042dce0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d0432ba0 con 0x5563d042dce0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 started sync module instance, tier type = 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.638+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0431aa0 con 0x5563d04293c0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887184183200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0431aa0 con 0x5563d04293c0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0433710 con 0x5563d0424a00 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887184183200] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887184187888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0431aa0 con 0x5563d0424a00 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.642+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0434120 con 0x5563d042dce0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887184187888] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887184180720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0431a10 con 0x5563d042dce0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0434e80 con 0x5563d04293c0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887184193904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0435720 con 0x5563d04293c0 2024-09-10T06:24:43.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0436120 con 0x5563d0424a00 2024-09-10T06:24:43.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887184180720] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.646+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887184193904] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887184192704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0435270 con 0x5563d0424a00 2024-09-10T06:24:43.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d04369c0 con 0x7f1f800fe070 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887184192704] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887184198704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0435270 con 0x7f1f800fe070 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.650+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0436eb0 con 0x7f1f800fe070 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887184198704] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887184202112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0436e70 con 0x7f1f800fe070 2024-09-10T06:24:43.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0437890 con 0x7f1f800fe070 2024-09-10T06:24:43.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887184202112] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887184204672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0437850 con 0x7f1f800fe070 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=0 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=1 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=2 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=3 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=4 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=5 2024-09-10T06:24:43.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.654+0000 7f1f88b059c0 20 add_watcher() i=6 2024-09-10T06:24:43.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887184204672] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 add_watcher() i=7 2024-09-10T06:24:43.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:43.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d043ac80 con 0x5563d0424a00 2024-09-10T06:24:43.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887184200464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d04381a0 con 0x5563d0424a00 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887184200464] v32'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 5 note: GC not initialized 2024-09-10T06:24:43.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1db77fe640 20 reqs_thread_entry: start 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 Filter name: none 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1db57fa640 20 reqs_thread_entry: start 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.658+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d045e300 con 0x7f1f800fe070 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:43.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d0465090 con 0x7f1f800fe070 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93887184390912 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5563d0460760 con 0x5563d0424a00 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 93887184192704 notify 137438953501 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f1f78010040 con 0x5563d0424a00 2024-09-10T06:24:43.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 93887184192704 notifier 4876 bl.length()=666 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 93887184390912 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1e69ffb640 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e4c003eb0 con 0x5563d0424a00 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.662+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 93887184390912 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1f7800ac70 con 0x5563d0424a00 2024-09-10T06:24:43.667 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:43.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887184200464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d0424a00 2024-09-10T06:24:43.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93887184200464] v32'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887184183200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d04293c0 2024-09-10T06:24:43.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93887184183200] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f88b059c0 20 remove_watcher() i=0 2024-09-10T06:24:43.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f88b059c0 2 removed watcher, disabling cache 2024-09-10T06:24:43.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.666+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887184187888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d0424a00 2024-09-10T06:24:43.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93887184187888] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 20 remove_watcher() i=1 2024-09-10T06:24:43.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887184180720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d042dce0 2024-09-10T06:24:43.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f85e0a640 1 -- 172.21.15.117:0/12974580 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93887184180720] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c00e620 con 0x5563d042dce0 2024-09-10T06:24:43.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 20 remove_watcher() i=2 2024-09-10T06:24:43.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887184193904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d04293c0 2024-09-10T06:24:43.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f8660b640 1 -- 172.21.15.117:0/12974580 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93887184193904] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f800fb030 con 0x5563d04293c0 2024-09-10T06:24:43.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 20 remove_watcher() i=3 2024-09-10T06:24:43.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.670+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887184192704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x5563d0424a00 2024-09-10T06:24:43.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.674+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93887184192704] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x5563d0424a00 2024-09-10T06:24:43.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.674+0000 7f1f88b059c0 20 remove_watcher() i=4 2024-09-10T06:24:43.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.674+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887184198704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x7f1f800fe070 2024-09-10T06:24:43.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93887184198704] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f88b059c0 20 remove_watcher() i=5 2024-09-10T06:24:43.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887184202112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x7f1f800fe070 2024-09-10T06:24:43.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93887184202112] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f88b059c0 20 remove_watcher() i=6 2024-09-10T06:24:43.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.678+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887184204672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5563d045c050 con 0x7f1f800fe070 2024-09-10T06:24:43.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93887184204672] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f780083f0 con 0x7f1f800fe070 2024-09-10T06:24:43.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 20 remove_watcher() i=7 2024-09-10T06:24:43.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f800fe070 msgr2=0x7f1f800f5480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f1f800fe070 0x7f1f800f5480 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d0424a00 msgr2=0x5563d0426e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d0424a00 0x5563d0426e90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d04293c0 msgr2=0x5563d042b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d04293c0 0x5563d042b7b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d042dce0 msgr2=0x5563d0430110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d042dce0 0x5563d0430110 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e50039a70 msgr2=0x7f1e5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e50039a70 0x7f1e5003bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5563d03f86d0 tx=0x7f1f7c010000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 msgr2=0x5563d04197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aaee0 tx=0x7f1f800f5000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f86e0c640 1 -- 172.21.15.117:0/12974580 reap_dead start 2024-09-10T06:24:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 shutdown_connections 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/12974580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0412490 0x5563d04197e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 >> 172.21.15.117:0/12974580 conn(0x5563d040e8c0 msgr2=0x5563d040cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 shutdown_connections 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/12974580 wait complete. 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 msgr2=0x7f1e6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 0x7f1e6003bf30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00bf50 tx=0x7f1f7c00f000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 msgr2=0x5563d0406190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1f800aafd0 tx=0x7f1f800a9690 comp rx=0 tx=0).stop 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 shutdown_connections 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e60039a70 0x7f1e6003bf30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2498012736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d0405d70 0x5563d0406190 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 >> 172.21.15.117:0/2498012736 conn(0x5563d03fb720 msgr2=0x5563d03fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 shutdown_connections 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2498012736 wait complete. 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d02f6630 msgr2=0x5563d03ef0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5563d02f6630 0x5563d03ef0e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d03f1870 msgr2=0x5563d03f3c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5563d03f1870 0x5563d03f3c60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d03f5770 msgr2=0x5563d03f7b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5563d03f5770 0x5563d03f7b60 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e6c039a70 msgr2=0x7f1e6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1e6c039a70 0x7f1e6c03bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c001d80 tx=0x7f1f7c0012e0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 msgr2=0x5563d03e8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 --2- 172.21.15.117:0/2310077015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563d02f34f0 0x5563d03e8010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1f80018c00 tx=0x7f1f80017d70 comp rx=0 tx=0).stop 2024-09-10T06:24:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f86e0c640 1 -- 172.21.15.117:0/2310077015 reap_dead start 2024-09-10T06:24:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 shutdown_connections 2024-09-10T06:24:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 >> 172.21.15.117:0/2310077015 conn(0x5563d02ef010 msgr2=0x5563d0268460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 shutdown_connections 2024-09-10T06:24:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.682+0000 7f1f88b059c0 1 -- 172.21.15.117:0/2310077015 wait complete. 2024-09-10T06:24:43.694 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.694 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.694 ERROR:root:0 2024-09-10T06:24:43.694 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:43.699 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:43.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:43.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:43.700 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T06:24:43.765 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:43.765 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:43.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239f19f9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564c0c6d48c0 0x564c0c6d6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239f19f9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c0c5829c0 con 0x564c0c6d0770 2024-09-10T06:24:43.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239f19f9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x564c0c5d26d0 con 0x564c0c6d48c0 2024-09-10T06:24:43.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239c4a4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x564c0c6d48c0 0x564c0c6d6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239cca5640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x564c0c6d0770 0x564c0c6d0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54452/0 (socket says 172.21.15.117:54452) 2024-09-10T06:24:43.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.762+0000 7f239cca5640 1 -- 172.21.15.117:0/774868907 learned_addr learned my addr 172.21.15.117:0/774868907 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:43.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239c4a4640 1 -- 172.21.15.117:0/774868907 >> v1:172.21.15.84:6789/0 conn(0x564c0c6d0770 legacy=0x564c0c6d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239c4a4640 1 -- 172.21.15.117:0/774868907 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c576ca0 con 0x564c0c6d48c0 2024-09-10T06:24:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239c4a4640 1 --2- 172.21.15.117:0/774868907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d48c0 0x564c0c6d6cb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f239000a480 tx=0x7f239001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d0fcff27e1a58e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239bca3640 1 -- 172.21.15.117:0/774868907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23900aa570 con 0x564c0c6d48c0 2024-09-10T06:24:43.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239bca3640 1 -- 172.21.15.117:0/774868907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23900af070 con 0x564c0c6d48c0 2024-09-10T06:24:43.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239bca3640 1 -- 172.21.15.117:0/774868907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23900aa860 con 0x564c0c6d48c0 2024-09-10T06:24:43.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 -- 172.21.15.117:0/774868907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d48c0 msgr2=0x564c0c6d6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/774868907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d48c0 0x564c0c6d6cb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f239000a480 tx=0x7f239001b310 comp rx=0 tx=0).stop 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 -- 172.21.15.117:0/774868907 shutdown_connections 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/774868907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d48c0 0x564c0c6d6cb0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 -- 172.21.15.117:0/774868907 >> 172.21.15.117:0/774868907 conn(0x564c0c644080 msgr2=0x564c0c644490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 -- 172.21.15.117:0/774868907 shutdown_connections 2024-09-10T06:24:43.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.766+0000 7f239f19f9c0 1 -- 172.21.15.117:0/774868907 wait complete. 2024-09-10T06:24:43.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564c0c5d6680 con 0x564c0c6d0770 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46212/0 (socket says 172.21.15.117:46212) 2024-09-10T06:24:43.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 -- 172.21.15.117:0/3337562670 learned_addr learned my addr 172.21.15.117:0/3337562670 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 -- 172.21.15.117:0/3337562670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c551da0 con 0x564c0c6d0770 2024-09-10T06:24:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 --2- 172.21.15.117:0/3337562670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f238c001e50 tx=0x7f238c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf637aa09aae21b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f228ae0d640 1 -- 172.21.15.117:0/3337562670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c012020 con 0x564c0c6d0770 2024-09-10T06:24:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f228ae0d640 1 -- 172.21.15.117:0/3337562670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c00e7c0 con 0x564c0c6d0770 2024-09-10T06:24:43.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f228ae0d640 1 -- 172.21.15.117:0/3337562670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c00eaa0 con 0x564c0c6d0770 2024-09-10T06:24:43.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- 172.21.15.117:0/3337562670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 msgr2=0x564c0c7bba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/3337562670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f238c001e50 tx=0x7f238c001e80 comp rx=0 tx=0).stop 2024-09-10T06:24:43.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- 172.21.15.117:0/3337562670 shutdown_connections 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/3337562670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7bba10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- 172.21.15.117:0/3337562670 >> 172.21.15.117:0/3337562670 conn(0x564c0c644080 msgr2=0x564c0c7b76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- 172.21.15.117:0/3337562670 shutdown_connections 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- 172.21.15.117:0/3337562670 wait complete. 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239f19f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564c0c578a50 con 0x564c0c6d0770 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46214/0 (socket says 172.21.15.117:46214) 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.782+0000 7f239cca5640 1 -- 172.21.15.117:0/1409850360 learned_addr learned my addr 172.21.15.117:0/1409850360 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239cca5640 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c7c3610 con 0x564c0c6d0770 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239cca5640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7c30b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x564c0c7bca00 tx=0x7f238c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 -- 172.21.15.117:0/1409850360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c012030 con 0x564c0c6d0770 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c0c7c38a0 con 0x564c0c6d0770 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 -- 172.21.15.117:0/1409850360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c01a680 con 0x564c0c6d0770 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c0c7c4250 con 0x564c0c6d0770 2024-09-10T06:24:43.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 -- 172.21.15.117:0/1409850360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c01a960 con 0x564c0c6d0770 2024-09-10T06:24:43.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 -- 172.21.15.117:0/1409850360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f238c015020 con 0x564c0c6d0770 2024-09-10T06:24:43.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2284039a70 0x7f228403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f228960a640 1 -- 172.21.15.117:0/1409850360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f238c020070 con 0x564c0c6d0770 2024-09-10T06:24:43.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239c4a4640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2284039a70 0x7f228403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c6d48c0 0x564c0c7ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c7ca760 con 0x564c0c6d48c0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239d4a6640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c6d48c0 0x564c0c7ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239c4a4640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2284039a70 0x7f228403bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23900ae000 tx=0x7f23900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239d4a6640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c6d48c0 0x564c0c7ca220 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239d4a6640 1 -- 172.21.15.117:0/1409850360 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c6d48c0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c7cab20 con 0x564c0c6d48c0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239d4a6640 1 -- 172.21.15.117:0/1409850360 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c6d48c0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c7cc930 0x564c0c7ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c7cf3f0 con 0x564c0c7cc930 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239cca5640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c7cc930 0x564c0c7ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.786+0000 7f239cca5640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c7cc930 0x564c0c7ced20 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 -- 172.21.15.117:0/1409850360 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f238c008030 con 0x564c0c7cc930 2024-09-10T06:24:43.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c7cb7a0 con 0x564c0c6d48c0 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239d4a6640 1 -- 172.21.15.117:0/1409850360 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c6d48c0 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c7d0830 0x564c0c7d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c7d3390 con 0x564c0c7d0830 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239c4a4640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c7d0830 0x564c0c7d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239c4a4640 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c7d0830 0x564c0c7d2c20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239c4a4640 1 -- 172.21.15.117:0/1409850360 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c7d0830 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564c0c5e3450 con 0x564c0c7e0e30 2024-09-10T06:24:43.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46220/0 (socket says 172.21.15.117:46220) 2024-09-10T06:24:43.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 -- 172.21.15.117:0/532076915 learned_addr learned my addr 172.21.15.117:0/532076915 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 -- 172.21.15.117:0/532076915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c7e1890 con 0x564c0c7e0e30 2024-09-10T06:24:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239cca5640 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f238c0168f0 tx=0x7f238c024730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f22827fc640 1 -- 172.21.15.117:0/532076915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c00dae0 con 0x564c0c7e0e30 2024-09-10T06:24:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f22827fc640 1 -- 172.21.15.117:0/532076915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c00dc80 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f22827fc640 1 -- 172.21.15.117:0/532076915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c04d330 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c0c7e20f0 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.790+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c0c7e2660 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f22827fc640 1 -- 172.21.15.117:0/532076915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f238c04d040 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f22827fc640 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 0x7f227403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f22827fc640 1 -- 172.21.15.117:0/532076915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f238c04a040 con 0x564c0c7e0e30 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239c4a4640 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 0x7f227403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239c4a4640 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 0x7f227403bf80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f239000a480 tx=0x7f2390005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564c0c7bc260 con 0x564c0c7ee660 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46228/0 (socket says 172.21.15.117:46228) 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239cca5640 1 -- 172.21.15.117:0/2175589264 learned_addr learned my addr 172.21.15.117:0/2175589264 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239cca5640 1 -- 172.21.15.117:0/2175589264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c7ef030 con 0x564c0c7ee660 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239cca5640 1 --2- 172.21.15.117:0/2175589264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f238c025ff0 tx=0x7f238c0508d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaddb43c5754d20a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f2273fff640 1 -- 172.21.15.117:0/2175589264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c060070 con 0x564c0c7ee660 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f2273fff640 1 -- 172.21.15.117:0/2175589264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c03fcf0 con 0x564c0c7ee660 2024-09-10T06:24:43.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f2273fff640 1 -- 172.21.15.117:0/2175589264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c057040 con 0x564c0c7ee660 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- 172.21.15.117:0/2175589264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 msgr2=0x564c0c7eea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/2175589264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f238c025ff0 tx=0x7f238c0508d0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- 172.21.15.117:0/2175589264 shutdown_connections 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/2175589264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7eea40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- 172.21.15.117:0/2175589264 >> 172.21.15.117:0/2175589264 conn(0x564c0c7e9a20 msgr2=0x564c0c7e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- 172.21.15.117:0/2175589264 shutdown_connections 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- 172.21.15.117:0/2175589264 wait complete. 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 Processor -- start 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- start start 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.794+0000 7f239f19f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564c0c7ed3d0 con 0x564c0c7ee660 2024-09-10T06:24:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239cca5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46242/0 (socket says 172.21.15.117:46242) 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 learned_addr learned my addr 172.21.15.117:0/596065365 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0c7f4e00 con 0x564c0c7ee660 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239cca5640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f238c02d7c0 tx=0x7f238c0478f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 -- 172.21.15.117:0/596065365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c060030 con 0x564c0c7ee660 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c0c7f4e00 con 0x564c0c7ee660 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 -- 172.21.15.117:0/596065365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c03fcf0 con 0x564c0c7ee660 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c0c7f4e00 con 0x564c0c7ee660 2024-09-10T06:24:43.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 -- 172.21.15.117:0/596065365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f238c023800 con 0x564c0c7ee660 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 -- 172.21.15.117:0/596065365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f238c06e030 con 0x564c0c7ee660 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2268039a20 0x7f226803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f22727fc640 1 -- 172.21.15.117:0/596065365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f238c06c020 con 0x564c0c7ee660 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239c4a4640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2268039a20 0x7f226803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c7ffaf0 0x564c0c801f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c8026d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239d4a6640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c7ffaf0 0x564c0c801f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239c4a4640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2268039a20 0x7f226803bee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2390018f40 tx=0x7f23900a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239d4a6640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c7ffaf0 0x564c0c801f80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 realm 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c802ae0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c8033b0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.798+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c8044b0 0x564c0c8068a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c806eb0 con 0x564c0c8044b0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c8044b0 0x564c0c8068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c8044b0 0x564c0c8068a0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 20 searching for the correct realm 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c808d90 0x564c0c80b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80b840 con 0x564c0c808d90 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239c4a4640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c808d90 0x564c0c80b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239c4a4640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c808d90 0x564c0c80b1c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80b840 con 0x564c0c8044b0 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f238c017050 0x7f238c037050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80b840 con 0x7f238c017050 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f238c017050 0x7f238c037050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f238c017050 0x7f238c037050 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.802+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c8044b0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c8044b0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.806+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c8044b0 2024-09-10T06:24:43.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c8044b0 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.810+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c808d90 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x7f238c017050 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c7ffaf0 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c0c803750 con 0x564c0c8044b0 2024-09-10T06:24:43.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c807700 con 0x564c0c7ffaf0 2024-09-10T06:24:43.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c807af0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c807af0 con 0x564c0c808d90 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 zone default found 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 4 Realm: () 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 zonegroup default 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80bcc0 con 0x7f238c017050 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80d7b0 con 0x564c0c808d90 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80dba0 con 0x564c0c808d90 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 started sync module instance, tier type = 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.814+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80cb50 con 0x564c0c8044b0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94884627271536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80c7b0 con 0x564c0c8044b0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80ea80 con 0x564c0c7ffaf0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94884627271536] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94884627277264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80e9f0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.818+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80f830 con 0x564c0c808d90 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94884627277264] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94884627279472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c80fc20 con 0x564c0c808d90 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c8105e0 con 0x564c0c8044b0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94884627286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c811250 con 0x564c0c8044b0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c811c10 con 0x564c0c7ffaf0 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94884627279472] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.822+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94884627286400] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94884627289952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c811250 con 0x564c0c7ffaf0 2024-09-10T06:24:43.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c811b80 con 0x7f238c017050 2024-09-10T06:24:43.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94884627289952] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94884627287456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c8111c0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.826+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c812a40 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94884627287456] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94884627292016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c812a40 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c813400 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94884627292016] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94884627293856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c813400 con 0x7f238c017050 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=0 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=1 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=2 2024-09-10T06:24:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=3 2024-09-10T06:24:43.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=4 2024-09-10T06:24:43.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=5 2024-09-10T06:24:43.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.830+0000 7f239f19f9c0 20 add_watcher() i=6 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94884627293856] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 add_watcher() i=7 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c8166f0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94884627296448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c813990 con 0x564c0c7ffaf0 2024-09-10T06:24:43.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94884627296448] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f22537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 5 note: GC not initialized 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f22527e4640 20 reqs_thread_entry: start 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 Filter name: none 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f224b7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.834+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c839df0 con 0x7f238c017050 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239f19f9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239f19f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239f19f9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239f19f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:43.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.838+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c840b90 con 0x7f238c017050 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239f19f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239f19f9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239f19f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94884627482112 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c0c83c220 con 0x564c0c7ffaf0 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94884627289952 notify 137438953502 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f2394018c80 con 0x564c0c7ffaf0 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f2273fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94884627289952 notifier 4883 bl.length()=679 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f2273fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:43.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f2273fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:43.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94884627482112 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f2273fff640 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2260003eb0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94884627482112 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2394034410 con 0x564c0c7ffaf0 2024-09-10T06:24:43.846 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:43.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f22537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:43.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.842+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94884627296448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c7ffaf0 2024-09-10T06:24:43.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94884627296448] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94884627271536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c8044b0 2024-09-10T06:24:43.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94884627271536] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 20 remove_watcher() i=0 2024-09-10T06:24:43.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 2 removed watcher, disabling cache 2024-09-10T06:24:43.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94884627277264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c7ffaf0 2024-09-10T06:24:43.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94884627277264] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 20 remove_watcher() i=1 2024-09-10T06:24:43.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.846+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94884627279472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c808d90 2024-09-10T06:24:43.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239c4a4640 1 -- 172.21.15.117:0/596065365 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94884627279472] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23900a8070 con 0x564c0c808d90 2024-09-10T06:24:43.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239f19f9c0 20 remove_watcher() i=2 2024-09-10T06:24:43.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94884627286400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c8044b0 2024-09-10T06:24:43.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239cca5640 1 -- 172.21.15.117:0/596065365 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94884627286400] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f238c03c020 con 0x564c0c8044b0 2024-09-10T06:24:43.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239f19f9c0 20 remove_watcher() i=3 2024-09-10T06:24:43.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.850+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94884627289952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x564c0c7ffaf0 2024-09-10T06:24:43.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94884627289952] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x564c0c7ffaf0 2024-09-10T06:24:43.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239f19f9c0 20 remove_watcher() i=4 2024-09-10T06:24:43.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94884627287456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x7f238c017050 2024-09-10T06:24:43.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94884627287456] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239f19f9c0 20 remove_watcher() i=5 2024-09-10T06:24:43.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.854+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94884627292016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x7f238c017050 2024-09-10T06:24:43.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94884627292016] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 20 remove_watcher() i=6 2024-09-10T06:24:43.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94884627293856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c0c837b20 con 0x7f238c017050 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94884627293856] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f239400a4d0 con 0x7f238c017050 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 20 remove_watcher() i=7 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f238c017050 msgr2=0x7f238c037050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f238c017050 0x7f238c037050 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c7ffaf0 msgr2=0x564c0c801f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c7ffaf0 0x564c0c801f80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c8044b0 msgr2=0x564c0c8068a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c8044b0 0x564c0c8068a0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c808d90 msgr2=0x564c0c80b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c808d90 0x564c0c80b1c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2268039a20 msgr2=0x7f226803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2268039a20 0x7f226803bee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2390018f40 tx=0x7f23900a8000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 msgr2=0x564c0c7f48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239d4a6640 1 -- 172.21.15.117:0/596065365 reap_dead start 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f238c02d7c0 tx=0x7f238c0478f0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 shutdown_connections 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/596065365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7ee660 0x564c0c7f48a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 >> 172.21.15.117:0/596065365 conn(0x564c0c7e9a20 msgr2=0x564c0c7e7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 shutdown_connections 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/596065365 wait complete. 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 msgr2=0x7f227403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 0x7f227403bf80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f239000a480 tx=0x7f2390005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 msgr2=0x564c0c7e1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f238c0168f0 tx=0x7f238c024730 comp rx=0 tx=0).stop 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 shutdown_connections 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2274039ac0 0x7f227403bf80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/532076915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c7e0e30 0x564c0c7e1250 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 >> 172.21.15.117:0/532076915 conn(0x564c0c7d67e0 msgr2=0x564c0c7d6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 shutdown_connections 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/532076915 wait complete. 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c6d48c0 msgr2=0x564c0c7ca220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x564c0c6d48c0 0x564c0c7ca220 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c7cc930 msgr2=0x564c0c7ced20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x564c0c7cc930 0x564c0c7ced20 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c7d0830 msgr2=0x564c0c7d2c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x564c0c7d0830 0x564c0c7d2c20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2284039a70 msgr2=0x7f228403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f2284039a70 0x7f228403bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23900ae000 tx=0x7f23900a6000 comp rx=0 tx=0).stop 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 msgr2=0x564c0c7c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239f19f9c0 1 --2- 172.21.15.117:0/1409850360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564c0c6d0770 0x564c0c7c30b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x564c0c7bca00 tx=0x7f238c000ee0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.858+0000 7f239d4a6640 1 -- 172.21.15.117:0/1409850360 reap_dead start 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.862+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 shutdown_connections 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.862+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 >> 172.21.15.117:0/1409850360 conn(0x564c0c644080 msgr2=0x564c0c7b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.862+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 shutdown_connections 2024-09-10T06:24:43.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.862+0000 7f239f19f9c0 1 -- 172.21.15.117:0/1409850360 wait complete. 2024-09-10T06:24:43.872 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.872 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:43.872 ERROR:root:0 2024-09-10T06:24:43.872 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:43.877 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:43.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T06:24:43.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T06:24:43.877 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-10T06:24:43.943 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:43.943 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:43.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f497987f9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b02da3a8c0 0x55b02da3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f497987f9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b02d8e89c0 con 0x55b02da36770 2024-09-10T06:24:43.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f497987f9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x55b02d9386d0 con 0x55b02da3a8c0 2024-09-10T06:24:43.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f4976b84640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55b02da3a8c0 0x55b02da3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f4977385640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x55b02da36770 0x55b02da36b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54462/0 (socket says 172.21.15.117:54462) 2024-09-10T06:24:43.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f4977385640 1 -- 172.21.15.117:0/481883531 learned_addr learned my addr 172.21.15.117:0/481883531 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:43.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f4976b84640 1 -- 172.21.15.117:0/481883531 >> v1:172.21.15.84:6789/0 conn(0x55b02da36770 legacy=0x55b02da36b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.942+0000 7f4976b84640 1 -- 172.21.15.117:0/481883531 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d8dcca0 con 0x55b02da3a8c0 2024-09-10T06:24:43.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f4976b84640 1 --2- 172.21.15.117:0/481883531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da3a8c0 0x55b02da3ccb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f496c00a480 tx=0x7f496c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4d12a08ad1edb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f4976383640 1 -- 172.21.15.117:0/481883531 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c0aa570 con 0x55b02da3a8c0 2024-09-10T06:24:43.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f4976383640 1 -- 172.21.15.117:0/481883531 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0af070 con 0x55b02da3a8c0 2024-09-10T06:24:43.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f4976383640 1 -- 172.21.15.117:0/481883531 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c0aa860 con 0x55b02da3a8c0 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 -- 172.21.15.117:0/481883531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da3a8c0 msgr2=0x55b02da3ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 --2- 172.21.15.117:0/481883531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da3a8c0 0x55b02da3ccb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f496c00a480 tx=0x7f496c01b310 comp rx=0 tx=0).stop 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 -- 172.21.15.117:0/481883531 shutdown_connections 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 --2- 172.21.15.117:0/481883531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da3a8c0 0x55b02da3ccb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 -- 172.21.15.117:0/481883531 >> 172.21.15.117:0/481883531 conn(0x55b02d9aa080 msgr2=0x55b02d9aa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 -- 172.21.15.117:0/481883531 shutdown_connections 2024-09-10T06:24:43.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.946+0000 7f497987f9c0 1 -- 172.21.15.117:0/481883531 wait complete. 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f497987f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f497987f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b02d93c680 con 0x55b02da36770 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46250/0 (socket says 172.21.15.117:46250) 2024-09-10T06:24:43.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f4977385640 1 -- 172.21.15.117:0/2412184149 learned_addr learned my addr 172.21.15.117:0/2412184149 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f4977385640 1 -- 172.21.15.117:0/2412184149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02d8b7da0 con 0x55b02da36770 2024-09-10T06:24:43.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f4977385640 1 --2- 172.21.15.117:0/2412184149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4968001e00 tx=0x7f496800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabd24fae49c8201 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f486560a640 1 -- 172.21.15.117:0/2412184149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968012020 con 0x55b02da36770 2024-09-10T06:24:43.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f486560a640 1 -- 172.21.15.117:0/2412184149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496800e690 con 0x55b02da36770 2024-09-10T06:24:43.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.958+0000 7f486560a640 1 -- 172.21.15.117:0/2412184149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496800ea10 con 0x55b02da36770 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/2412184149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 msgr2=0x55b02db21a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 --2- 172.21.15.117:0/2412184149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4968001e00 tx=0x7f496800b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/2412184149 shutdown_connections 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 --2- 172.21.15.117:0/2412184149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db21a40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/2412184149 >> 172.21.15.117:0/2412184149 conn(0x55b02d9aa080 msgr2=0x55b02db1d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/2412184149 shutdown_connections 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/2412184149 wait complete. 2024-09-10T06:24:43.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db290e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b02d8dea50 con 0x55b02da36770 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db290e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46256/0 (socket says 172.21.15.117:46256) 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4977385640 1 -- 172.21.15.117:0/3838065448 learned_addr learned my addr 172.21.15.117:0/3838065448 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4977385640 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02db29640 con 0x55b02da36770 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4977385640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db290e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55b02db22a30 tx=0x7f4968000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 -- 172.21.15.117:0/3838065448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968012030 con 0x55b02da36770 2024-09-10T06:24:43.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02db298d0 con 0x55b02da36770 2024-09-10T06:24:43.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 -- 172.21.15.117:0/3838065448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496801a750 con 0x55b02da36770 2024-09-10T06:24:43.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02db2a280 con 0x55b02da36770 2024-09-10T06:24:43.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 -- 172.21.15.117:0/3838065448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496801aa30 con 0x55b02da36770 2024-09-10T06:24:43.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 -- 172.21.15.117:0/3838065448 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4968015020 con 0x55b02da36770 2024-09-10T06:24:43.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f485c039a70 0x7f485c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.962+0000 7f4863e07640 1 -- 172.21.15.117:0/3838065448 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4968020030 con 0x55b02da36770 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4976b84640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f485c039a70 0x7f485c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02da3a8c0 0x55b02db30250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db30790 con 0x55b02da3a8c0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977b86640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02da3a8c0 0x55b02db30250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4976b84640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f485c039a70 0x7f485c03bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ae000 tx=0x7f496c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977b86640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02da3a8c0 0x55b02db30250 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977b86640 1 -- 172.21.15.117:0/3838065448 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02da3a8c0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db30b50 con 0x55b02da3a8c0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977b86640 1 -- 172.21.15.117:0/3838065448 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02da3a8c0 2024-09-10T06:24:43.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db32960 0x55b02db34d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db35420 con 0x55b02db32960 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977385640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db32960 0x55b02db34d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977385640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db32960 0x55b02db34d50 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977385640 1 -- 172.21.15.117:0/3838065448 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4968008030 con 0x55b02db32960 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db31800 con 0x55b02da3a8c0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977b86640 1 -- 172.21.15.117:0/3838065448 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02da3a8c0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db36860 0x55b02db38c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db393e0 con 0x55b02db36860 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4976b84640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db36860 0x55b02db38c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4976b84640 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db36860 0x55b02db38c50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4976b84640 1 -- 172.21.15.117:0/3838065448 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db36860 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f497987f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b02d949450 con 0x55b02db46ea0 2024-09-10T06:24:43.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.966+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46268/0 (socket says 172.21.15.117:46268) 2024-09-10T06:24:43.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 -- 172.21.15.117:0/279185778 learned_addr learned my addr 172.21.15.117:0/279185778 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 -- 172.21.15.117:0/279185778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02db47900 con 0x55b02db46ea0 2024-09-10T06:24:43.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4968025ff0 tx=0x7f496800c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 -- 172.21.15.117:0/279185778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496800d7b0 con 0x55b02db46ea0 2024-09-10T06:24:43.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02db48160 con 0x55b02db46ea0 2024-09-10T06:24:43.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 -- 172.21.15.117:0/279185778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496800dae0 con 0x55b02db46ea0 2024-09-10T06:24:43.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 -- 172.21.15.117:0/279185778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496800ddc0 con 0x55b02db46ea0 2024-09-10T06:24:43.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02db486d0 con 0x55b02db46ea0 2024-09-10T06:24:43.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 -- 172.21.15.117:0/279185778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f496804d040 con 0x55b02db46ea0 2024-09-10T06:24:43.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 0x7f485003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4861602640 1 -- 172.21.15.117:0/279185778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f496804a040 con 0x55b02db46ea0 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4976b84640 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 0x7f485003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4976b84640 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 0x7f485003bee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f496c0aa650 tx=0x7f496c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f497987f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b02db22290 con 0x55b02db53640 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46274/0 (socket says 172.21.15.117:46274) 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 -- 172.21.15.117:0/342494682 learned_addr learned my addr 172.21.15.117:0/342494682 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.970+0000 7f4977385640 1 -- 172.21.15.117:0/342494682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02db53ff0 con 0x55b02db53640 2024-09-10T06:24:43.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 --2- 172.21.15.117:0/342494682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f496802ffd0 tx=0x7f49680249b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa84006a56615a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f485affd640 1 -- 172.21.15.117:0/342494682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968060070 con 0x55b02db53640 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f485affd640 1 -- 172.21.15.117:0/342494682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4968035960 con 0x55b02db53640 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f485affd640 1 -- 172.21.15.117:0/342494682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680355c0 con 0x55b02db53640 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/342494682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 msgr2=0x55b02db53a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 --2- 172.21.15.117:0/342494682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f496802ffd0 tx=0x7f49680249b0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/342494682 shutdown_connections 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 --2- 172.21.15.117:0/342494682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db53a20 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/342494682 >> 172.21.15.117:0/342494682 conn(0x55b02db4fa70 msgr2=0x55b02db4dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/342494682 shutdown_connections 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/342494682 wait complete. 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 Processor -- start 2024-09-10T06:24:43.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- start start 2024-09-10T06:24:43.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db5a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b02db544d0 con 0x55b02db53640 2024-09-10T06:24:43.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db5a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db5a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46290/0 (socket says 172.21.15.117:46290) 2024-09-10T06:24:43.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 learned_addr learned my addr 172.21.15.117:0/1545815121 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02db5aef0 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f4977385640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db5a990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4968050860 tx=0x7f4968032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f48597fa640 1 -- 172.21.15.117:0/1545815121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496806b020 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b02db5aef0 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f48597fa640 1 -- 172.21.15.117:0/1545815121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4968035960 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f48597fa640 1 -- 172.21.15.117:0/1545815121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4968060030 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.974+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02db5b4c0 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f48597fa640 1 -- 172.21.15.117:0/1545815121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f496806e020 con 0x55b02db53640 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f48597fa640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4840039a20 0x7f484003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f48597fa640 1 -- 172.21.15.117:0/1545815121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4968061070 con 0x55b02db53640 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4840039a20 0x7f484003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02db65bd0 0x55b02db68060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db687b0 con 0x55b02db65bd0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02db65bd0 0x55b02db68060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4840039a20 0x7f484003bee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f496c0cd040 tx=0x7f496c0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02db65bd0 0x55b02db68060 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 realm 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db68bc0 con 0x55b02db65bd0 2024-09-10T06:24:43.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69490 con 0x55b02db65bd0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db6a590 0x55b02db6c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db6cf50 con 0x55b02db6a590 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977385640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db6a590 0x55b02db6c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977385640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db6a590 0x55b02db6c980 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 20 searching for the correct realm 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db6eea0 0x55b02db712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db71950 con 0x55b02db6eea0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db6eea0 0x55b02db712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db6eea0 0x55b02db712d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.978+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db71950 con 0x55b02db6a590 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:43.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977385640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f496807b040 0x7f496803a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db71950 con 0x7f496807b040 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f496807b040 0x7f496803a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f496807b040 0x7f496803a1c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6a590 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:43.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.982+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6a590 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:43.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.986+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6a590 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6a590 2024-09-10T06:24:44.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6eea0 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x7f496807b040 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db65bd0 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b02db69830 con 0x55b02db6a590 2024-09-10T06:24:44.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db6d810 con 0x55b02db65bd0 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.990+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db6dc00 con 0x55b02db65bd0 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db6dc00 con 0x55b02db6eea0 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 zone default found 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 4 Realm: () 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 zonegroup default 2024-09-10T06:24:44.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db71dd0 con 0x7f496807b040 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db738c0 con 0x55b02db6eea0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db73cf0 con 0x55b02db6eea0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 started sync module instance, tier type = 2024-09-10T06:24:44.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db72c60 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215169585232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db745e0 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db74e30 con 0x55b02db65bd0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.994+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215169585232] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215169589552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db74e90 con 0x55b02db65bd0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db759a0 con 0x55b02db6eea0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215169594448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db76240 con 0x55b02db6eea0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db76c60 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:43.998+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215169589552] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215169591680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db77500 con 0x55b02db6a590 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db77d50 con 0x55b02db65bd0 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215169591680] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215169594448] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215169601616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db77920 con 0x55b02db65bd0 2024-09-10T06:24:44.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.002+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db785f0 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215169601616] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215169602672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db77890 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db78a80 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215169602672] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215169605552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db78a80 con 0x7f496807b040 2024-09-10T06:24:44.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.006+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db79440 con 0x7f496807b040 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215169605552] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215169607600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db79440 con 0x7f496807b040 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=0 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=1 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=2 2024-09-10T06:24:44.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=3 2024-09-10T06:24:44.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=4 2024-09-10T06:24:44.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=5 2024-09-10T06:24:44.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=6 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215169607600] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 20 add_watcher() i=7 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db7c840 con 0x55b02db65bd0 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.010+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215169610080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db79d60 con 0x55b02db65bd0 2024-09-10T06:24:44.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215169610080] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f482dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 5 note: GC not initialized 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f482cfe1640 20 reqs_thread_entry: start 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 Filter name: none 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f47a67fc640 20 reqs_thread_entry: start 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9ff00 con 0x7f496807b040 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.014+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02dba6d10 con 0x7f496807b040 2024-09-10T06:24:44.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94215169795968 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b02dba2400 con 0x55b02db65bd0 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94215169601616 notify 137438953503 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f4970026410 con 0x55b02db65bd0 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f485affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94215169601616 notifier 4890 bl.length()=636 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f485affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f485affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94215169795968 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f485affd640 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f483c003eb0 con 0x55b02db65bd0 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94215169795968 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f49700265e0 con 0x55b02db65bd0 2024-09-10T06:24:44.022 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:44.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f482dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215169610080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db65bd0 2024-09-10T06:24:44.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94215169610080] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.018+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215169585232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db6a590 2024-09-10T06:24:44.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94215169585232] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f497987f9c0 20 remove_watcher() i=0 2024-09-10T06:24:44.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f497987f9c0 2 removed watcher, disabling cache 2024-09-10T06:24:44.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215169589552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db65bd0 2024-09-10T06:24:44.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94215169589552] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f497987f9c0 20 remove_watcher() i=1 2024-09-10T06:24:44.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.022+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215169594448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db6eea0 2024-09-10T06:24:44.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f4976b84640 1 -- 172.21.15.117:0/1545815121 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94215169594448] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c0a8070 con 0x55b02db6eea0 2024-09-10T06:24:44.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f497987f9c0 20 remove_watcher() i=2 2024-09-10T06:24:44.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215169591680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db6a590 2024-09-10T06:24:44.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f4977385640 1 -- 172.21.15.117:0/1545815121 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94215169591680] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496803c020 con 0x55b02db6a590 2024-09-10T06:24:44.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f497987f9c0 20 remove_watcher() i=3 2024-09-10T06:24:44.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.026+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215169601616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x55b02db65bd0 2024-09-10T06:24:44.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94215169601616] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x55b02db65bd0 2024-09-10T06:24:44.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f497987f9c0 20 remove_watcher() i=4 2024-09-10T06:24:44.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215169602672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x7f496807b040 2024-09-10T06:24:44.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94215169602672] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f497987f9c0 20 remove_watcher() i=5 2024-09-10T06:24:44.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.030+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215169605552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x7f496807b040 2024-09-10T06:24:44.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94215169605552] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 20 remove_watcher() i=6 2024-09-10T06:24:44.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215169607600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b02db9dc20 con 0x7f496807b040 2024-09-10T06:24:44.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94215169607600] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f497000a4d0 con 0x7f496807b040 2024-09-10T06:24:44.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 20 remove_watcher() i=7 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f496807b040 msgr2=0x7f496803a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f496807b040 0x7f496803a1c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02db65bd0 msgr2=0x55b02db68060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02db65bd0 0x55b02db68060 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db6a590 msgr2=0x55b02db6c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db6a590 0x55b02db6c980 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db6eea0 msgr2=0x55b02db712d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db6eea0 0x55b02db712d0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4840039a20 msgr2=0x7f484003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4840039a20 0x7f484003bee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f496c0cd040 tx=0x7f496c0a8000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 msgr2=0x55b02db5a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/1545815121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db53640 0x55b02db5a990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4968050860 tx=0x7f4968032f60 comp rx=0 tx=0).stop 2024-09-10T06:24:44.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f4977b86640 1 -- 172.21.15.117:0/1545815121 reap_dead start 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 shutdown_connections 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 >> 172.21.15.117:0/1545815121 conn(0x55b02db4fa70 msgr2=0x55b02db4dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 shutdown_connections 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/1545815121 wait complete. 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 msgr2=0x7f485003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 0x7f485003bee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f496c0aa650 tx=0x7f496c005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 msgr2=0x55b02db472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4968025ff0 tx=0x7f496800c610 comp rx=0 tx=0).stop 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 shutdown_connections 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4850039a20 0x7f485003bee0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/279185778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02db46ea0 0x55b02db472c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 >> 172.21.15.117:0/279185778 conn(0x55b02db3c850 msgr2=0x55b02db3cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 shutdown_connections 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/279185778 wait complete. 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02da3a8c0 msgr2=0x55b02db30250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x55b02da3a8c0 0x55b02db30250 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db32960 msgr2=0x55b02db34d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55b02db32960 0x55b02db34d50 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db36860 msgr2=0x55b02db38c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x55b02db36860 0x55b02db38c50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f485c039a70 msgr2=0x7f485c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f485c039a70 0x7f485c03bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ae000 tx=0x7f496c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 msgr2=0x55b02db290e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 --2- 172.21.15.117:0/3838065448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b02da36770 0x55b02db290e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x55b02db22a30 tx=0x7f4968000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f4977b86640 1 -- 172.21.15.117:0/3838065448 reap_dead start 2024-09-10T06:24:44.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 shutdown_connections 2024-09-10T06:24:44.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 >> 172.21.15.117:0/3838065448 conn(0x55b02d9aa080 msgr2=0x55b02db1c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 shutdown_connections 2024-09-10T06:24:44.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.034+0000 7f497987f9c0 1 -- 172.21.15.117:0/3838065448 wait complete. 2024-09-10T06:24:44.048 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.048 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.048 ERROR:root:0 2024-09-10T06:24:44.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T06:24:44.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T06:24:44.048 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-10T06:24:44.120 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:44.120 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:44.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe7311c9c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56041f2be8c0 0x56041f2c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe7311c9c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56041f16e9c0 con 0x56041f22e770 2024-09-10T06:24:44.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe7311c9c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x56041f1be6d0 con 0x56041f2be8c0 2024-09-10T06:24:44.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe70421640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x56041f2be8c0 0x56041f2c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe70c22640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x56041f22e770 0x56041f2bd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54476/0 (socket says 172.21.15.117:54476) 2024-09-10T06:24:44.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe70c22640 1 -- 172.21.15.117:0/656280127 learned_addr learned my addr 172.21.15.117:0/656280127 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:44.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe70421640 1 -- 172.21.15.117:0/656280127 >> v1:172.21.15.84:6789/0 conn(0x56041f22e770 legacy=0x56041f2bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.118+0000 7fbe70421640 1 -- 172.21.15.117:0/656280127 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f162ca0 con 0x56041f2be8c0 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe70421640 1 --2- 172.21.15.117:0/656280127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f2be8c0 0x56041f2c0cb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400a480 tx=0x7fbe6401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1c4321cc88387a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe6fc20640 1 -- 172.21.15.117:0/656280127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe640af070 con 0x56041f2be8c0 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe6fc20640 1 -- 172.21.15.117:0/656280127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe640aa530 con 0x56041f2be8c0 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe6fc20640 1 -- 172.21.15.117:0/656280127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe640aa830 con 0x56041f2be8c0 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/656280127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f2be8c0 msgr2=0x56041f2c0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/656280127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f2be8c0 0x56041f2c0cb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400a480 tx=0x7fbe6401b280 comp rx=0 tx=0).stop 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/656280127 shutdown_connections 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/656280127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f2be8c0 0x56041f2c0cb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/656280127 >> 172.21.15.117:0/656280127 conn(0x56041f2b4e90 msgr2=0x56041f2b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/656280127 shutdown_connections 2024-09-10T06:24:44.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.122+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/656280127 wait complete. 2024-09-10T06:24:44.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56041f1c2680 con 0x56041f22e770 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46312/0 (socket says 172.21.15.117:46312) 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 -- 172.21.15.117:0/2172361018 learned_addr learned my addr 172.21.15.117:0/2172361018 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 -- 172.21.15.117:0/2172361018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f13dda0 con 0x56041f22e770 2024-09-10T06:24:44.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 --2- 172.21.15.117:0/2172361018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbe60001e00 tx=0x7fbe6000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c0ba58f5141de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbd5ee0d640 1 -- 172.21.15.117:0/2172361018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60012020 con 0x56041f22e770 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbd5ee0d640 1 -- 172.21.15.117:0/2172361018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6000e690 con 0x56041f22e770 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbd5ee0d640 1 -- 172.21.15.117:0/2172361018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6000ea10 con 0x56041f22e770 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2172361018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 msgr2=0x56041f3a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2172361018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fbe60001e00 tx=0x7fbe6000b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2172361018 shutdown_connections 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2172361018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3a5930 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2172361018 >> 172.21.15.117:0/2172361018 conn(0x56041f2b4e90 msgr2=0x56041f3a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2172361018 shutdown_connections 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2172361018 wait complete. 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe7311c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56041f164a50 con 0x56041f22e770 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46324/0 (socket says 172.21.15.117:46324) 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.138+0000 7fbe70c22640 1 -- 172.21.15.117:0/3523125426 learned_addr learned my addr 172.21.15.117:0/3523125426 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70c22640 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f3ad530 con 0x56041f22e770 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70c22640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3acfd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x56041f3a6920 tx=0x7fbe60000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 -- 172.21.15.117:0/3523125426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60012030 con 0x56041f22e770 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 -- 172.21.15.117:0/3523125426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6001a750 con 0x56041f22e770 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 -- 172.21.15.117:0/3523125426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6001aa50 con 0x56041f22e770 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56041f3ad7c0 con 0x56041f22e770 2024-09-10T06:24:44.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041f3ae170 con 0x56041f22e770 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 -- 172.21.15.117:0/3523125426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe60015020 con 0x56041f22e770 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd58039a70 0x7fbd5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbd5d60a640 1 -- 172.21.15.117:0/3523125426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbe60020030 con 0x56041f22e770 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70421640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd58039a70 0x7fbd5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f2be8c0 0x56041f3b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3b4680 con 0x56041f2be8c0 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe71423640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f2be8c0 0x56041f3b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70421640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd58039a70 0x7fbd5803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac000 tx=0x7fbe640a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe71423640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f2be8c0 0x56041f3b4140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe71423640 1 -- 172.21.15.117:0/3523125426 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f2be8c0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ae4d0 con 0x56041f2be8c0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe71423640 1 -- 172.21.15.117:0/3523125426 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f2be8c0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3b6970 0x56041f3b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3b94a0 con 0x56041f3b6970 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70c22640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3b6970 0x56041f3b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.142+0000 7fbe70c22640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3b6970 0x56041f3b8d60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 -- 172.21.15.117:0/3523125426 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe60008030 con 0x56041f3b6970 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3b5810 con 0x56041f2be8c0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe71423640 1 -- 172.21.15.117:0/3523125426 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f2be8c0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3ba8e0 0x56041f3bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3bd360 con 0x56041f3ba8e0 2024-09-10T06:24:44.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70421640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3ba8e0 0x56041f3bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70421640 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3ba8e0 0x56041f3bccd0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70421640 1 -- 172.21.15.117:0/3523125426 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe640a8070 con 0x56041f3ba8e0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56041f1cf450 con 0x56041f3cade0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46338/0 (socket says 172.21.15.117:46338) 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 -- 172.21.15.117:0/1435142086 learned_addr learned my addr 172.21.15.117:0/1435142086 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 -- 172.21.15.117:0/1435142086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f3cb840 con 0x56041f3cade0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe70c22640 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000b710 tx=0x7fbe6001aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbd567fc640 1 -- 172.21.15.117:0/1435142086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6002cd90 con 0x56041f3cade0 2024-09-10T06:24:44.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbd567fc640 1 -- 172.21.15.117:0/1435142086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe60016b00 con 0x56041f3cade0 2024-09-10T06:24:44.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56041f3cc0a0 con 0x56041f3cade0 2024-09-10T06:24:44.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbd567fc640 1 -- 172.21.15.117:0/1435142086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60016de0 con 0x56041f3cade0 2024-09-10T06:24:44.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.146+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041f3cc610 con 0x56041f3cade0 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd567fc640 1 -- 172.21.15.117:0/1435142086 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe60035060 con 0x56041f3cade0 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd567fc640 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 0x7fbd4803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd567fc640 1 -- 172.21.15.117:0/1435142086 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbe60005050 con 0x56041f3cade0 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70421640 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 0x7fbd4803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70421640 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 0x7fbd4803bf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbe64017e90 tx=0x7fbe64005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56041f3a6180 con 0x56041f3d8530 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46348/0 (socket says 172.21.15.117:46348) 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70c22640 1 -- 172.21.15.117:0/1667459730 learned_addr learned my addr 172.21.15.117:0/1667459730 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70c22640 1 -- 172.21.15.117:0/1667459730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f3d8f20 con 0x56041f3d8530 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe70c22640 1 --2- 172.21.15.117:0/1667459730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002ff90 tx=0x7fbe600378d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48775ed4880977db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd47fff640 1 -- 172.21.15.117:0/1667459730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6005d070 con 0x56041f3d8530 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd47fff640 1 -- 172.21.15.117:0/1667459730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe600379d0 con 0x56041f3d8530 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbd47fff640 1 -- 172.21.15.117:0/1667459730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60025e80 con 0x56041f3d8530 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1667459730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 msgr2=0x56041f3d8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1667459730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002ff90 tx=0x7fbe600378d0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1667459730 shutdown_connections 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1667459730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3d8930 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1667459730 >> 172.21.15.117:0/1667459730 conn(0x56041f3d3950 msgr2=0x56041f3d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.150+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1667459730 shutdown_connections 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1667459730 wait complete. 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 Processor -- start 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 -- start start 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56041f3d7300 con 0x56041f3d8530 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70c22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46362/0 (socket says 172.21.15.117:46362) 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 learned_addr learned my addr 172.21.15.117:0/2099895181 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041f3ded30 con 0x56041f3d8530 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70c22640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002eeb0 tx=0x7fbe60019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 -- 172.21.15.117:0/2099895181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe60066070 con 0x56041f3d8530 2024-09-10T06:24:44.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56041f3ded30 con 0x56041f3d8530 2024-09-10T06:24:44.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 -- 172.21.15.117:0/2099895181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe600379d0 con 0x56041f3d8530 2024-09-10T06:24:44.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 -- 172.21.15.117:0/2099895181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6005d040 con 0x56041f3d8530 2024-09-10T06:24:44.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041f3ded30 con 0x56041f3d8530 2024-09-10T06:24:44.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 -- 172.21.15.117:0/2099895181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe60069070 con 0x56041f3d8530 2024-09-10T06:24:44.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd3c039a20 0x7fbd3c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbd467fc640 1 -- 172.21.15.117:0/2099895181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fbe6006cc00 con 0x56041f3d8530 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.154+0000 7fbe70421640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd3c039a20 0x7fbd3c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f3e99c0 0x56041f3ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ec5a0 con 0x56041f3e99c0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f3e99c0 0x56041f3ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70421640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd3c039a20 0x7fbd3c03bee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe640aafd0 tx=0x7fbe640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f3e99c0 0x56041f3ebe50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 realm 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3eca00 con 0x56041f3e99c0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed2d0 con 0x56041f3e99c0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3ee3d0 0x56041f3f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f0d90 con 0x56041f3ee3d0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3ee3d0 0x56041f3f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3ee3d0 0x56041f3f07c0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 20 searching for the correct realm 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3f2c70 0x56041f3f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f57b0 con 0x56041f3f2c70 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70421640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3f2c70 0x56041f3f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70421640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3f2c70 0x56041f3f50e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f57b0 con 0x56041f3ee3d0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbe6006b070 0x7fbe60047250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f57b0 con 0x7fbe6006b070 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.158+0000 7fbe71423640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbe6006b070 0x7fbe60047250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbe6006b070 0x7fbe60047250 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3ee3d0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.162+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3ee3d0 2024-09-10T06:24:44.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3ee3d0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.166+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3ee3d0 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3f2c70 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x7fbe6006b070 2024-09-10T06:24:44.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3e99c0 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56041f3ed670 con 0x56041f3ee3d0 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f15e0 con 0x56041f3e99c0 2024-09-10T06:24:44.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f19d0 con 0x56041f3e99c0 2024-09-10T06:24:44.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.170+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f19d0 con 0x56041f3f2c70 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 zone default found 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 4 Realm: () 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 zonegroup default 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f5c30 con 0x7fbe6006b070 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f7720 con 0x56041f3f2c70 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f7b60 con 0x56041f3f2c70 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 started sync module instance, tier type = 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f6ac0 con 0x56041f3ee3d0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94575704108720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f6720 con 0x56041f3ee3d0 2024-09-10T06:24:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f8a70 con 0x56041f3e99c0 2024-09-10T06:24:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.174+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94575704108720] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94575704114624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f8e90 con 0x56041f3e99c0 2024-09-10T06:24:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f9850 con 0x56041f3f2c70 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94575704118176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fa0a0 con 0x56041f3f2c70 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3faa60 con 0x56041f3ee3d0 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94575704114624] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94575704122800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fa9d0 con 0x56041f3ee3d0 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.178+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fb7e0 con 0x56041f3e99c0 2024-09-10T06:24:44.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94575704118176] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94575704122800] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94575704120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fb330 con 0x56041f3e99c0 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fbbc0 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94575704126256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fb750 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fcab0 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.182+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94575704120304] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94575704126256] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94575704129504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fc600 con 0x7fbe6006b070 2024-09-10T06:24:44.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fceb0 con 0x7fbe6006b070 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94575704131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fca20 con 0x7fbe6006b070 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=0 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=1 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=2 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=3 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=4 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=5 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94575704129504] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.186+0000 7fbe7311c9c0 20 add_watcher() i=6 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94575704131072] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 add_watcher() i=7 2024-09-10T06:24:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fae80 con 0x56041f3e99c0 2024-09-10T06:24:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94575704125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fd880 con 0x56041f3e99c0 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94575704125056] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe6800a4d0 con 0x56041f3e99c0 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbd277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 5 note: GC not initialized 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbd267e4640 20 reqs_thread_entry: start 2024-09-10T06:24:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 Filter name: none 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbd1f7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.190+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f423920 con 0x7fbe6006b070 2024-09-10T06:24:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fbe6800a4d0 con 0x7fbe6006b070 2024-09-10T06:24:44.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T06:24:44.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:44.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:44.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f42a320 con 0x7fbe6006b070 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x7fbe6006b070 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94575704317328 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56041f425a10 con 0x56041f3e99c0 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94575704120304 notify 137438953504 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fbe68018c80 con 0x56041f3e99c0 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbd47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94575704120304 notifier 4897 bl.length()=666 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbd47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbd47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbd47fff640 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbd34003eb0 con 0x56041f3e99c0 2024-09-10T06:24:44.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94575704317328 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe68047040 con 0x56041f3e99c0 2024-09-10T06:24:44.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x56041f3e99c0 2024-09-10T06:24:44.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.194+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94575704317328 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe68026410 con 0x56041f3e99c0 2024-09-10T06:24:44.199 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:44.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbd277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94575704125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f421620 con 0x56041f3e99c0 2024-09-10T06:24:44.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94575704125056] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x56041f3e99c0 2024-09-10T06:24:44.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94575704108720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f421620 con 0x56041f3ee3d0 2024-09-10T06:24:44.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94575704108720] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe7311c9c0 20 remove_watcher() i=0 2024-09-10T06:24:44.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe7311c9c0 2 removed watcher, disabling cache 2024-09-10T06:24:44.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.198+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94575704114624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f421620 con 0x56041f3e99c0 2024-09-10T06:24:44.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94575704114624] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x56041f3e99c0 2024-09-10T06:24:44.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 20 remove_watcher() i=1 2024-09-10T06:24:44.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94575704118176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f85c0 con 0x56041f3f2c70 2024-09-10T06:24:44.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe70421640 1 -- 172.21.15.117:0/2099895181 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94575704118176] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe640d9070 con 0x56041f3f2c70 2024-09-10T06:24:44.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 20 remove_watcher() i=2 2024-09-10T06:24:44.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94575704122800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f421620 con 0x56041f3ee3d0 2024-09-10T06:24:44.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe70c22640 1 -- 172.21.15.117:0/2099895181 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94575704122800] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe60068030 con 0x56041f3ee3d0 2024-09-10T06:24:44.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 20 remove_watcher() i=3 2024-09-10T06:24:44.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.202+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94575704120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f93a0 con 0x56041f3e99c0 2024-09-10T06:24:44.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94575704120304] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x56041f3e99c0 2024-09-10T06:24:44.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe7311c9c0 20 remove_watcher() i=4 2024-09-10T06:24:44.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94575704126256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3fa5b0 con 0x7fbe6006b070 2024-09-10T06:24:44.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94575704126256] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x7fbe6006b070 2024-09-10T06:24:44.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe7311c9c0 20 remove_watcher() i=5 2024-09-10T06:24:44.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.206+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94575704129504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f421620 con 0x7fbe6006b070 2024-09-10T06:24:44.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94575704129504] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x7fbe6006b070 2024-09-10T06:24:44.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 20 remove_watcher() i=6 2024-09-10T06:24:44.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94575704131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56041f3f93a0 con 0x7fbe6006b070 2024-09-10T06:24:44.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94575704131072] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe68047040 con 0x7fbe6006b070 2024-09-10T06:24:44.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 20 remove_watcher() i=7 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbe6006b070 msgr2=0x7fbe60047250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fbe6006b070 0x7fbe60047250 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f3e99c0 msgr2=0x56041f3ebe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f3e99c0 0x56041f3ebe50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3ee3d0 msgr2=0x56041f3f07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3ee3d0 0x56041f3f07c0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3f2c70 msgr2=0x56041f3f50e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3f2c70 0x56041f3f50e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd3c039a20 msgr2=0x7fbd3c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd3c039a20 0x7fbd3c03bee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe640aafd0 tx=0x7fbe640a7000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 msgr2=0x56041f3de7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe71423640 1 -- 172.21.15.117:0/2099895181 reap_dead start 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002eeb0 tx=0x7fbe60019f90 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 shutdown_connections 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/2099895181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3d8530 0x56041f3de7d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 >> 172.21.15.117:0/2099895181 conn(0x56041f3d3950 msgr2=0x56041f3d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 shutdown_connections 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/2099895181 wait complete. 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 msgr2=0x7fbd4803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 0x7fbd4803bf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbe64017e90 tx=0x7fbe64005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 msgr2=0x56041f3cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000b710 tx=0x7fbe6001aee0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 shutdown_connections 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd48039ac0 0x7fbd4803bf80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/1435142086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f3cade0 0x56041f3cb200 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 >> 172.21.15.117:0/1435142086 conn(0x56041f3c0790 msgr2=0x56041f3c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 shutdown_connections 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/1435142086 wait complete. 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f2be8c0 msgr2=0x56041f3b4140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x56041f2be8c0 0x56041f3b4140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3b6970 msgr2=0x56041f3b8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x56041f3b6970 0x56041f3b8d60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3ba8e0 msgr2=0x56041f3bccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x56041f3ba8e0 0x56041f3bccd0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd58039a70 msgr2=0x7fbd5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fbd58039a70 0x7fbd5803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ac000 tx=0x7fbe640a5000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.210+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 msgr2=0x56041f3acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe7311c9c0 1 --2- 172.21.15.117:0/3523125426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56041f22e770 0x56041f3acfd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x56041f3a6920 tx=0x7fbe60000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe71423640 1 -- 172.21.15.117:0/3523125426 reap_dead start 2024-09-10T06:24:44.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 shutdown_connections 2024-09-10T06:24:44.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 >> 172.21.15.117:0/3523125426 conn(0x56041f2b4e90 msgr2=0x56041f3a0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 shutdown_connections 2024-09-10T06:24:44.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.214+0000 7fbe7311c9c0 1 -- 172.21.15.117:0/3523125426 wait complete. 2024-09-10T06:24:44.224 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.224 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.224 ERROR:root:0 2024-09-10T06:24:44.224 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.229 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000005d7f596d319448a7-0066dfe62c-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:24:44.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T06:24:44.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T06:24:44.230 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-10T06:24:44.299 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:44.299 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:44.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95440c59c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55556406b7b0 0x5555640fa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95440c59c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555563fab9c0 con 0x5555640fa6a0 2024-09-10T06:24:44.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95440c59c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x555563ffb6d0 con 0x55556406b7b0 2024-09-10T06:24:44.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f9541bcb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x55556406b7b0 0x5555640fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95413ca640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x5555640fa6a0 0x5555640fca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54482/0 (socket says 172.21.15.117:54482) 2024-09-10T06:24:44.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f95413ca640 1 -- 172.21.15.117:0/2413172697 learned_addr learned my addr 172.21.15.117:0/2413172697 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:44.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f9541bcb640 1 -- 172.21.15.117:0/2413172697 >> v1:172.21.15.84:6789/0 conn(0x5555640fa6a0 legacy=0x5555640fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.298+0000 7f9541bcb640 1 -- 172.21.15.117:0/2413172697 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555563f9fca0 con 0x55556406b7b0 2024-09-10T06:24:44.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f9541bcb640 1 --2- 172.21.15.117:0/2413172697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556406b7b0 0x5555640fa160 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a480 tx=0x7f953c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba318537299273b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f9540bc9640 1 -- 172.21.15.117:0/2413172697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0af070 con 0x55556406b7b0 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f9540bc9640 1 -- 172.21.15.117:0/2413172697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c0aa530 con 0x55556406b7b0 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f9540bc9640 1 -- 172.21.15.117:0/2413172697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0aa830 con 0x55556406b7b0 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 -- 172.21.15.117:0/2413172697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556406b7b0 msgr2=0x5555640fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 --2- 172.21.15.117:0/2413172697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556406b7b0 0x5555640fa160 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a480 tx=0x7f953c01b280 comp rx=0 tx=0).stop 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 -- 172.21.15.117:0/2413172697 shutdown_connections 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 --2- 172.21.15.117:0/2413172697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556406b7b0 0x5555640fa160 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 -- 172.21.15.117:0/2413172697 >> 172.21.15.117:0/2413172697 conn(0x5555640f1e90 msgr2=0x5555640f42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 -- 172.21.15.117:0/2413172697 shutdown_connections 2024-09-10T06:24:44.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.302+0000 7f95440c59c0 1 -- 172.21.15.117:0/2413172697 wait complete. 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f95440c59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f95440c59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555563fff680 con 0x5555640fa6a0 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46388/0 (socket says 172.21.15.117:46388) 2024-09-10T06:24:44.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f9541bcb640 1 -- 172.21.15.117:0/299052436 learned_addr learned my addr 172.21.15.117:0/299052436 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.314+0000 7f9541bcb640 1 -- 172.21.15.117:0/299052436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555563f7ada0 con 0x5555640fa6a0 2024-09-10T06:24:44.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 --2- 172.21.15.117:0/299052436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f953c01b2c0 tx=0x7f953c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235e339eeda5aee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942fe07640 1 -- 172.21.15.117:0/299052436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0af070 con 0x5555640fa6a0 2024-09-10T06:24:44.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942fe07640 1 -- 172.21.15.117:0/299052436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c0bb070 con 0x5555640fa6a0 2024-09-10T06:24:44.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942fe07640 1 -- 172.21.15.117:0/299052436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0aa6e0 con 0x5555640fa6a0 2024-09-10T06:24:44.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/299052436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 msgr2=0x5555640f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 --2- 172.21.15.117:0/299052436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f953c01b2c0 tx=0x7f953c003030 comp rx=0 tx=0).stop 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/299052436 shutdown_connections 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 --2- 172.21.15.117:0/299052436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555640f7660 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/299052436 >> 172.21.15.117:0/299052436 conn(0x5555640f1e90 msgr2=0x5555641de690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/299052436 shutdown_connections 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/299052436 wait complete. 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555641ec210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555563fa1a50 con 0x5555640fa6a0 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555641ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555641ec210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46402/0 (socket says 172.21.15.117:46402) 2024-09-10T06:24:44.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 -- 172.21.15.117:0/3652732971 learned_addr learned my addr 172.21.15.117:0/3652732971 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555641ec770 con 0x5555640fa6a0 2024-09-10T06:24:44.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f9541bcb640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555641ec210 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f953c0aa500 tx=0x7f953c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942e604640 1 -- 172.21.15.117:0/3652732971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0b65b0 con 0x5555640fa6a0 2024-09-10T06:24:44.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942e604640 1 -- 172.21.15.117:0/3652732971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c0c3070 con 0x5555640fa6a0 2024-09-10T06:24:44.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f942e604640 1 -- 172.21.15.117:0/3652732971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0b6880 con 0x5555640fa6a0 2024-09-10T06:24:44.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555641eca00 con 0x5555640fa6a0 2024-09-10T06:24:44.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.318+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555641ed310 con 0x5555640fa6a0 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f942e604640 1 -- 172.21.15.117:0/3652732971 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f953c0ce060 con 0x5555640fa6a0 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f942e604640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9428039a70 0x7f942803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f942e604640 1 -- 172.21.15.117:0/3652732971 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f953c0eae00 con 0x5555640fa6a0 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95413ca640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9428039a70 0x7f942803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5555641f12d0 0x5555641f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555641f3c00 con 0x5555641f12d0 2024-09-10T06:24:44.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95423cc640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5555641f12d0 0x5555641f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95413ca640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9428039a70 0x7f942803bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9538001650 tx=0x7f9538006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95423cc640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5555641f12d0 0x5555641f36c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95423cc640 1 -- 172.21.15.117:0/3652732971 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95340083f0 con 0x5555641f12d0 2024-09-10T06:24:44.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555641ed6b0 con 0x5555641f12d0 2024-09-10T06:24:44.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95423cc640 1 -- 172.21.15.117:0/3652732971 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95340083f0 con 0x5555641f12d0 2024-09-10T06:24:44.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5555641f5e70 0x5555641f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555641f8950 con 0x5555641f5e70 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f9541bcb640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5555641f5e70 0x5555641f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f9541bcb640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5555641f5e70 0x5555641f8260 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f9541bcb640 1 -- 172.21.15.117:0/3652732971 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f953c0a8070 con 0x5555641f5e70 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555641f4d10 con 0x5555641f12d0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95423cc640 1 -- 172.21.15.117:0/3652732971 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95340083f0 con 0x5555641f12d0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5555641f9db0 0x5555641fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555641fc840 con 0x5555641f9db0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95413ca640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5555641f9db0 0x5555641fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.322+0000 7f95413ca640 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5555641f9db0 0x5555641fc1a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95413ca640 1 -- 172.21.15.117:0/3652732971 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f953800f070 con 0x5555641f9db0 2024-09-10T06:24:44.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55556400c450 con 0x55556420a340 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46406/0 (socket says 172.21.15.117:46406) 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f9541bcb640 1 -- 172.21.15.117:0/4008066608 learned_addr learned my addr 172.21.15.117:0/4008066608 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f9541bcb640 1 -- 172.21.15.117:0/4008066608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55556420ada0 con 0x55556420a340 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f9541bcb640 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a480 tx=0x7f953c0b56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 -- 172.21.15.117:0/4008066608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0b4ad0 con 0x55556420a340 2024-09-10T06:24:44.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 -- 172.21.15.117:0/4008066608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c0bb050 con 0x55556420a340 2024-09-10T06:24:44.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 -- 172.21.15.117:0/4008066608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0b4dc0 con 0x55556420a340 2024-09-10T06:24:44.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55556420b600 con 0x55556420a340 2024-09-10T06:24:44.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55556420bb70 con 0x55556420a340 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 -- 172.21.15.117:0/4008066608 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f953c0e0060 con 0x55556420a340 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 0x7f941c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f94277fe640 1 -- 172.21.15.117:0/4008066608 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f953c0dac20 con 0x55556420a340 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95413ca640 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 0x7f941c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.326+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95413ca640 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 0x7f941c03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f95380062e0 tx=0x7f953800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5555640f7df0 con 0x555564217b10 2024-09-10T06:24:44.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46412/0 (socket says 172.21.15.117:46412) 2024-09-10T06:24:44.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 -- 172.21.15.117:0/2444951874 learned_addr learned my addr 172.21.15.117:0/2444951874 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 -- 172.21.15.117:0/2444951874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555564218500 con 0x555564217b10 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 --2- 172.21.15.117:0/2444951874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f953c0c6ff0 tx=0x7f953c0d83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d60b2457954b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f94257fa640 1 -- 172.21.15.117:0/2444951874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0e2690 con 0x555564217b10 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f94257fa640 1 -- 172.21.15.117:0/2444951874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c0b0040 con 0x555564217b10 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f94257fa640 1 -- 172.21.15.117:0/2444951874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c009420 con 0x555564217b10 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- 172.21.15.117:0/2444951874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 msgr2=0x555564217f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 --2- 172.21.15.117:0/2444951874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f953c0c6ff0 tx=0x7f953c0d83d0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- 172.21.15.117:0/2444951874 shutdown_connections 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 --2- 172.21.15.117:0/2444951874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x555564217f10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- 172.21.15.117:0/2444951874 >> 172.21.15.117:0/2444951874 conn(0x555564212f30 msgr2=0x555564211170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- 172.21.15.117:0/2444951874 shutdown_connections 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- 172.21.15.117:0/2444951874 wait complete. 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 Processor -- start 2024-09-10T06:24:44.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- start start 2024-09-10T06:24:44.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f95440c59c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5555642168e0 con 0x555564217b10 2024-09-10T06:24:44.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46426/0 (socket says 172.21.15.117:46426) 2024-09-10T06:24:44.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 learned_addr learned my addr 172.21.15.117:0/367306573 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.330+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55556421e3a0 con 0x555564217b10 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f9541bcb640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f953c0d8410 tx=0x7f953c0edf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 -- 172.21.15.117:0/367306573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c109070 con 0x555564217b10 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 -- 172.21.15.117:0/367306573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c100070 con 0x555564217b10 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 -- 172.21.15.117:0/367306573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f953c0e2170 con 0x555564217b10 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55556421e3a0 con 0x555564217b10 2024-09-10T06:24:44.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55556421e3a0 con 0x555564217b10 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 -- 172.21.15.117:0/367306573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f953c10c070 con 0x555564217b10 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f940c039a20 0x7f940c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f94137fe640 1 -- 172.21.15.117:0/367306573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f953c10fbf0 con 0x555564217b10 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95413ca640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f940c039a20 0x7f940c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555564229020 0x55556422b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55556422bc00 con 0x555564229020 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555564229020 0x55556422b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95413ca640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f940c039a20 0x7f940c03bee0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5555641f4040 tx=0x7f9538010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555564229020 0x55556422b4b0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95340083f0 con 0x555564229020 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 realm 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55556422c060 con 0x555564229020 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95340083f0 con 0x555564229020 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55556422c930 con 0x555564229020 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95340083f0 con 0x555564229020 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95340083f0 con 0x555564229020 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55556422da30 0x55556422fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555564230470 con 0x55556422da30 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.334+0000 7f9541bcb640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55556422da30 0x55556422fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f9541bcb640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55556422da30 0x55556422fe20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95440c59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95440c59c0 20 searching for the correct realm 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555564232350 0x555564234780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555564234e00 con 0x555564232350 2024-09-10T06:24:44.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95413ca640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555564232350 0x555564234780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95413ca640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555564232350 0x555564234780 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555564234e00 con 0x55556422da30 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f9541bcb640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f953c10e060 0x7f953c0ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555564234e00 con 0x7f953c10e060 2024-09-10T06:24:44.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f953c10e060 0x7f953c0ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f953c10e060 0x7f953c0ea3f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95340083f0 con 0x7f953c10e060 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95340083f0 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.338+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x55556422da30 2024-09-10T06:24:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x55556422da30 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.342+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x55556422da30 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x55556422da30 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564232350 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.346+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x555564229020 2024-09-10T06:24:44.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55556422ccd0 con 0x55556422da30 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555564230cc0 con 0x555564229020 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555642310b0 con 0x555564229020 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555642310b0 con 0x555564232350 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 zone default found 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 4 Realm: () 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 zonegroup default 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555564235280 con 0x7f953c10e060 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555564236d70 con 0x555564232350 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555642371e0 con 0x555564232350 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 started sync module instance, tier type = 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.350+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564236110 con 0x55556422da30 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93825240622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564235d70 con 0x55556422da30 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564238110 con 0x555564229020 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93825240622336] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93825240628320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564238530 con 0x555564229020 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.354+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564238ef0 con 0x555564232350 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93825240628320] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93825240629376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5555642384a0 con 0x555564232350 2024-09-10T06:24:44.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564239bf0 con 0x55556422da30 2024-09-10T06:24:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93825240637456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423a8e0 con 0x55556422da30 2024-09-10T06:24:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423b2a0 con 0x555564229020 2024-09-10T06:24:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93825240629376] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.358+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93825240637456] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93825240638512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423a850 con 0x555564229020 2024-09-10T06:24:44.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423b750 con 0x7f953c10e060 2024-09-10T06:24:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93825240638512] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93825240641008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423b6c0 con 0x7f953c10e060 2024-09-10T06:24:44.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.362+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423bf50 con 0x7f953c10e060 2024-09-10T06:24:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.366+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93825240641008] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.366+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.366+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93825240642064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423bae0 con 0x7f953c10e060 2024-09-10T06:24:44.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.366+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423c990 con 0x7f953c10e060 2024-09-10T06:24:44.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.366+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93825240642064] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93825240643600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423c990 con 0x7f953c10e060 2024-09-10T06:24:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=0 2024-09-10T06:24:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=1 2024-09-10T06:24:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=2 2024-09-10T06:24:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=3 2024-09-10T06:24:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=4 2024-09-10T06:24:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=5 2024-09-10T06:24:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=6 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93825240643600] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.370+0000 7f95440c59c0 20 add_watcher() i=7 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55556423fd00 con 0x555564229020 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93825240659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423cb00 con 0x555564229020 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93825240659696] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f93f3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 5 note: GC not initialized 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f93f2ffd640 20 reqs_thread_entry: start 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 Filter name: none 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f93f0ff9640 20 reqs_thread_entry: start 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555564263410 con 0x7f953c10e060 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:44.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.374+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556426a120 con 0x7f953c10e060 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95440c59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95440c59c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95440c59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93825240832912 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5555642657d0 con 0x555564229020 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 93825240638512 notify 137438953505 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f9534010040 con 0x555564229020 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f94257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 93825240638512 notifier 4904 bl.length()=636 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f94257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f94257fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 93825240832912 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f94257fa640 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9404003eb0 con 0x555564229020 2024-09-10T06:24:44.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.378+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 93825240832912 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f953400ade0 con 0x555564229020 2024-09-10T06:24:44.383 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f93f3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93825240659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564261110 con 0x555564229020 2024-09-10T06:24:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93825240659696] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93825240622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564261110 con 0x55556422da30 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93825240622336] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95440c59c0 20 remove_watcher() i=0 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95440c59c0 2 removed watcher, disabling cache 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.382+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93825240628320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564261110 con 0x555564229020 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93825240628320] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 20 remove_watcher() i=1 2024-09-10T06:24:44.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93825240629376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564261110 con 0x555564232350 2024-09-10T06:24:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95413ca640 1 -- 172.21.15.117:0/367306573 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93825240629376] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953800f070 con 0x555564232350 2024-09-10T06:24:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 20 remove_watcher() i=2 2024-09-10T06:24:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93825240637456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564236500 con 0x55556422da30 2024-09-10T06:24:44.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f9541bcb640 1 -- 172.21.15.117:0/367306573 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93825240637456] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f953c10b030 con 0x55556422da30 2024-09-10T06:24:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 20 remove_watcher() i=3 2024-09-10T06:24:44.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.386+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93825240638512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423a010 con 0x555564229020 2024-09-10T06:24:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93825240638512] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x555564229020 2024-09-10T06:24:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95440c59c0 20 remove_watcher() i=4 2024-09-10T06:24:44.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93825240641008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564236500 con 0x7f953c10e060 2024-09-10T06:24:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93825240641008] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95440c59c0 20 remove_watcher() i=5 2024-09-10T06:24:44.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.390+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93825240642064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55556423adf0 con 0x7f953c10e060 2024-09-10T06:24:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.394+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93825240642064] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.394+0000 7f95440c59c0 20 remove_watcher() i=6 2024-09-10T06:24:44.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.394+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93825240643600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555564236500 con 0x7f953c10e060 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93825240643600] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9534027040 con 0x7f953c10e060 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 20 remove_watcher() i=7 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f953c10e060 msgr2=0x7f953c0ea3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f953c10e060 0x7f953c0ea3f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555564229020 msgr2=0x55556422b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x555564229020 0x55556422b4b0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55556422da30 msgr2=0x55556422fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x55556422da30 0x55556422fe20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555564232350 msgr2=0x555564234780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x555564232350 0x555564234780 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f940c039a20 msgr2=0x7f940c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f940c039a20 0x7f940c03bee0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5555641f4040 tx=0x7f9538010000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 msgr2=0x55556421de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f953c0d8410 tx=0x7f953c0edf10 comp rx=0 tx=0).stop 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95423cc640 1 -- 172.21.15.117:0/367306573 reap_dead start 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 shutdown_connections 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/367306573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555564217b10 0x55556421de40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 >> 172.21.15.117:0/367306573 conn(0x555564212f30 msgr2=0x555564211140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 shutdown_connections 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/367306573 wait complete. 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 msgr2=0x7f941c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 0x7f941c03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f95380062e0 tx=0x7f953800f000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 msgr2=0x55556420a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f953c00a480 tx=0x7f953c0b56d0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 shutdown_connections 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f941c039a70 0x7f941c03bf30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/4008066608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55556420a340 0x55556420a760 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 >> 172.21.15.117:0/4008066608 conn(0x5555641ffcf0 msgr2=0x5555642000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 shutdown_connections 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/4008066608 wait complete. 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5555641f12d0 msgr2=0x5555641f36c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x5555641f12d0 0x5555641f36c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5555641f5e70 msgr2=0x5555641f8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x5555641f5e70 0x5555641f8260 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5555641f9db0 msgr2=0x5555641fc1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x5555641f9db0 0x5555641fc1a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9428039a70 msgr2=0x7f942803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9428039a70 0x7f942803bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9538001650 tx=0x7f9538006720 comp rx=0 tx=0).stop 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 msgr2=0x5555641ec210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 --2- 172.21.15.117:0/3652732971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555640fa6a0 0x5555641ec210 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f953c0aa500 tx=0x7f953c018020 comp rx=0 tx=0).stop 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95423cc640 1 -- 172.21.15.117:0/3652732971 reap_dead start 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 shutdown_connections 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 >> 172.21.15.117:0/3652732971 conn(0x5555640f1e90 msgr2=0x5555640f62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 shutdown_connections 2024-09-10T06:24:44.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.398+0000 7f95440c59c0 1 -- 172.21.15.117:0/3652732971 wait complete. 2024-09-10T06:24:44.409 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.409 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.410 ERROR:root:0 2024-09-10T06:24:44.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:44.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:44.410 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T06:24:44.487 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:44.487 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:44.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd6108c39c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562ab95038c0 0x562ab9505cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd6108c39c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ab93b39c0 con 0x562ab9473770 2024-09-10T06:24:44.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd6108c39c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x562ab94036d0 con 0x562ab95038c0 2024-09-10T06:24:44.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd60dbc8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x562ab95038c0 0x562ab9505cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd60e3c9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x562ab9473770 0x562ab95021a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54484/0 (socket says 172.21.15.117:54484) 2024-09-10T06:24:44.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd60e3c9640 1 -- 172.21.15.117:0/22467723 learned_addr learned my addr 172.21.15.117:0/22467723 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:44.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd60dbc8640 1 -- 172.21.15.117:0/22467723 >> v1:172.21.15.84:6789/0 conn(0x562ab9473770 legacy=0x562ab95021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.486+0000 7fd60dbc8640 1 -- 172.21.15.117:0/22467723 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab93a7ca0 con 0x562ab95038c0 2024-09-10T06:24:44.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/22467723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab95038c0 0x562ab9505cb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a480 tx=0x7fd60401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d99bbf4d9c6608 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd60d3c7640 1 -- 172.21.15.117:0/22467723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6040af070 con 0x562ab95038c0 2024-09-10T06:24:44.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd60d3c7640 1 -- 172.21.15.117:0/22467723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6040aa530 con 0x562ab95038c0 2024-09-10T06:24:44.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd60d3c7640 1 -- 172.21.15.117:0/22467723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6040aa830 con 0x562ab95038c0 2024-09-10T06:24:44.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 -- 172.21.15.117:0/22467723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab95038c0 msgr2=0x562ab9505cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/22467723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab95038c0 0x562ab9505cb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a480 tx=0x7fd60401b280 comp rx=0 tx=0).stop 2024-09-10T06:24:44.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 -- 172.21.15.117:0/22467723 shutdown_connections 2024-09-10T06:24:44.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/22467723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab95038c0 0x562ab9505cb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 -- 172.21.15.117:0/22467723 >> 172.21.15.117:0/22467723 conn(0x562ab94f9e90 msgr2=0x562ab94fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 -- 172.21.15.117:0/22467723 shutdown_connections 2024-09-10T06:24:44.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.490+0000 7fd6108c39c0 1 -- 172.21.15.117:0/22467723 wait complete. 2024-09-10T06:24:44.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd6108c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd6108c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ab9407680 con 0x562ab9473770 2024-09-10T06:24:44.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46444/0 (socket says 172.21.15.117:46444) 2024-09-10T06:24:44.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2836393054 learned_addr learned my addr 172.21.15.117:0/2836393054 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.502+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2836393054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab9382da0 con 0x562ab9473770 2024-09-10T06:24:44.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/2836393054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd600001e00 tx=0x7fd60000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9032fe03c6ed56d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fc608640 1 -- 172.21.15.117:0/2836393054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600012020 con 0x562ab9473770 2024-09-10T06:24:44.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fc608640 1 -- 172.21.15.117:0/2836393054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60000e690 con 0x562ab9473770 2024-09-10T06:24:44.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fc608640 1 -- 172.21.15.117:0/2836393054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60000ea10 con 0x562ab9473770 2024-09-10T06:24:44.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2836393054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 msgr2=0x562ab95ea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2836393054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd600001e00 tx=0x7fd60000b6d0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2836393054 shutdown_connections 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2836393054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95ea930 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2836393054 >> 172.21.15.117:0/2836393054 conn(0x562ab94f9e90 msgr2=0x562ab95e65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2836393054 shutdown_connections 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2836393054 wait complete. 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ab93a9a50 con 0x562ab9473770 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46450/0 (socket says 172.21.15.117:46450) 2024-09-10T06:24:44.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2421858488 learned_addr learned my addr 172.21.15.117:0/2421858488 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab95f2530 con 0x562ab9473770 2024-09-10T06:24:44.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95f1fd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x562ab95eb920 tx=0x7fd600000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fae05640 1 -- 172.21.15.117:0/2421858488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600012030 con 0x562ab9473770 2024-09-10T06:24:44.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fae05640 1 -- 172.21.15.117:0/2421858488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60001a750 con 0x562ab9473770 2024-09-10T06:24:44.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd4fae05640 1 -- 172.21.15.117:0/2421858488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60001aa50 con 0x562ab9473770 2024-09-10T06:24:44.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab95f27c0 con 0x562ab9473770 2024-09-10T06:24:44.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.506+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab95f3170 con 0x562ab9473770 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd4fae05640 1 -- 172.21.15.117:0/2421858488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd600015020 con 0x562ab9473770 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd4fae05640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4f4039a70 0x7fd4f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd4fae05640 1 -- 172.21.15.117:0/2421858488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd600020030 con 0x562ab9473770 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4f4039a70 0x7fd4f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab95038c0 0x562ab95f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab95f9680 con 0x562ab95038c0 2024-09-10T06:24:44.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60ebca640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab95038c0 0x562ab95f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4f4039a70 0x7fd4f403bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6040ac000 tx=0x7fd6040a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60ebca640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab95038c0 0x562ab95f9140 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60ebca640 1 -- 172.21.15.117:0/2421858488 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab95038c0 2024-09-10T06:24:44.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab95f34d0 con 0x562ab95038c0 2024-09-10T06:24:44.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60ebca640 1 -- 172.21.15.117:0/2421858488 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab95038c0 2024-09-10T06:24:44.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab95fb970 0x562ab95fdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab95fe4a0 con 0x562ab95fb970 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab95fb970 0x562ab95fdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab95fb970 0x562ab95fdd60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2421858488 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd600008030 con 0x562ab95fb970 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab95fa810 con 0x562ab95038c0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60ebca640 1 -- 172.21.15.117:0/2421858488 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab95038c0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab95ff8e0 0x562ab9601cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9602360 con 0x562ab95ff8e0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab95ff8e0 0x562ab9601cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.510+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab95ff8e0 0x562ab9601cd0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60dbc8640 1 -- 172.21.15.117:0/2421858488 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd6040a8070 con 0x562ab95ff8e0 2024-09-10T06:24:44.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ab9414450 con 0x562ab960fde0 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46456/0 (socket says 172.21.15.117:46456) 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2283772896 learned_addr learned my addr 172.21.15.117:0/2283772896 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60e3c9640 1 -- 172.21.15.117:0/2283772896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab9610840 con 0x562ab960fde0 2024-09-10T06:24:44.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd60004ec80 tx=0x7fd60001aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 -- 172.21.15.117:0/2283772896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60002ce60 con 0x562ab960fde0 2024-09-10T06:24:44.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab96110a0 con 0x562ab960fde0 2024-09-10T06:24:44.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 -- 172.21.15.117:0/2283772896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd600016d10 con 0x562ab960fde0 2024-09-10T06:24:44.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 -- 172.21.15.117:0/2283772896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600016570 con 0x562ab960fde0 2024-09-10T06:24:44.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab96110a0 con 0x562ab960fde0 2024-09-10T06:24:44.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 -- 172.21.15.117:0/2283772896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd60004a040 con 0x562ab960fde0 2024-09-10T06:24:44.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 0x7fd4e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd4f3fff640 1 -- 172.21.15.117:0/2283772896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd600005050 con 0x562ab960fde0 2024-09-10T06:24:44.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.514+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 0x7fd4e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 0x7fd4e803bf30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd604017e90 tx=0x7fd604005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ab95eb180 con 0x562ab961d360 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46462/0 (socket says 172.21.15.117:46462) 2024-09-10T06:24:44.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3367864850 learned_addr learned my addr 172.21.15.117:0/3367864850 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3367864850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab961dd50 con 0x562ab961d360 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/3367864850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd600018c60 tx=0x7fd600004010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e583ca62c8b7ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd4f1ffb640 1 -- 172.21.15.117:0/3367864850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60000cc20 con 0x562ab961d360 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd4f1ffb640 1 -- 172.21.15.117:0/3367864850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60005f070 con 0x562ab961d360 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd4f1ffb640 1 -- 172.21.15.117:0/3367864850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600050cf0 con 0x562ab961d360 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3367864850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 msgr2=0x562ab961d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3367864850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd600018c60 tx=0x7fd600004010 comp rx=0 tx=0).stop 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3367864850 shutdown_connections 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3367864850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab961d760 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3367864850 >> 172.21.15.117:0/3367864850 conn(0x562ab9618780 msgr2=0x562ab96169c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3367864850 shutdown_connections 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3367864850 wait complete. 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 Processor -- start 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- start start 2024-09-10T06:24:44.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd6108c39c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ab961c130 con 0x562ab961d360 2024-09-10T06:24:44.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46476/0 (socket says 172.21.15.117:46476) 2024-09-10T06:24:44.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 learned_addr learned my addr 172.21.15.117:0/3826641293 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.518+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab9623b90 con 0x562ab961d360 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd600004050 tx=0x7fd6000037e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 -- 172.21.15.117:0/3826641293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600040210 con 0x562ab961d360 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 -- 172.21.15.117:0/3826641293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60005f070 con 0x562ab961d360 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab9623b90 con 0x562ab961d360 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 -- 172.21.15.117:0/3826641293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60004d4e0 con 0x562ab961d360 2024-09-10T06:24:44.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab9623b90 con 0x562ab961d360 2024-09-10T06:24:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 -- 172.21.15.117:0/3826641293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd600059070 con 0x562ab961d360 2024-09-10T06:24:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4d8039b10 0x7fd4d803bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd4dffff640 1 -- 172.21.15.117:0/3826641293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd600077ba0 con 0x562ab961d360 2024-09-10T06:24:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4d8039b10 0x7fd4d803bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab962e7b0 0x562ab9630c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9631390 con 0x562ab962e7b0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab962e7b0 0x562ab9630c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4d8039b10 0x7fd4d803bfd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6040aafd0 tx=0x7fd6040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab962e7b0 0x562ab9630c40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 realm 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab96317a0 con 0x562ab962e7b0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632070 con 0x562ab962e7b0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab9633170 0x562ab9635560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9635b70 con 0x562ab9633170 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.522+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab9633170 0x562ab9635560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab9633170 0x562ab9635560 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd6108c39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd6108c39c0 20 searching for the correct realm 2024-09-10T06:24:44.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab9637a50 0x562ab9639e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab963a500 con 0x562ab9637a50 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab9637a50 0x562ab9639e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60dbc8640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab9637a50 0x562ab9639e80 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab963a500 con 0x562ab9633170 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60e3c9640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd600017050 0x7fd600027340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab963a500 con 0x7fd600017050 2024-09-10T06:24:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd600017050 0x7fd600027340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd600017050 0x7fd600027340 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.526+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9633170 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9633170 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.530+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9633170 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9633170 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.534+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9637a50 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x7fd600017050 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab962e7b0 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ab9632410 con 0x562ab9633170 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:44.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab96363c0 con 0x562ab962e7b0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab96367b0 con 0x562ab962e7b0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab96367b0 con 0x562ab9637a50 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 zone default found 2024-09-10T06:24:44.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 4 Realm: () 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 zonegroup default 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab963a980 con 0x7fd600017050 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab963c470 con 0x562ab9637a50 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab963c880 con 0x562ab9637a50 2024-09-10T06:24:44.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 started sync module instance, tier type = 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.538+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963b810 con 0x562ab9633170 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741498936320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963b470 con 0x562ab9633170 2024-09-10T06:24:44.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963d790 con 0x562ab962e7b0 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741498936320] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741498942176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963d700 con 0x562ab962e7b0 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.542+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963e4e0 con 0x562ab9637a50 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741498945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963ed80 con 0x562ab9637a50 2024-09-10T06:24:44.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963f780 con 0x562ab9633170 2024-09-10T06:24:44.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741498942176] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741498944384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9640020 con 0x562ab9633170 2024-09-10T06:24:44.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9640870 con 0x562ab962e7b0 2024-09-10T06:24:44.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741498945584] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741498944384] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741498952560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9640440 con 0x562ab962e7b0 2024-09-10T06:24:44.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.546+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9641110 con 0x7fd600017050 2024-09-10T06:24:44.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741498956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9640440 con 0x7fd600017050 2024-09-10T06:24:44.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9641af0 con 0x7fd600017050 2024-09-10T06:24:44.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741498952560] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741498956496] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741498959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab963ffd0 con 0x7fd600017050 2024-09-10T06:24:44.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.550+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9642180 con 0x7fd600017050 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741498959296] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741498957552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9642180 con 0x7fd600017050 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=0 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=1 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=2 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=3 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=4 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=5 2024-09-10T06:24:44.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=6 2024-09-10T06:24:44.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741498957552] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 20 add_watcher() i=7 2024-09-10T06:24:44.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:44.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.554+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9645310 con 0x562ab962e7b0 2024-09-10T06:24:44.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741498961104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab96425a0 con 0x562ab962e7b0 2024-09-10T06:24:44.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741498961104] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd60800a4d0 con 0x562ab962e7b0 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd4c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 5 note: GC not initialized 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd43f7fe640 20 reqs_thread_entry: start 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 Filter name: none 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd43d7fa640 20 reqs_thread_entry: start 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab9668a10 con 0x7fd600017050 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fd60800a4d0 con 0x7fd600017050 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:44.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.558+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab966f430 con 0x7fd600017050 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd608047040 con 0x7fd600017050 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd6108c39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd6108c39c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd6108c39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94741499145888 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ab966ab20 con 0x562ab962e7b0 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94741498952560 notify 137438953506 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fd608026410 con 0x562ab962e7b0 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd4f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94741498952560 notifier 4911 bl.length()=649 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd4f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd4f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94741499145888 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd608047040 con 0x562ab962e7b0 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd4f1ffb640 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd4d4003eb0 con 0x562ab962e7b0 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x562ab962e7b0 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94741499145888 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd6080265e0 con 0x562ab962e7b0 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd4c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.562+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741498961104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab966b2e0 con 0x562ab962e7b0 2024-09-10T06:24:44.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94741498961104] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd608047040 con 0x562ab962e7b0 2024-09-10T06:24:44.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741498936320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab966b2e0 con 0x562ab9633170 2024-09-10T06:24:44.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94741498936320] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 20 remove_watcher() i=0 2024-09-10T06:24:44.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 2 removed watcher, disabling cache 2024-09-10T06:24:44.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741498942176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab966b2e0 con 0x562ab962e7b0 2024-09-10T06:24:44.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94741498942176] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x562ab962e7b0 2024-09-10T06:24:44.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 20 remove_watcher() i=1 2024-09-10T06:24:44.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.566+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741498945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab966b2e0 con 0x562ab9637a50 2024-09-10T06:24:44.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd60dbc8640 1 -- 172.21.15.117:0/3826641293 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94741498945584] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6040d9070 con 0x562ab9637a50 2024-09-10T06:24:44.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd6108c39c0 20 remove_watcher() i=2 2024-09-10T06:24:44.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741498944384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9666740 con 0x562ab9633170 2024-09-10T06:24:44.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd60e3c9640 1 -- 172.21.15.117:0/3826641293 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94741498944384] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd600073020 con 0x562ab9633170 2024-09-10T06:24:44.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd6108c39c0 20 remove_watcher() i=3 2024-09-10T06:24:44.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.570+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741498952560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9666740 con 0x562ab962e7b0 2024-09-10T06:24:44.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94741498952560] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x562ab962e7b0 2024-09-10T06:24:44.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd6108c39c0 20 remove_watcher() i=4 2024-09-10T06:24:44.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741498956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9666740 con 0x7fd600017050 2024-09-10T06:24:44.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94741498956496] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x7fd600017050 2024-09-10T06:24:44.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd6108c39c0 20 remove_watcher() i=5 2024-09-10T06:24:44.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.574+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741498959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9666740 con 0x7fd600017050 2024-09-10T06:24:44.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94741498959296] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x7fd600017050 2024-09-10T06:24:44.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 20 remove_watcher() i=6 2024-09-10T06:24:44.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741498957552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ab9666740 con 0x7fd600017050 2024-09-10T06:24:44.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94741498957552] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd608047040 con 0x7fd600017050 2024-09-10T06:24:44.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 20 remove_watcher() i=7 2024-09-10T06:24:44.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd600017050 msgr2=0x7fd600027340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7fd600017050 0x7fd600027340 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab962e7b0 msgr2=0x562ab9630c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab962e7b0 0x562ab9630c40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab9633170 msgr2=0x562ab9635560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab9633170 0x562ab9635560 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab9637a50 msgr2=0x562ab9639e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab9637a50 0x562ab9639e80 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4d8039b10 msgr2=0x7fd4d803bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4d8039b10 0x7fd4d803bfd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6040aafd0 tx=0x7fd6040a7000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 msgr2=0x562ab9623630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd60ebca640 1 -- 172.21.15.117:0/3826641293 reap_dead start 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd600004050 tx=0x7fd6000037e0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 shutdown_connections 2024-09-10T06:24:44.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/3826641293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab961d360 0x562ab9623630 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 >> 172.21.15.117:0/3826641293 conn(0x562ab9618780 msgr2=0x562ab9616990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 shutdown_connections 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/3826641293 wait complete. 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 msgr2=0x7fd4e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 0x7fd4e803bf30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd604017e90 tx=0x7fd604005a10 comp rx=0 tx=0).stop 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 msgr2=0x562ab9610200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd60004ec80 tx=0x7fd60001aec0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 shutdown_connections 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4e8039a70 0x7fd4e803bf30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2283772896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab960fde0 0x562ab9610200 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 >> 172.21.15.117:0/2283772896 conn(0x562ab9605790 msgr2=0x562ab9605b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 shutdown_connections 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2283772896 wait complete. 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab95038c0 msgr2=0x562ab95f9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x562ab95038c0 0x562ab95f9140 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab95fb970 msgr2=0x562ab95fdd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x562ab95fb970 0x562ab95fdd60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab95ff8e0 msgr2=0x562ab9601cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x562ab95ff8e0 0x562ab9601cd0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4f4039a70 msgr2=0x7fd4f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fd4f4039a70 0x7fd4f403bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6040ac000 tx=0x7fd6040a5000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 msgr2=0x562ab95f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd6108c39c0 1 --2- 172.21.15.117:0/2421858488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ab9473770 0x562ab95f1fd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x562ab95eb920 tx=0x7fd600000bd0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.578+0000 7fd60ebca640 1 -- 172.21.15.117:0/2421858488 reap_dead start 2024-09-10T06:24:44.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.582+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 shutdown_connections 2024-09-10T06:24:44.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.582+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 >> 172.21.15.117:0/2421858488 conn(0x562ab94f9e90 msgr2=0x562ab95e5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.582+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 shutdown_connections 2024-09-10T06:24:44.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.582+0000 7fd6108c39c0 1 -- 172.21.15.117:0/2421858488 wait complete. 2024-09-10T06:24:44.593 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.593 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.593 ERROR:root:0 2024-09-10T06:24:44.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:44.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T06:24:44.593 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T06:24:44.668 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:24:44.669 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:24:44.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a692b69c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558329b5fc80 0x558329b62070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a692b69c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558329a119c0 con 0x558329b625b0 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a692b69c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x558329a616d0 con 0x558329b5fc80 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a66dbc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558329b5fc80 0x558329b62070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a665bb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x558329b625b0 0x558329b649a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:54492/0 (socket says 172.21.15.117:54492) 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a66dbc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558329b5fc80 0x558329b62070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46490/0 (socket says 172.21.15.117:46490) 2024-09-10T06:24:44.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.666+0000 7f9a665bb640 1 -- 172.21.15.117:0/4199312216 learned_addr learned my addr 172.21.15.117:0/4199312216 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:24:44.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a66dbc640 1 -- 172.21.15.117:0/4199312216 >> v1:172.21.15.84:6789/0 conn(0x558329b625b0 legacy=0x558329b649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a66dbc640 1 -- 172.21.15.117:0/4199312216 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558329a05ca0 con 0x558329b5fc80 2024-09-10T06:24:44.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/4199312216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329b62070 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800a480 tx=0x7f9a5801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c1e4cfd0245008 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a65dba640 1 -- 172.21.15.117:0/4199312216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b0070 con 0x558329b5fc80 2024-09-10T06:24:44.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a65dba640 1 -- 172.21.15.117:0/4199312216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580ab540 con 0x558329b5fc80 2024-09-10T06:24:44.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a65dba640 1 -- 172.21.15.117:0/4199312216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580ab840 con 0x558329b5fc80 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 -- 172.21.15.117:0/4199312216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 msgr2=0x558329b62070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/4199312216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329b62070 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800a480 tx=0x7f9a5801b280 comp rx=0 tx=0).stop 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 -- 172.21.15.117:0/4199312216 shutdown_connections 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/4199312216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329b62070 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 -- 172.21.15.117:0/4199312216 >> 172.21.15.117:0/4199312216 conn(0x558329ad3010 msgr2=0x558329ad3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.670+0000 7f9a692b69c0 1 -- 172.21.15.117:0/4199312216 shutdown_connections 2024-09-10T06:24:44.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.674+0000 7f9a692b69c0 1 -- 172.21.15.117:0/4199312216 wait complete. 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558329a65680 con 0x558329b5fc80 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46504/0 (socket says 172.21.15.117:46504) 2024-09-10T06:24:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 -- 172.21.15.117:0/1506251477 learned_addr learned my addr 172.21.15.117:0/1506251477 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 -- 172.21.15.117:0/1506251477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583299e0da0 con 0x558329b5fc80 2024-09-10T06:24:44.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/1506251477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9a58018eb0 tx=0x7f9a58003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff5794ffa0abc36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9954e09640 1 -- 172.21.15.117:0/1506251477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b0040 con 0x558329b5fc80 2024-09-10T06:24:44.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9954e09640 1 -- 172.21.15.117:0/1506251477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580bb070 con 0x558329b5fc80 2024-09-10T06:24:44.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9954e09640 1 -- 172.21.15.117:0/1506251477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580ab6f0 con 0x558329b5fc80 2024-09-10T06:24:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- 172.21.15.117:0/1506251477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 msgr2=0x558329c4aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/1506251477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9a58018eb0 tx=0x7f9a58003030 comp rx=0 tx=0).stop 2024-09-10T06:24:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- 172.21.15.117:0/1506251477 shutdown_connections 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/1506251477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c4aa40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- 172.21.15.117:0/1506251477 >> 172.21.15.117:0/1506251477 conn(0x558329ad3010 msgr2=0x558329c466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- 172.21.15.117:0/1506251477 shutdown_connections 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- 172.21.15.117:0/1506251477 wait complete. 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c51f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a692b69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558329a07a50 con 0x558329b5fc80 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c51f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.686+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c51f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46514/0 (socket says 172.21.15.117:46514) 2024-09-10T06:24:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a66dbc640 1 -- 172.21.15.117:0/635853642 learned_addr learned my addr 172.21.15.117:0/635853642 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a66dbc640 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558329c524b0 con 0x558329b5fc80 2024-09-10T06:24:44.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c51f50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b8040 tx=0x7f9a58018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 -- 172.21.15.117:0/635853642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b0030 con 0x558329b5fc80 2024-09-10T06:24:44.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558329c52740 con 0x558329b5fc80 2024-09-10T06:24:44.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 -- 172.21.15.117:0/635853642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580bb070 con 0x558329b5fc80 2024-09-10T06:24:44.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 -- 172.21.15.117:0/635853642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580b6900 con 0x558329b5fc80 2024-09-10T06:24:44.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558329c530f0 con 0x558329b5fc80 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 -- 172.21.15.117:0/635853642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9a580b6aa0 con 0x558329b5fc80 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f994c039a70 0x7f994c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9953606640 1 -- 172.21.15.117:0/635853642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9a580a8070 con 0x558329b5fc80 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a665bb640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f994c039a70 0x7f994c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329b625b0 0x558329c590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c59600 con 0x558329b625b0 2024-09-10T06:24:44.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a675bd640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329b625b0 0x558329c590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a665bb640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f994c039a70 0x7f994c03bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c001d80 tx=0x7f9a5c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a675bd640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329b625b0 0x558329c590c0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a675bd640 1 -- 172.21.15.117:0/635853642 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329b625b0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c599e0 con 0x558329b625b0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a675bd640 1 -- 172.21.15.117:0/635853642 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329b625b0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c5b7f0 0x558329c5dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.690+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c5e2b0 con 0x558329c5b7f0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c5b7f0 0x558329c5dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c5b7f0 0x558329c5dbe0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 -- 172.21.15.117:0/635853642 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a580b3040 con 0x558329c5b7f0 2024-09-10T06:24:44.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c5a690 con 0x558329b625b0 2024-09-10T06:24:44.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a675bd640 1 -- 172.21.15.117:0/635853642 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329b625b0 2024-09-10T06:24:44.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c5f6f0 0x558329c61ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c62270 con 0x558329c5f6f0 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a665bb640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c5f6f0 0x558329c61ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a665bb640 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c5f6f0 0x558329c61ae0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a665bb640 1 -- 172.21.15.117:0/635853642 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c5f6f0 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558329a72450 con 0x558329c6fd30 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46516/0 (socket says 172.21.15.117:46516) 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2741670886 learned_addr learned my addr 172.21.15.117:0/2741670886 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2741670886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558329c70790 con 0x558329c6fd30 2024-09-10T06:24:44.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b4af0 tx=0x7f9a580b4f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9950e01640 1 -- 172.21.15.117:0/2741670886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580e8210 con 0x558329c6fd30 2024-09-10T06:24:44.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558329c70ff0 con 0x558329c6fd30 2024-09-10T06:24:44.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9950e01640 1 -- 172.21.15.117:0/2741670886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580e83b0 con 0x558329c6fd30 2024-09-10T06:24:44.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558329c70ff0 con 0x558329c6fd30 2024-09-10T06:24:44.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.694+0000 7f9950e01640 1 -- 172.21.15.117:0/2741670886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580c0400 con 0x558329c6fd30 2024-09-10T06:24:44.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9950e01640 1 -- 172.21.15.117:0/2741670886 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9a580da070 con 0x558329c6fd30 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9950e01640 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 0x7f994003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9950e01640 1 -- 172.21.15.117:0/2741670886 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9a580dc070 con 0x558329c6fd30 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 0x7f994003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 0x7f994003bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bf50 tx=0x7f9a5c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558329c4b1b0 con 0x558329c7c300 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46532/0 (socket says 172.21.15.117:46532) 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a66dbc640 1 -- 172.21.15.117:0/3988121249 learned_addr learned my addr 172.21.15.117:0/3988121249 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a66dbc640 1 -- 172.21.15.117:0/3988121249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558329c7ccd0 con 0x558329c7c300 2024-09-10T06:24:44.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/3988121249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9a580bffd0 tx=0x7f9a580bc910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80ddb80cb574046 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f994a7fc640 1 -- 172.21.15.117:0/3988121249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580dbb20 con 0x558329c7c300 2024-09-10T06:24:44.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f994a7fc640 1 -- 172.21.15.117:0/3988121249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580bc450 con 0x558329c7c300 2024-09-10T06:24:44.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f994a7fc640 1 -- 172.21.15.117:0/3988121249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580aa3b0 con 0x558329c7c300 2024-09-10T06:24:44.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- 172.21.15.117:0/3988121249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 msgr2=0x558329c7c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/3988121249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9a580bffd0 tx=0x7f9a580bc910 comp rx=0 tx=0).stop 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- 172.21.15.117:0/3988121249 shutdown_connections 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/3988121249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c7c6e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- 172.21.15.117:0/3988121249 >> 172.21.15.117:0/3988121249 conn(0x558329c78730 msgr2=0x558329c76970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- 172.21.15.117:0/3988121249 shutdown_connections 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 -- 172.21.15.117:0/3988121249 wait complete. 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.698+0000 7f9a692b69c0 1 Processor -- start 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 -- start start 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558329c7d190 con 0x558329c7c300 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a66dbc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:46536/0 (socket says 172.21.15.117:46536) 2024-09-10T06:24:44.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 learned_addr learned my addr 172.21.15.117:0/2798152475 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558329c83bd0 con 0x558329c7c300 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9a580bffd0 tx=0x7f9a580bbf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 -- 172.21.15.117:0/2798152475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a58110070 con 0x558329c7c300 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 -- 172.21.15.117:0/2798152475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a580c05a0 con 0x558329c7c300 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558329c83bd0 con 0x558329c7c300 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558329c83bd0 con 0x558329c7c300 2024-09-10T06:24:44.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 -- 172.21.15.117:0/2798152475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a580c0880 con 0x558329c7c300 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 -- 172.21.15.117:0/2798152475 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9a58113070 con 0x558329c7c300 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9930039a70 0x7f993003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9948ff9640 1 -- 172.21.15.117:0/2798152475 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9a58107030 con 0x558329c7c300 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9930039a70 0x7f993003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329c8e720 0x558329c90bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c91300 con 0x558329c8e720 2024-09-10T06:24:44.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a675bd640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329c8e720 0x558329c90bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.702+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9930039a70 0x7f993003bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558329c62670 tx=0x7f9a5c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329c8e720 0x558329c90bb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 realm 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c91710 con 0x558329c8e720 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c91fe0 con 0x558329c8e720 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c930e0 0x558329c954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c95aa0 con 0x558329c930e0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c930e0 0x558329c954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c930e0 0x558329c954d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:24:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 20 searching for the correct realm 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c979f0 0x558329c99e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c9a4a0 con 0x558329c979f0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c979f0 0x558329c99e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a665bb640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c979f0 0x558329c99e20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c9a4a0 con 0x558329c930e0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9a58115060 0x7f9a580c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c9a4a0 con 0x7f9a58115060 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9a58115060 0x7f9a580c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:24:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.706+0000 7f9a675bd640 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9a58115060 0x7f9a580c79a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:24:44.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c930e0 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c930e0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.710+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c930e0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.714+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c930e0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c979f0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x7f9a58115060 2024-09-10T06:24:44.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c8e720 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558329c92380 con 0x558329c930e0 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c96360 con 0x558329c8e720 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c96750 con 0x558329c8e720 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c96750 con 0x558329c979f0 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 zone default found 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 4 Realm: () 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 zonegroup default 2024-09-10T06:24:44.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c9a920 con 0x7f9a58115060 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c9c440 con 0x558329c979f0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.718+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329c9c900 con 0x558329c979f0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 20 started sync module instance, tier type = 2024-09-10T06:24:44.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:24:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9b7b0 con 0x558329c930e0 2024-09-10T06:24:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021830163360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9b410 con 0x558329c930e0 2024-09-10T06:24:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9d830 con 0x558329c8e720 2024-09-10T06:24:44.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021830163360] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021830169472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9dc50 con 0x558329c8e720 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.722+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9e520 con 0x558329c979f0 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021830169472] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021830170832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9e910 con 0x558329c979f0 2024-09-10T06:24:44.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9f2d0 con 0x558329c930e0 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021830176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329c9fb70 con 0x558329c930e0 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca0530 con 0x558329c8e720 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.726+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021830170832] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021830176592] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021830178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca0080 con 0x558329c8e720 2024-09-10T06:24:44.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca0dd0 con 0x7f9a58115060 2024-09-10T06:24:44.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021830182512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca0f40 con 0x7f9a58115060 2024-09-10T06:24:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca1790 con 0x7f9a58115060 2024-09-10T06:24:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.730+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021830178496] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021830184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca1810 con 0x7f9a58115060 2024-09-10T06:24:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca21d0 con 0x7f9a58115060 2024-09-10T06:24:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021830182512] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021830183568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca21d0 con 0x7f9a58115060 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=0 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=1 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=2 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=3 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=4 2024-09-10T06:24:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.734+0000 7f9a692b69c0 20 add_watcher() i=5 2024-09-10T06:24:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021830184768] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 add_watcher() i=6 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021830183568] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 add_watcher() i=7 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329ca5200 con 0x558329c8e720 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021830188320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ca25f0 con 0x558329c8e720 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021830188320] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x558329c8e720 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f991d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 5 note: GC not initialized 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9897fff640 20 reqs_thread_entry: start 2024-09-10T06:24:44.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 init_complete bucket index max shards: 11 2024-09-10T06:24:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 Filter name: none 2024-09-10T06:24:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9895ffb640 20 reqs_thread_entry: start 2024-09-10T06:24:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T06:24:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 20 rados->read ofs=0 len=0 2024-09-10T06:24:44.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.738+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329cc8720 con 0x7f9a58115060 2024-09-10T06:24:44.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T06:24:44.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T06:24:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T06:24:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccf440 con 0x7f9a58115060 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9a6000a4d0 con 0x7f9a58115060 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.742+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94021830373040 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558329ccab50 con 0x558329c8e720 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== watch-notify(notify (1) cookie 94021830178496 notify 137438953507 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f9a60026410 con 0x558329c8e720 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f994a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94021830178496 notifier 4918 bl.length()=649 2024-09-10T06:24:44.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f994a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f994a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(64 notify.4 [notify cookie 94021830373040 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a60046020 con 0x558329c8e720 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f994a7fc640 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f992c003eb0 con 0x558329c8e720 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x558329c8e720 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== watch-notify(notify_complete (2) cookie 94021830373040 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a600265e0 con 0x558329c8e720 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T06:24:42.176494Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T06:24:42.176475Z","tags":[],"group_ids":[]} 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f991d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:24:44.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021830188320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c8e720 2024-09-10T06:24:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94021830188320] v32'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x558329c8e720 2024-09-10T06:24:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021830163360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c930e0 2024-09-10T06:24:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94021830163360] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a692b69c0 20 remove_watcher() i=0 2024-09-10T06:24:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a692b69c0 2 removed watcher, disabling cache 2024-09-10T06:24:44.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.746+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021830169472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c8e720 2024-09-10T06:24:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94021830169472] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x558329c8e720 2024-09-10T06:24:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a692b69c0 20 remove_watcher() i=1 2024-09-10T06:24:44.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021830170832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c979f0 2024-09-10T06:24:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a665bb640 1 -- 172.21.15.117:0/2798152475 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94021830170832] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c00e620 con 0x558329c979f0 2024-09-10T06:24:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a692b69c0 20 remove_watcher() i=2 2024-09-10T06:24:44.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.750+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021830176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c930e0 2024-09-10T06:24:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a66dbc640 1 -- 172.21.15.117:0/2798152475 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94021830176592] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a58112030 con 0x558329c930e0 2024-09-10T06:24:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a692b69c0 20 remove_watcher() i=3 2024-09-10T06:24:44.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021830178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329ccb310 con 0x558329c8e720 2024-09-10T06:24:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94021830178496] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x558329c8e720 2024-09-10T06:24:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a692b69c0 20 remove_watcher() i=4 2024-09-10T06:24:44.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.754+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021830182512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329cc6470 con 0x7f9a58115060 2024-09-10T06:24:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94021830182512] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x7f9a58115060 2024-09-10T06:24:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a692b69c0 20 remove_watcher() i=5 2024-09-10T06:24:44.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021830184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329cc6470 con 0x7f9a58115060 2024-09-10T06:24:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94021830184768] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x7f9a58115060 2024-09-10T06:24:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a692b69c0 20 remove_watcher() i=6 2024-09-10T06:24:44.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.758+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021830183568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558329cc6470 con 0x7f9a58115060 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94021830183568] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a60046020 con 0x7f9a58115060 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 20 remove_watcher() i=7 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9a58115060 msgr2=0x7f9a580c79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f9a58115060 0x7f9a580c79a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329c8e720 msgr2=0x558329c90bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329c8e720 0x558329c90bb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c930e0 msgr2=0x558329c954d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c930e0 0x558329c954d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c979f0 msgr2=0x558329c99e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c979f0 0x558329c99e20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9930039a70 msgr2=0x7f993003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9930039a70 0x7f993003bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x558329c62670 tx=0x7f9a5c010000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 msgr2=0x558329c83670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a675bd640 1 -- 172.21.15.117:0/2798152475 reap_dead start 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9a580bffd0 tx=0x7f9a580bbf40 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 shutdown_connections 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2798152475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c7c300 0x558329c83670 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 >> 172.21.15.117:0/2798152475 conn(0x558329c78730 msgr2=0x558329c76940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 shutdown_connections 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2798152475 wait complete. 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 msgr2=0x7f994003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 0x7f994003bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bf50 tx=0x7f9a5c00f000 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 msgr2=0x558329c70150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b4af0 tx=0x7f9a580b4f30 comp rx=0 tx=0).stop 2024-09-10T06:24:44.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 shutdown_connections 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f9940039a70 0x7f994003bf30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/2741670886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329c6fd30 0x558329c70150 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 >> 172.21.15.117:0/2741670886 conn(0x558329c656e0 msgr2=0x558329c65ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 shutdown_connections 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/2741670886 wait complete. 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329b625b0 msgr2=0x558329c590c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558329b625b0 0x558329c590c0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c5b7f0 msgr2=0x558329c5dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558329c5b7f0 0x558329c5dbe0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c5f6f0 msgr2=0x558329c61ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558329c5f6f0 0x558329c61ae0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f994c039a70 msgr2=0x7f994c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f994c039a70 0x7f994c03bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c001d80 tx=0x7f9a5c0012e0 comp rx=0 tx=0).stop 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 msgr2=0x558329c51f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:24:44.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 --2- 172.21.15.117:0/635853642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558329b5fc80 0x558329c51f50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b8040 tx=0x7f9a58018020 comp rx=0 tx=0).stop 2024-09-10T06:24:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a675bd640 1 -- 172.21.15.117:0/635853642 reap_dead start 2024-09-10T06:24:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 shutdown_connections 2024-09-10T06:24:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 >> 172.21.15.117:0/635853642 conn(0x558329ad3010 msgr2=0x558329c45170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:24:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 shutdown_connections 2024-09-10T06:24:44.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:24:44.762+0000 7f9a692b69c0 1 -- 172.21.15.117:0/635853642 wait complete. 2024-09-10T06:24:44.774 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.774 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T06:24:42.176494Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T06:24:42.176475Z', 'tags': [], 'group_ids': []} 2024-09-10T06:24:44.775 ERROR:root:0 2024-09-10T06:24:44.775 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T06:24:44.781 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.785 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.785 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T06:24:44.791 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.791 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.797 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-10T06:24:44.807 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-10T06:24:44.807 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.811 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.811 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-10T06:24:44.818 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:44.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.822 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.822 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-10T06:24:44.829 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-10T06:24:44.829 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.833 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.833 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-10T06:24:44.841 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-10T06:24:44.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.845 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.845 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-10T06:24:44.851 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:44.852 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.855 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-10T06:24:44.860 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:44.860 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.864 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.864 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-10T06:24:44.871 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:44.872 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.875 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:44.875 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.879 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T06:24:44.879 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T06:24:44.883 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T06:24:44.899 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T06:24:44.949 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-10T06:24:44.950 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T06:24:44.956 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:24:44.891334Z', 'creation_time': '2024-09-10T06:24:44.887902Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T06:24:44.957 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T06:24:44.964 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:24:44.891334Z', 'creation_time': '2024-09-10T06:24:44.887902Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T06:24:44.974 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T06:24:44.980 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:24:44.891334Z', 'creation_time': '2024-09-10T06:24:44.887902Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T06:24:44.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-10T06:24:44.985 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000028ad9505156f4f77-0066dfe62c-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:24:44.994 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-10T06:24:45.006 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:45.007 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-10T06:24:45.024 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:24:45.042 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11'} 2024-09-10T06:24:45.063 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:45.109 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11'} 2024-09-10T06:24:45.132 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:45.132 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-10T06:24:45.154 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:45.166 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-10T06:24:45.177 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:24:45.178 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T06:24:45.184 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '1f11ec0c-dab3-4c88-849a-c22a32f07424', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'marker': 'be621638-e902-4133-b94d-0397be1b6a7c.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T06:24:45.118425Z', 'creation_time': '2024-09-10T06:24:44.887902Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-10T06:25:45.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-10T06:25:45.338 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.339 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-10T06:25:45.367 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T06:25:45.374 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.374 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-10T06:25:45.379 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-10T06:25:45.384 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.385 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-10T06:25:45.390 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-10T06:25:45.395 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T06:00:00.000000Z', 'epoch': 1725948000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T06:25:45.396 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-10T06:25:45.406 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:45.407 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T06:25:45.412 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-10T06:25:45.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T06:25:45.429 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:25:45.433 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T06:25:45.449 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:25:45.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T06:25:45.818 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a26e11f9470650c6-0066dfe669-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:45.996 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T06:25:46.002 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T06:25:46.013 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T06:25:46.018 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T06:25:46.165 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-10T06:25:46.256 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:46.256 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T06:25:46.266 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-10T06:25:46.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T06:25:46.275 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T06:25:46.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T06:25:46.305 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000075497ed6832bc52-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-10T06:25:46.426 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:46.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T06:25:46.432 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000048af5b69be78ba25-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.432 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-10T06:25:46.436 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '2ef3ea51-0aa2-410c-a700-42b75c2c5647'}]}} 2024-09-10T06:25:46.437 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-10T06:25:46.460 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T06:25:46.460 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T06:25:46.464 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T06:25:46.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-10T06:25:46.470 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008699420655187d56-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-10T06:25:46.474 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bbae74cb8634b306-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T06:25:46.502 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T06:25:46.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-10T06:25:46.507 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c4b3f41ef1f3c837-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.508 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-10T06:25:46.512 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ee39cf4cf1ce19c0-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.512 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-10T06:25:46.517 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T06:25:46.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-10T06:25:46.523 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009e457b734e4437c6-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.523 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-10T06:25:46.527 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002ff8aef21f691c74-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.527 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-10T06:25:46.531 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000cf39dd6403078ff4-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.532 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-10T06:25:46.536 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ad917a679db317a4-0066dfe66a-4227-default', 'HostId': '4227-default-default'} 2024-09-10T06:25:46.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-10T06:25:46.556 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:46.556 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T06:25:46.560 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-10T06:25:46.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-10T06:25:46.570 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:46.570 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T06:25:46.574 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-10T06:25:46.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-10T06:25:46.584 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T06:25:46.589 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T06:25:46.599 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T06:25:46.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:25:46.601 INFO:tasks.rgw.client.0.smithi117.stdout:2024-09-10T06:25:46.597+0000 7f3814ae6640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29140) UID: 0 2024-09-10T06:25:46.601 INFO:tasks.rgw.client.0.smithi117.stdout:2024-09-10T06:25:46.597+0000 7f381832ea40 -1 shutting down 2024-09-10T06:26:14.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-10T06:26:17.107 INFO:tasks.rgw.client.0:Stopped 2024-09-10T06:26:17.108 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T06:26:17.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T06:26:17.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T06:26:17.226 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T06:26:17.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T06:26:17.226 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T06:26:17.307 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setuser ceph since I am not root 2024-09-10T06:26:17.307 INFO:teuthology.orchestra.run.smithi117.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T06:26:17.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20aa1d49c0 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558e0771b8c0 0x558e0771dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20aa1d49c0 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e075c99c0 con 0x558e07717770 2024-09-10T06:26:17.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20aa1d49c0 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x558e076196d0 con 0x558e0771b8c0 2024-09-10T06:26:17.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a74d9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x558e0771b8c0 0x558e0771dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a7cda640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x558e07717770 0x558e07717b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.117:34148/0 (socket says 172.21.15.117:34148) 2024-09-10T06:26:17.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2546482001 >> v2:172.21.15.84:3300/0 conn(0x558e0771b8c0 0x558e0771dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50540/0 (socket says 172.21.15.117:50540) 2024-09-10T06:26:17.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a7cda640 1 -- 172.21.15.117:0/2546482001 learned_addr learned my addr 172.21.15.117:0/2546482001 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-10T06:26:17.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a74d9640 1 -- 172.21.15.117:0/2546482001 >> v1:172.21.15.84:6789/0 conn(0x558e07717770 legacy=0x558e07717b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.304+0000 7f20a74d9640 1 -- 172.21.15.117:0/2546482001 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e075bdca0 con 0x558e0771b8c0 2024-09-10T06:26:17.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2546482001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e0771b8c0 0x558e0771dcb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a480 tx=0x7f209c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b01e67dc77f77c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20a6cd8640 1 -- 172.21.15.117:0/2546482001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c0aa570 con 0x558e0771b8c0 2024-09-10T06:26:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20a6cd8640 1 -- 172.21.15.117:0/2546482001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0af070 con 0x558e0771b8c0 2024-09-10T06:26:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20a6cd8640 1 -- 172.21.15.117:0/2546482001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c0aa860 con 0x558e0771b8c0 2024-09-10T06:26:17.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2546482001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e0771b8c0 msgr2=0x558e0771dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2546482001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e0771b8c0 0x558e0771dcb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a480 tx=0x7f209c01b310 comp rx=0 tx=0).stop 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2546482001 shutdown_connections 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2546482001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e0771b8c0 0x558e0771dcb0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2546482001 >> 172.21.15.117:0/2546482001 conn(0x558e0768b080 msgr2=0x558e0768b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2546482001 shutdown_connections 2024-09-10T06:26:17.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.308+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2546482001 wait complete. 2024-09-10T06:26:17.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20aa1d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20aa1d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e0761d680 con 0x558e07717770 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50550/0 (socket says 172.21.15.117:50550) 2024-09-10T06:26:17.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.324+0000 7f20a7cda640 1 -- 172.21.15.117:0/538982784 learned_addr learned my addr 172.21.15.117:0/538982784 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:26:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 -- 172.21.15.117:0/538982784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e07598da0 con 0x558e07717770 2024-09-10T06:26:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 --2- 172.21.15.117:0/538982784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2098001e50 tx=0x7f2098001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbdc1071ea2075f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f1f95e0b640 1 -- 172.21.15.117:0/538982784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098012020 con 0x558e07717770 2024-09-10T06:26:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f1f95e0b640 1 -- 172.21.15.117:0/538982784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209800e7c0 con 0x558e07717770 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f1f95e0b640 1 -- 172.21.15.117:0/538982784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209800eaa0 con 0x558e07717770 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/538982784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 msgr2=0x558e078029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/538982784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2098001e50 tx=0x7f2098001e80 comp rx=0 tx=0).stop 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/538982784 shutdown_connections 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/538982784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e078029b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/538982784 >> 172.21.15.117:0/538982784 conn(0x558e0768b080 msgr2=0x558e077fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/538982784 shutdown_connections 2024-09-10T06:26:17.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/538982784 wait complete. 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e0780a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20aa1d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e075bfa50 con 0x558e07717770 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e0780a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e0780a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50562/0 (socket says 172.21.15.117:50562) 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 -- 172.21.15.117:0/1874020390 learned_addr learned my addr 172.21.15.117:0/1874020390 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:26:17.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0780a5b0 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.328+0000 7f20a7cda640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e0780a050 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x558e078039a0 tx=0x7f2098000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 -- 172.21.15.117:0/1874020390 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098012030 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 -- 172.21.15.117:0/1874020390 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209801a680 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e0780a840 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 -- 172.21.15.117:0/1874020390 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209801a980 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0780b1f0 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 -- 172.21.15.117:0/1874020390 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2098015020 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f1f8ffff640 1 -- 172.21.15.117:0/1874020390 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2098020070 con 0x558e07717770 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a74d9640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e0771b8c0 0x558e078111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07811700 con 0x558e0771b8c0 2024-09-10T06:26:17.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a84db640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e0771b8c0 0x558e078111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a74d9640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ae000 tx=0x7f209c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a84db640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e0771b8c0 0x558e078111c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a84db640 1 -- 172.21.15.117:0/1874020390 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e0771b8c0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07811aa0 con 0x558e0771b8c0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a84db640 1 -- 172.21.15.117:0/1874020390 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e0771b8c0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e078138b0 0x558e07815ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:3 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07816370 con 0x558e078138b0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a7cda640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e078138b0 0x558e07815ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.332+0000 7f20a7cda640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e078138b0 0x558e07815ca0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 -- 172.21.15.117:0/1874020390 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(3 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2098008030 con 0x558e078138b0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07812750 con 0x558e0771b8c0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a84db640 1 -- 172.21.15.117:0/1874020390 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e0771b8c0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e078177b0 0x558e07819ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:5 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0781a330 con 0x558e078177b0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a74d9640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e078177b0 0x558e07819ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a74d9640 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e078177b0 0x558e07819ba0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a74d9640 1 -- 172.21.15.117:0/1874020390 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(5 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f209c0a8070 con 0x558e078177b0 2024-09-10T06:26:17.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e0762a450 con 0x558e07827df0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50568/0 (socket says 172.21.15.117:50568) 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 -- 172.21.15.117:0/637318535 learned_addr learned my addr 172.21.15.117:0/637318535 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 -- 172.21.15.117:0/637318535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e07828850 con 0x558e07827df0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20a7cda640 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2098017df0 tx=0x7f2098040f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f1f8d7fa640 1 -- 172.21.15.117:0/637318535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098016d10 con 0x558e07827df0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e078290b0 con 0x558e07827df0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f1f8d7fa640 1 -- 172.21.15.117:0/637318535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098016570 con 0x558e07827df0 2024-09-10T06:26:17.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.336+0000 7f1f8d7fa640 1 -- 172.21.15.117:0/637318535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098016870 con 0x558e07827df0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e07829620 con 0x558e07827df0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f8d7fa640 1 -- 172.21.15.117:0/637318535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f209804a040 con 0x558e07827df0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f8d7fa640 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 0x7f1f8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f8d7fa640 1 -- 172.21.15.117:0/637318535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2098005050 con 0x558e07827df0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a74d9640 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 0x7f1f8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20aa1d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20aa1d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e07803200 con 0x558e07834530 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a74d9640 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 0x7f1f8003bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a480 tx=0x7f209c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50584/0 (socket says 172.21.15.117:50584) 2024-09-10T06:26:17.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a7cda640 1 -- 172.21.15.117:0/1526331828 learned_addr learned my addr 172.21.15.117:0/1526331828 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:26:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a7cda640 1 -- 172.21.15.117:0/1526331828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e07834f00 con 0x558e07834530 2024-09-10T06:26:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f20a7cda640 1 --2- 172.21.15.117:0/1526331828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2098043fb0 tx=0x7f20980508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28034baf40e5777 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f86ffd640 1 -- 172.21.15.117:0/1526331828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098061070 con 0x558e07834530 2024-09-10T06:26:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f86ffd640 1 -- 172.21.15.117:0/1526331828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098024800 con 0x558e07834530 2024-09-10T06:26:17.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.340+0000 7f1f86ffd640 1 -- 172.21.15.117:0/1526331828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209803c970 con 0x558e07834530 2024-09-10T06:26:17.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1526331828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 msgr2=0x558e07834910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1526331828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2098043fb0 tx=0x7f20980508e0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1526331828 shutdown_connections 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1526331828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e07834910 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1526331828 >> 172.21.15.117:0/1526331828 conn(0x558e07830960 msgr2=0x558e0782eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1526331828 shutdown_connections 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1526331828 wait complete. 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 Processor -- start 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- start start 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e078353c0 con 0x558e07834530 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20a7cda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.117:50600/0 (socket says 172.21.15.117:50600) 2024-09-10T06:26:17.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 learned_addr learned my addr 172.21.15.117:0/2445644809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0783bdd0 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20a7cda640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2098043ec0 tx=0x7f2098014e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f1f857fa640 1 -- 172.21.15.117:0/2445644809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209806c020 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e0783bdd0 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f1f857fa640 1 -- 172.21.15.117:0/2445644809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098024800 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0783c3a0 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f1f857fa640 1 -- 172.21.15.117:0/2445644809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098061030 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f1f857fa640 1 -- 172.21.15.117:0/2445644809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f209806f020 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.344+0000 7f1f857fa640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f70039a70 0x7f1f7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f1f857fa640 1 -- 172.21.15.117:0/2445644809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2098062070 con 0x558e07834530 2024-09-10T06:26:17.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f70039a70 0x7f1f7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e07846aa0 0x558e07848f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07849680 con 0x558e07846aa0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e07846aa0 0x558e07848f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f70039a70 0x7f1f7003bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f209c018f40 tx=0x7f209c0a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e07846aa0 0x558e07848f30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 realm 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07849a90 con 0x558e07846aa0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a330 con 0x558e07846aa0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e0784b430 0x558e0784d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:5 5.1f 5:fd5061de:::zone_info.be621638-e902-4133-b94d-0397be1b6a7c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784de70 con 0x558e0784b430 2024-09-10T06:26:17.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a7cda640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e0784b430 0x558e0784d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a7cda640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e0784b430 0x558e0784d820 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== osd_op_reply(5 zone_info.be621638-e902-4133-b94d-0397be1b6a7c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 20 searching for the correct realm 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e0784fd50 0x558e078521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e07852840 con 0x558e0784fd50 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e0784fd50 0x558e078521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e0784fd50 0x558e078521c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.348+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e07852840 con 0x558e0784b430 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a7cda640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f209807c040 0x7f2098022780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e07852840 con 0x7f209807c040 2024-09-10T06:26:17.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f209807c040 0x7f2098022780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f209807c040 0x7f2098022780 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 7 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784b430 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.352+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784b430 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.356+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 5 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784b430 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784b430 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784fd50 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.360+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x7f209807c040 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 8 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e07846aa0 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e0784a6d0 con 0x558e0784b430 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T06:26:17.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 RGWRados::pool_iterate: got zone_info.be621638-e902-4133-b94d-0397be1b6a7c 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784e6c0 con 0x558e07846aa0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784eab0 con 0x558e07846aa0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:40 5.2 5:43af4d4a:::zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0784eab0 con 0x558e0784fd50 2024-09-10T06:26:17.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 10 ==== osd_op_reply(40 zonegroup_info.1f11ec0c-dab3-4c88-849a-c22a32f07424 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 zone default found 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 4 Realm: () 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 4 ZoneGroup: default (1f11ec0c-dab3-4c88-849a-c22a32f07424) 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 4 Zone: default (be621638-e902-4133-b94d-0397be1b6a7c) 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 zonegroup default 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07852cc0 con 0x7f209807c040 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.364+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07854840 con 0x558e0784fd50 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 20 rados->read ofs=0 len=0 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07854c60 con 0x558e0784fd50 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 20 started sync module instance, tier type = 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 20 started zone id=be621638-e902-4133-b94d-0397be1b6a7c (name=default) with tier type = 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07853b50 con 0x558e0784b430 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 8 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068499889984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07854360 con 0x558e0784b430 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07855b60 con 0x558e07846aa0 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.368+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068499889984] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 16 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068499895984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07855ad0 con 0x558e07846aa0 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078568f0 con 0x558e0784fd50 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 13 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068499895984] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068499898192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07856d10 con 0x558e0784fd50 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078576d0 con 0x558e0784b430 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 10 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068499905216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07858390 con 0x558e0784b430 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.372+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07858d50 con 0x558e07846aa0 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.376+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068499898192] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.376+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068499905216] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.376+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 18 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.376+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068499906272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07858300 con 0x558e07846aa0 2024-09-10T06:26:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.376+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07859200 con 0x7f209807c040 2024-09-10T06:26:17.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068499906272] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 10 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068499908768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07859170 con 0x7f209807c040 2024-09-10T06:26:17.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07859b30 con 0x7f209807c040 2024-09-10T06:26:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 11 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068499912320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07859f50 con 0x7f209807c040 2024-09-10T06:26:17.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0785a910 con 0x7f209807c040 2024-09-10T06:26:17.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.380+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068499908768] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068499912320] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 14 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068499913376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07859ec0 con 0x7f209807c040 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=0 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=1 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=2 2024-09-10T06:26:17.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=3 2024-09-10T06:26:17.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=4 2024-09-10T06:26:17.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=5 2024-09-10T06:26:17.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20aa1d49c0 20 add_watcher() i=6 2024-09-10T06:26:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.384+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068499913376] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 20 add_watcher() i=7 2024-09-10T06:26:17.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 2 all 8 watchers are set, enabling cache 2024-09-10T06:26:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0785d940 con 0x558e07846aa0 2024-09-10T06:26:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068499915872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0785ad30 con 0x558e07846aa0 2024-09-10T06:26:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068499915872] v32'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f1f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:26:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T06:26:17.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T06:26:17.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.388+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078660c0 con 0x558e07846aa0 2024-09-10T06:26:17.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07866650 con 0x7f209807c040 2024-09-10T06:26:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07866a70 con 0x558e0784fd50 2024-09-10T06:26:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.392+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07866eb0 con 0x558e07846aa0 2024-09-10T06:26:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'276 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867420 con 0x558e0784b430 2024-09-10T06:26:17.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'83 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867420 con 0x558e0784fd50 2024-09-10T06:26:17.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.396+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867990 con 0x558e07846aa0 2024-09-10T06:26:17.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.400+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.400+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867a20 con 0x7f209807c040 2024-09-10T06:26:17.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867a20 con 0x558e0784b430 2024-09-10T06:26:17.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07867ab0 con 0x558e0784fd50 2024-09-10T06:26:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.404+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868100 con 0x558e0784b430 2024-09-10T06:26:17.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.408+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'84 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.408+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078684e0 con 0x7f209807c040 2024-09-10T06:26:17.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.408+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.408+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x558e0784b430 2024-09-10T06:26:17.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.412+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.412+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x7f209807c040 2024-09-10T06:26:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.412+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'64 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.412+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x558e07846aa0 2024-09-10T06:26:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x558e0784fd50 2024-09-10T06:26:17.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x558e0784b430 2024-09-10T06:26:17.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'85 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.416+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078681f0 con 0x558e0784fd50 2024-09-10T06:26:17.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.420+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.420+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e07846aa0 2024-09-10T06:26:17.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.420+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.420+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e07846aa0 2024-09-10T06:26:17.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.424+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'278 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.424+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784fd50 2024-09-10T06:26:17.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784b430 2024-09-10T06:26:17.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784fd50 2024-09-10T06:26:17.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.428+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784fd50 2024-09-10T06:26:17.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784fd50 2024-09-10T06:26:17.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868320 con 0x558e0784fd50 2024-09-10T06:26:17.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.432+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868340 con 0x7f209807c040 2024-09-10T06:26:17.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.436+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.436+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868340 con 0x558e0784fd50 2024-09-10T06:26:17.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.436+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.436+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868370 con 0x7f209807c040 2024-09-10T06:26:17.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.440+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.440+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868370 con 0x558e0784fd50 2024-09-10T06:26:17.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.444+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.444+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07868340 con 0x7f209807c040 2024-09-10T06:26:17.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.444+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'65 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.444+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078683e0 con 0x558e0784b430 2024-09-10T06:26:17.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f1f5cfe1640 20 reqs_thread_entry: start 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f20aa1d49c0 20 init_complete bucket index max shards: 11 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f20aa1d49c0 20 Filter name: none 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f1ed67fc640 20 reqs_thread_entry: start 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-10T06:26:17.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.448+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:94 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865ba0 con 0x558e0784fd50 2024-09-10T06:26:17.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 27 ==== osd_op_reply(94 gc.24 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:95 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 28 ==== osd_op_reply(95 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:96 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 29 ==== osd_op_reply(96 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:97 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 30 ==== osd_op_reply(97 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:98 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 31 ==== osd_op_reply(98 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:99 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.452+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 32 ==== osd_op_reply(99 gc.24 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-10T06:26:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:100 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 33 ==== osd_op_reply(100 gc.25 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:101 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 34 ==== osd_op_reply(101 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:102 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 35 ==== osd_op_reply(102 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:103 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 36 ==== osd_op_reply(103 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:104 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 37 ==== osd_op_reply(104 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.456+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:105 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.460+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 38 ==== osd_op_reply(105 gc.25 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.460+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-10T06:26:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.460+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:106 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.460+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 23 ==== osd_op_reply(106 gc.26 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.460+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:107 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 24 ==== osd_op_reply(107 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:108 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x7f209807c040 2024-09-10T06:26:17.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 25 ==== osd_op_reply(108 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:109 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 26 ==== osd_op_reply(109 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:110 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 27 ==== osd_op_reply(110 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.464+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.468+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 28 ==== osd_op_reply(111 gc.26 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.468+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-10T06:26:17.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.468+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:112 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.468+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 39 ==== osd_op_reply(112 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.468+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:113 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 40 ==== osd_op_reply(113 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 41 ==== osd_op_reply(114 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 42 ==== osd_op_reply(115 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 43 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:117 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 44 ==== osd_op_reply(117 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-10T06:26:17.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.472+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 29 ==== osd_op_reply(118 gc.28 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 30 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:120 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x7f209807c040 2024-09-10T06:26:17.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 31 ==== osd_op_reply(120 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:121 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 32 ==== osd_op_reply(121 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:122 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 33 ==== osd_op_reply(122 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.476+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:123 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.480+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 34 ==== osd_op_reply(123 gc.28 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.480+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-10T06:26:17.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.480+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:124 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 45 ==== osd_op_reply(124 gc.29 [call] v32'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:125 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 46 ==== osd_op_reply(125 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:126 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x558e0784fd50 2024-09-10T06:26:17.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 47 ==== osd_op_reply(126 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:127 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 48 ==== osd_op_reply(127 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:128 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 49 ==== osd_op_reply(128 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.484+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:129 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784fd50 2024-09-10T06:26:17.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 50 ==== osd_op_reply(129 gc.29 [call] v32'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-10T06:26:17.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:130 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 35 ==== osd_op_reply(130 gc.30 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:131 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 36 ==== osd_op_reply(131 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:132 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07864b50 con 0x7f209807c040 2024-09-10T06:26:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 37 ==== osd_op_reply(132 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.488+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:133 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 38 ==== osd_op_reply(133 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:134 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 39 ==== osd_op_reply(134 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.492+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:135 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x7f209807c040 2024-09-10T06:26:17.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 40 ==== osd_op_reply(135 gc.30 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-10T06:26:17.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:136 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784b430 2024-09-10T06:26:17.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 19 ==== osd_op_reply(136 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:137 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784b430 2024-09-10T06:26:17.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 20 ==== osd_op_reply(137 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:138 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784b430 2024-09-10T06:26:17.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 21 ==== osd_op_reply(138 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:139 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784b430 2024-09-10T06:26:17.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 22 ==== osd_op_reply(139 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.496+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:140 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07865b60 con 0x558e0784b430 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 23 ==== osd_op_reply(140 gc.31 [call out=1715b] v0'0 uv39 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process iterating over entry tag='be621638-e902-4133-b94d-0397be1b6a7c.4227.3741086107034748830', time=2024-09-10T06:26:00.809794+0000, chain.objs.size()=7 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_1 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:141 3.3d 3:bc3621c6:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07884f70 con 0x558e0784fd50 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_2 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:142 3.7 3:e1230ab1:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07887bb0 con 0x558e0784fd50 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_3 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:143 3.3 3:c07cf2d5:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788a6c0 con 0x558e0784b430 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_4 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:144 3.1c 3:39a78c52:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07887bb0 con 0x558e07846aa0 2024-09-10T06:26:17.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_5 2024-09-10T06:26:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:145 3.15 3:aa5a6075:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788a6c0 con 0x558e0784b430 2024-09-10T06:26:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_6 2024-09-10T06:26:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:146 3.1d 3:b90088d0:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788a6c0 con 0x558e0784fd50 2024-09-10T06:26:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_7 2024-09-10T06:26:17.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.500+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:147 3.20 3:059d9747:::be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07894110 con 0x558e0784b430 2024-09-10T06:26:17.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 24 ==== osd_op_reply(147 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_7 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 51 ==== osd_op_reply(141 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_1 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 25 ==== osd_op_reply(143 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_3 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 26 ==== osd_op_reply(145 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_5 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 28 ==== osd_op_reply(144 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_4 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 52 ==== osd_op_reply(142 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_2 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 53 ==== osd_op_reply(146 be621638-e902-4133-b94d-0397be1b6a7c.4227.11__shadow_.Z9l1SI4P3g0dYF0BNl6epNF5ICAFd0A_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20aa1d49c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T06:26:17.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.504+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:148 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f040 con 0x558e0784b430 2024-09-10T06:26:17.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.508+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 27 ==== osd_op_reply(148 gc.31 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.508+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:149 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784b430 2024-09-10T06:26:17.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 28 ==== osd_op_reply(149 gc.31 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-10T06:26:17.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 29 ==== osd_op_reply(150 gc.0 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 30 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.512+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 31 ==== osd_op_reply(152 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 32 ==== osd_op_reply(153 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:154 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 33 ==== osd_op_reply(154 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:155 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 34 ==== osd_op_reply(155 gc.0 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-10T06:26:17.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.516+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.520+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 41 ==== osd_op_reply(156 gc.1 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.520+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.520+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 42 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.520+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.520+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 43 ==== osd_op_reply(158 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 44 ==== osd_op_reply(159 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:160 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 45 ==== osd_op_reply(160 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.524+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:161 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x7f209807c040 2024-09-10T06:26:17.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.528+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 46 ==== osd_op_reply(161 gc.1 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.528+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-10T06:26:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.528+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.528+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 54 ==== osd_op_reply(162 gc.2 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.528+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 55 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 56 ==== osd_op_reply(164 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 57 ==== osd_op_reply(165 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:166 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 58 ==== osd_op_reply(166 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:167 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784fd50 2024-09-10T06:26:17.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 59 ==== osd_op_reply(167 gc.2 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-10T06:26:17.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.532+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 35 ==== osd_op_reply(168 gc.3 [call] v32'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 36 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 37 ==== osd_op_reply(170 gc.3 [call out=24b] v0'0 uv279 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 38 ==== osd_op_reply(171 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.536+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:172 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 39 ==== osd_op_reply(172 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:173 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e07846aa0 2024-09-10T06:26:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 40 ==== osd_op_reply(173 gc.3 [call] v32'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-10T06:26:17.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.540+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e0788f020 con 0x558e0784b430 2024-09-10T06:26:17.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 29 ==== osd_op_reply(174 gc.4 [call] v32'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 30 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 31 ==== osd_op_reply(176 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 32 ==== osd_op_reply(177 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:178 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.544+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 33 ==== osd_op_reply(178 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.548+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.548+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:179 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.548+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 34 ==== osd_op_reply(179 gc.4 [call] v32'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.548+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-10T06:26:17.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.548+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 60 ==== osd_op_reply(180 gc.5 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 61 ==== osd_op_reply(181 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 62 ==== osd_op_reply(182 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 63 ==== osd_op_reply(183 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:184 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 64 ==== osd_op_reply(184 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.552+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:185 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.556+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 65 ==== osd_op_reply(185 gc.5 [call] v32'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.556+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-10T06:26:17.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.556+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 41 ==== osd_op_reply(186 gc.6 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 42 ==== osd_op_reply(187 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 43 ==== osd_op_reply(188 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 44 ==== osd_op_reply(189 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:190 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 45 ==== osd_op_reply(190 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.560+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:191 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.564+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 46 ==== osd_op_reply(191 gc.6 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.564+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-10T06:26:17.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.564+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 47 ==== osd_op_reply(192 gc.7 [call] v32'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 48 ==== osd_op_reply(193 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 49 ==== osd_op_reply(194 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 50 ==== osd_op_reply(195 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.568+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:196 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 51 ==== osd_op_reply(196 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:197 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 52 ==== osd_op_reply(197 gc.7 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-10T06:26:17.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.572+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 35 ==== osd_op_reply(198 gc.8 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 36 ==== osd_op_reply(199 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 37 ==== osd_op_reply(200 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.576+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 38 ==== osd_op_reply(201 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:202 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 39 ==== osd_op_reply(202 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:203 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 40 ==== osd_op_reply(203 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.580+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-10T06:26:17.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 66 ==== osd_op_reply(204 gc.9 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 67 ==== osd_op_reply(205 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.584+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 68 ==== osd_op_reply(206 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 69 ==== osd_op_reply(207 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:208 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 70 ==== osd_op_reply(208 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:209 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.588+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 71 ==== osd_op_reply(209 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-10T06:26:17.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 41 ==== osd_op_reply(210 gc.10 [call] v32'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 42 ==== osd_op_reply(211 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.592+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 43 ==== osd_op_reply(212 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 44 ==== osd_op_reply(213 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:214 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 45 ==== osd_op_reply(214 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.596+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:215 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.600+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 46 ==== osd_op_reply(215 gc.10 [call] v32'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.600+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-10T06:26:17.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.600+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.600+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 53 ==== osd_op_reply(216 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.600+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 54 ==== osd_op_reply(217 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 55 ==== osd_op_reply(218 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:219 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 56 ==== osd_op_reply(219 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:220 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 57 ==== osd_op_reply(220 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.604+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:221 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.608+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 58 ==== osd_op_reply(221 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.608+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-10T06:26:17.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.608+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:222 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 47 ==== osd_op_reply(222 gc.12 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:223 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 48 ==== osd_op_reply(223 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:224 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 49 ==== osd_op_reply(224 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.612+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:225 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 50 ==== osd_op_reply(225 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:226 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 51 ==== osd_op_reply(226 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:227 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 52 ==== osd_op_reply(227 gc.12 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-10T06:26:17.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.616+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:228 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.620+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 59 ==== osd_op_reply(228 gc.13 [call] v32'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.620+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:229 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 60 ==== osd_op_reply(229 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:230 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 61 ==== osd_op_reply(230 gc.13 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:231 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 62 ==== osd_op_reply(231 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:232 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 63 ==== osd_op_reply(232 gc.13 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.624+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:233 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x7f209807c040 2024-09-10T06:26:17.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.628+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 64 ==== osd_op_reply(233 gc.13 [call] v32'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.628+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-10T06:26:17.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.628+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:234 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 47 ==== osd_op_reply(234 gc.14 [call] v32'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:235 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 48 ==== osd_op_reply(235 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:236 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 49 ==== osd_op_reply(236 gc.14 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.632+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:237 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 50 ==== osd_op_reply(237 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:238 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 51 ==== osd_op_reply(238 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.636+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:239 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.640+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 52 ==== osd_op_reply(239 gc.14 [call] v32'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.640+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-10T06:26:17.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.640+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:240 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.640+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 72 ==== osd_op_reply(240 gc.15 [call] v32'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.640+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:241 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 73 ==== osd_op_reply(241 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:242 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 74 ==== osd_op_reply(242 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:243 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 75 ==== osd_op_reply(243 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:244 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 76 ==== osd_op_reply(244 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.644+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:245 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.648+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 77 ==== osd_op_reply(245 gc.15 [call] v32'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.648+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-10T06:26:17.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.648+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:246 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 53 ==== osd_op_reply(246 gc.16 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:247 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 54 ==== osd_op_reply(247 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:248 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 55 ==== osd_op_reply(248 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:249 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 56 ==== osd_op_reply(249 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.652+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:250 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 57 ==== osd_op_reply(250 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:251 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 58 ==== osd_op_reply(251 gc.16 [call] v32'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-10T06:26:17.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.656+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:252 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 78 ==== osd_op_reply(252 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:253 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 79 ==== osd_op_reply(253 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:254 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 80 ==== osd_op_reply(254 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.660+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:255 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 81 ==== osd_op_reply(255 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:256 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 82 ==== osd_op_reply(256 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:257 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.664+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 83 ==== osd_op_reply(257 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-10T06:26:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:258 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 53 ==== osd_op_reply(258 gc.18 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:259 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 54 ==== osd_op_reply(259 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.668+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:260 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 55 ==== osd_op_reply(260 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:261 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 56 ==== osd_op_reply(261 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:262 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 57 ==== osd_op_reply(262 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.672+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:263 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.676+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 58 ==== osd_op_reply(263 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.676+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-10T06:26:17.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.676+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:264 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.676+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 59 ==== osd_op_reply(264 gc.19 [call] v32'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.676+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:265 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 60 ==== osd_op_reply(265 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:266 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 61 ==== osd_op_reply(266 gc.19 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:267 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 62 ==== osd_op_reply(267 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:268 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 63 ==== osd_op_reply(268 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.680+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:269 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.684+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 64 ==== osd_op_reply(269 gc.19 [call] v32'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.684+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-10T06:26:17.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.684+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:270 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 84 ==== osd_op_reply(270 gc.20 [call] v32'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:271 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 85 ==== osd_op_reply(271 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:272 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 86 ==== osd_op_reply(272 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:273 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 87 ==== osd_op_reply(273 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:274 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 88 ==== osd_op_reply(274 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.688+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:275 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.692+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 89 ==== osd_op_reply(275 gc.20 [call] v32'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.692+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-10T06:26:17.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.692+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:276 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 59 ==== osd_op_reply(276 gc.21 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:277 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 60 ==== osd_op_reply(277 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:278 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 61 ==== osd_op_reply(278 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:279 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 62 ==== osd_op_reply(279 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:280 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 63 ==== osd_op_reply(280 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.696+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:281 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.700+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 64 ==== osd_op_reply(281 gc.21 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.700+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-10T06:26:17.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.700+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:282 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 90 ==== osd_op_reply(282 gc.22 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:283 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 91 ==== osd_op_reply(283 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:284 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 92 ==== osd_op_reply(284 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:285 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 93 ==== osd_op_reply(285 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:286 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 94 ==== osd_op_reply(286 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.704+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:287 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.708+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 95 ==== osd_op_reply(287 gc.22 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.708+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-10T06:26:17.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.708+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:288 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 96 ==== osd_op_reply(288 gc.23 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:289 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 97 ==== osd_op_reply(289 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:290 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 98 ==== osd_op_reply(290 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:291 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 99 ==== osd_op_reply(291 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T06:26:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:292 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 100 ==== osd_op_reply(292 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T06:26:17.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.712+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:293 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784fd50 2024-09-10T06:26:17.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.716+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 101 ==== osd_op_reply(293 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.720+0000 7f1f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T06:26:17.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.720+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068499915872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e07846aa0 2024-09-10T06:26:17.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.720+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94068499915872] v32'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.720+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068499889984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07885400 con 0x558e0784b430 2024-09-10T06:26:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94068499889984] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20aa1d49c0 20 remove_watcher() i=0 2024-09-10T06:26:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20aa1d49c0 2 removed watcher, disabling cache 2024-09-10T06:26:17.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068499895984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07853f40 con 0x558e07846aa0 2024-09-10T06:26:17.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94068499895984] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20aa1d49c0 20 remove_watcher() i=1 2024-09-10T06:26:17.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.724+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068499898192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e078556b0 con 0x558e0784fd50 2024-09-10T06:26:17.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.728+0000 7f20a74d9640 1 -- 172.21.15.117:0/2445644809 <== osd.3 v2:172.21.15.117:6808/266380039 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94068499898192] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a8070 con 0x558e0784fd50 2024-09-10T06:26:17.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.728+0000 7f20aa1d49c0 20 remove_watcher() i=2 2024-09-10T06:26:17.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.728+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068499905216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07853f40 con 0x558e0784b430 2024-09-10T06:26:17.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20a7cda640 1 -- 172.21.15.117:0/2445644809 <== osd.2 v2:172.21.15.117:6816/4244172515 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94068499905216] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098008030 con 0x558e0784b430 2024-09-10T06:26:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20aa1d49c0 20 remove_watcher() i=3 2024-09-10T06:26:17.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068499906272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07855f50 con 0x558e07846aa0 2024-09-10T06:26:17.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.1 v2:172.21.15.117:6800/2871996333 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94068499906272] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x558e07846aa0 2024-09-10T06:26:17.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20aa1d49c0 20 remove_watcher() i=4 2024-09-10T06:26:17.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.732+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068499908768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07857f20 con 0x7f209807c040 2024-09-10T06:26:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.736+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94068499908768] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.736+0000 7f20aa1d49c0 20 remove_watcher() i=5 2024-09-10T06:26:17.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.736+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068499912320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07857f20 con 0x7f209807c040 2024-09-10T06:26:17.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.740+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94068499912320] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.740+0000 7f20aa1d49c0 20 remove_watcher() i=6 2024-09-10T06:26:17.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.740+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068499913376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e07857f20 con 0x7f209807c040 2024-09-10T06:26:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.740+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 <== osd.0 v2:172.21.15.84:6800/3404052370 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94068499913376] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a000a4d0 con 0x7f209807c040 2024-09-10T06:26:17.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.740+0000 7f20aa1d49c0 20 remove_watcher() i=7 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f209807c040 msgr2=0x7f2098022780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f209807c040 0x7f2098022780 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e07846aa0 msgr2=0x558e07848f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e07846aa0 0x558e07848f30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e0784b430 msgr2=0x558e0784d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e0784b430 0x558e0784d820 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e0784fd50 msgr2=0x558e078521c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e0784fd50 0x558e078521c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f70039a70 msgr2=0x7f1f7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f70039a70 0x7f1f7003bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f209c018f40 tx=0x7f209c0a8000 comp rx=0 tx=0).stop 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 msgr2=0x558e0783b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20a84db640 1 -- 172.21.15.117:0/2445644809 reap_dead start 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2098043ec0 tx=0x7f2098014e80 comp rx=0 tx=0).stop 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 shutdown_connections 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/2445644809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07834530 0x558e0783b870 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 >> 172.21.15.117:0/2445644809 conn(0x558e07830960 msgr2=0x558e0782eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 shutdown_connections 2024-09-10T06:26:17.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/2445644809 wait complete. 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 msgr2=0x7f1f8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 0x7f1f8003bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a480 tx=0x7f209c005a10 comp rx=0 tx=0).stop 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 msgr2=0x558e07828210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2098017df0 tx=0x7f2098040f00 comp rx=0 tx=0).stop 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 shutdown_connections 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f80039a70 0x7f1f8003bf30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/637318535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07827df0 0x558e07828210 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 >> 172.21.15.117:0/637318535 conn(0x558e0781d7a0 msgr2=0x558e0781db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 shutdown_connections 2024-09-10T06:26:17.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/637318535 wait complete. 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e0771b8c0 msgr2=0x558e078111c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x558e0771b8c0 0x558e078111c0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e078138b0 msgr2=0x558e07815ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x558e078138b0 0x558e07815ca0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e078177b0 msgr2=0x558e07819ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x558e078177b0 0x558e07819ba0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 msgr2=0x7f1f9003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f1f90039ac0 0x7f1f9003bf80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ae000 tx=0x7f209c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:26:17.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 msgr2=0x558e0780a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 --2- 172.21.15.117:0/1874020390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e07717770 0x558e0780a050 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x558e078039a0 tx=0x7f2098000ee0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20a84db640 1 -- 172.21.15.117:0/1874020390 reap_dead start 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 shutdown_connections 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 >> 172.21.15.117:0/1874020390 conn(0x558e0768b080 msgr2=0x558e077fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 shutdown_connections 2024-09-10T06:26:17.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-10T06:26:17.744+0000 7f20aa1d49c0 1 -- 172.21.15.117:0/1874020390 wait complete. 2024-09-10T06:26:17.771 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T06:26:17.784 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T06:26:17.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.911+0000 7f593b856640 1 Processor -- start 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.911+0000 7f593b856640 1 -- start start 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.911+0000 7f593b856640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f593412f4a0 0x7f593412f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.911+0000 7f593b856640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593406feb0 con 0x7f593412fdc0 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.911+0000 7f593b856640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5934070610 con 0x7f593412f4a0 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f59395f2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f593412f4a0 0x7f593412f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f5938df1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f593412fdc0 0x7f593406edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53490/0 (socket says 172.21.15.84:53490) 2024-09-10T06:26:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f5938df1640 1 -- 172.21.15.84:0/2490188638 learned_addr learned my addr 172.21.15.84:0/2490188638 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f59395f2640 1 -- 172.21.15.84:0/2490188638 >> v1:172.21.15.84:6789/0 conn(0x7f593412fdc0 legacy=0x7f593406edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f5927fff640 1 -- 172.21.15.84:0/2490188638 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56648926 0 0) 0x7f593406feb0 con 0x7f593412fdc0 2024-09-10T06:26:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f59395f2640 1 -- 172.21.15.84:0/2490188638 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934073f10 con 0x7f593412f4a0 2024-09-10T06:26:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f59395f2640 1 --2- 172.21.15.84:0/2490188638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f593412f880 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5930009740 tx=0x7f593001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e42a546f9d7ce46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.915+0000 7f5927fff640 1 -- 172.21.15.84:0/2490188638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59300b0070 con 0x7f593412f4a0 2024-09-10T06:26:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5927fff640 1 -- 172.21.15.84:0/2490188638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59300ab530 con 0x7f593412f4a0 2024-09-10T06:26:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5927fff640 1 -- 172.21.15.84:0/2490188638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59300ab830 con 0x7f593412f4a0 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/2490188638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 msgr2=0x7f593412f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 --2- 172.21.15.84:0/2490188638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f593412f880 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5930009740 tx=0x7f593001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/2490188638 shutdown_connections 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 --2- 172.21.15.84:0/2490188638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f593412f880 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/2490188638 >> 172.21.15.84:0/2490188638 conn(0x7f5934071e50 msgr2=0x7f5934072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/2490188638 shutdown_connections 2024-09-10T06:26:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/2490188638 wait complete. 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 Processor -- start 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- start start 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59341378c0 con 0x7f593412f4a0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f59395f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f59395f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45772/0 (socket says 172.21.15.84:45772) 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f59395f2640 1 -- 172.21.15.84:0/1211022846 learned_addr learned my addr 172.21.15.84:0/1211022846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f59395f2640 1 -- 172.21.15.84:0/1211022846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934117670 con 0x7f593412f4a0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f59395f2640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5930019fa0 tx=0x7f593001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59300b0050 con 0x7f593412f4a0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59300b1040 con 0x7f593412f4a0 2024-09-10T06:26:17.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5934134c20 con 0x7f593412f4a0 2024-09-10T06:26:17.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59300b5740 con 0x7f593412f4a0 2024-09-10T06:26:17.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5934118730 con 0x7f593412f4a0 2024-09-10T06:26:17.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593412f880 con 0x7f593412f4a0 2024-09-10T06:26:17.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f59300be030 con 0x7f593412f4a0 2024-09-10T06:26:17.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.919+0000 7f5925ffb640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 0x7f591803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.923+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f59300bc070 con 0x7f593412f4a0 2024-09-10T06:26:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.923+0000 7f5938df1640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 0x7f591803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:17.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.923+0000 7f5938df1640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 0x7f591803d6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5928007fd0 tx=0x7f5928007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:17.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:17.927+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f59300c5020 con 0x7f593412f4a0 2024-09-10T06:26:18.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.095+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5934068e50 con 0x7f591803b200 2024-09-10T06:26:18.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.139+0000 7f5925ffb640 1 -- 172.21.15.84:0/1211022846 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665562 (secure 0 0 0) 0x7f5934068e50 con 0x7f591803b200 2024-09-10T06:26:18.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:18.158 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:26:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.143+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 msgr2=0x7f591803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.143+0000 7f593b856640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 0x7f591803d6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5928007fd0 tx=0x7f5928007900 comp rx=0 tx=0).stop 2024-09-10T06:26:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.143+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 msgr2=0x7f5934124f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.143+0000 7f593b856640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5930019fa0 tx=0x7f593001abb0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 shutdown_connections 2024-09-10T06:26:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f591803b200 0x7f591803d6c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 --2- 172.21.15.84:0/1211022846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f593412f4a0 0x7f5934124f60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 >> 172.21.15.84:0/1211022846 conn(0x7f5934071e50 msgr2=0x7f59341284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 shutdown_connections 2024-09-10T06:26:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.147+0000 7f593b856640 1 -- 172.21.15.84:0/1211022846 wait complete. 2024-09-10T06:26:18.170 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-10T06:26:17.863835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4872,"num_read_kb":4458,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53336984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006310"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852214+0000","last_change":"2024-09-10T06:22:31.830584+0000","last_active":"2024-09-10T06:23:12.852214+0000","last_peered":"2024-09-10T06:23:12.852214+0000","last_clean":"2024-09-10T06:23:12.852214+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:23:12.852214+0000","last_undegraded":"2024-09-10T06:23:12.852214+0000","last_fullsized":"2024-09-10T06:23:12.852214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:16.702734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380991+0000","last_change":"2024-09-10T06:22:33.833535+0000","last_active":"2024-09-10T06:25:46.380991+0000","last_peered":"2024-09-10T06:25:46.380991+0000","last_clean":"2024-09-10T06:25:46.380991+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:25:46.380991+0000","last_undegraded":"2024-09-10T06:25:46.380991+0000","last_fullsized":"2024-09-10T06:25:46.380991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841367+0000","last_change":"2024-09-10T06:22:31.815930+0000","last_active":"2024-09-10T06:23:12.841367+0000","last_peered":"2024-09-10T06:23:12.841367+0000","last_clean":"2024-09-10T06:23:12.841367+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:23:12.841367+0000","last_undegraded":"2024-09-10T06:23:12.841367+0000","last_fullsized":"2024-09-10T06:23:12.841367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:10.113632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856201+0000","last_change":"2024-09-10T06:22:31.836564+0000","last_active":"2024-09-10T06:24:38.856201+0000","last_peered":"2024-09-10T06:24:38.856201+0000","last_clean":"2024-09-10T06:24:38.856201+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:24:38.856201+0000","last_undegraded":"2024-09-10T06:24:38.856201+0000","last_fullsized":"2024-09-10T06:24:38.856201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:18.259418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847960+0000","last_change":"2024-09-10T06:22:31.806993+0000","last_active":"2024-09-10T06:23:12.847960+0000","last_peered":"2024-09-10T06:23:12.847960+0000","last_clean":"2024-09-10T06:23:12.847960+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:23:12.847960+0000","last_undegraded":"2024-09-10T06:23:12.847960+0000","last_fullsized":"2024-09-10T06:23:12.847960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:10.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.401883+0000","last_change":"2024-09-10T06:23:12.860422+0000","last_active":"2024-09-10T06:25:46.401883+0000","last_peered":"2024-09-10T06:25:46.401883+0000","last_clean":"2024-09-10T06:25:46.401883+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:25:46.401883+0000","last_undegraded":"2024-09-10T06:25:46.401883+0000","last_fullsized":"2024-09-10T06:25:46.401883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:40.359356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838331+0000","last_change":"2024-09-10T06:22:31.826279+0000","last_active":"2024-09-10T06:23:12.838331+0000","last_peered":"2024-09-10T06:23:12.838331+0000","last_clean":"2024-09-10T06:23:12.838331+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:23:12.838331+0000","last_undegraded":"2024-09-10T06:23:12.838331+0000","last_fullsized":"2024-09-10T06:23:12.838331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:26.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.313495+0000","last_change":"2024-09-10T06:22:33.812237+0000","last_active":"2024-09-10T06:25:46.313495+0000","last_peered":"2024-09-10T06:25:46.313495+0000","last_clean":"2024-09-10T06:25:46.313495+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:25:46.313495+0000","last_undegraded":"2024-09-10T06:25:46.313495+0000","last_fullsized":"2024-09-10T06:25:46.313495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.206290+0000","last_change":"2024-09-10T06:22:31.809080+0000","last_active":"2024-09-10T06:25:46.206290+0000","last_peered":"2024-09-10T06:25:46.206290+0000","last_clean":"2024-09-10T06:25:46.206290+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:25:46.206290+0000","last_undegraded":"2024-09-10T06:25:46.206290+0000","last_fullsized":"2024-09-10T06:25:46.206290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:43.483133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843973+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:23:12.843973+0000","last_peered":"2024-09-10T06:23:12.843973+0000","last_clean":"2024-09-10T06:23:12.843973+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:23:12.843973+0000","last_undegraded":"2024-09-10T06:23:12.843973+0000","last_fullsized":"2024-09-10T06:23:12.843973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:50.427247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838841+0000","last_change":"2024-09-10T06:22:31.828678+0000","last_active":"2024-09-10T06:23:12.838841+0000","last_peered":"2024-09-10T06:23:12.838841+0000","last_clean":"2024-09-10T06:23:12.838841+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:23:12.838841+0000","last_undegraded":"2024-09-10T06:23:12.838841+0000","last_fullsized":"2024-09-10T06:23:12.838841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:33.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.426746+0000","last_change":"2024-09-10T06:22:33.841656+0000","last_active":"2024-09-10T06:24:00.426746+0000","last_peered":"2024-09-10T06:24:00.426746+0000","last_clean":"2024-09-10T06:24:00.426746+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:24:00.426746+0000","last_undegraded":"2024-09-10T06:24:00.426746+0000","last_fullsized":"2024-09-10T06:24:00.426746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.423672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.870547+0000","last_change":"2024-09-10T06:23:12.869310+0000","last_active":"2024-09-10T06:23:12.870547+0000","last_peered":"2024-09-10T06:23:12.870547+0000","last_clean":"2024-09-10T06:23:12.870547+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:23:12.870547+0000","last_undegraded":"2024-09-10T06:23:12.870547+0000","last_fullsized":"2024-09-10T06:23:12.870547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:34.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.027326+0000","last_change":"2024-09-10T06:23:12.857760+0000","last_active":"2024-09-10T06:25:46.027326+0000","last_peered":"2024-09-10T06:25:46.027326+0000","last_clean":"2024-09-10T06:25:46.027326+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:25:46.027326+0000","last_undegraded":"2024-09-10T06:25:46.027326+0000","last_fullsized":"2024-09-10T06:25:46.027326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.942980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.864475+0000","last_change":"2024-09-10T06:22:31.832009+0000","last_active":"2024-09-10T06:23:12.864475+0000","last_peered":"2024-09-10T06:23:12.864475+0000","last_clean":"2024-09-10T06:23:12.864475+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:23:12.864475+0000","last_undegraded":"2024-09-10T06:23:12.864475+0000","last_fullsized":"2024-09-10T06:23:12.864475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028692+0000","last_change":"2024-09-10T06:22:33.844939+0000","last_active":"2024-09-10T06:25:46.028692+0000","last_peered":"2024-09-10T06:25:46.028692+0000","last_clean":"2024-09-10T06:25:46.028692+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:25:46.028692+0000","last_undegraded":"2024-09-10T06:25:46.028692+0000","last_fullsized":"2024-09-10T06:25:46.028692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:54.074106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849914+0000","last_change":"2024-09-10T06:22:31.833253+0000","last_active":"2024-09-10T06:23:12.849914+0000","last_peered":"2024-09-10T06:23:12.849914+0000","last_clean":"2024-09-10T06:23:12.849914+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:23:12.849914+0000","last_undegraded":"2024-09-10T06:23:12.849914+0000","last_fullsized":"2024-09-10T06:23:12.849914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:12.255366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226464+0000","last_change":"2024-09-10T06:22:33.841628+0000","last_active":"2024-09-10T06:25:46.226464+0000","last_peered":"2024-09-10T06:25:46.226464+0000","last_clean":"2024-09-10T06:25:46.226464+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:25:46.226464+0000","last_undegraded":"2024-09-10T06:25:46.226464+0000","last_fullsized":"2024-09-10T06:25:46.226464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.857466+0000","last_change":"2024-09-10T06:22:31.828028+0000","last_active":"2024-09-10T06:23:12.857466+0000","last_peered":"2024-09-10T06:23:12.857466+0000","last_clean":"2024-09-10T06:23:12.857466+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:23:12.857466+0000","last_undegraded":"2024-09-10T06:23:12.857466+0000","last_fullsized":"2024-09-10T06:23:12.857466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.372084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026158+0000","last_change":"2024-09-10T06:22:33.822953+0000","last_active":"2024-09-10T06:25:46.026158+0000","last_peered":"2024-09-10T06:25:46.026158+0000","last_clean":"2024-09-10T06:25:46.026158+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:25:46.026158+0000","last_undegraded":"2024-09-10T06:25:46.026158+0000","last_fullsized":"2024-09-10T06:25:46.026158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.856102+0000","last_change":"2024-09-10T06:22:31.803614+0000","last_active":"2024-09-10T06:23:12.856102+0000","last_peered":"2024-09-10T06:23:12.856102+0000","last_clean":"2024-09-10T06:23:12.856102+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:23:12.856102+0000","last_undegraded":"2024-09-10T06:23:12.856102+0000","last_fullsized":"2024-09-10T06:23:12.856102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.894566+0000","last_change":"2024-09-10T06:22:33.841481+0000","last_active":"2024-09-10T06:25:45.894566+0000","last_peered":"2024-09-10T06:25:45.894566+0000","last_clean":"2024-09-10T06:25:45.894566+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:25:45.894566+0000","last_undegraded":"2024-09-10T06:25:45.894566+0000","last_fullsized":"2024-09-10T06:25:45.894566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:07.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844594+0000","last_change":"2024-09-10T06:22:31.814700+0000","last_active":"2024-09-10T06:23:12.844594+0000","last_peered":"2024-09-10T06:23:12.844594+0000","last_clean":"2024-09-10T06:23:12.844594+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:23:12.844594+0000","last_undegraded":"2024-09-10T06:23:12.844594+0000","last_fullsized":"2024-09-10T06:23:12.844594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.299397+0000","last_change":"2024-09-10T06:22:33.818692+0000","last_active":"2024-09-10T06:24:45.299397+0000","last_peered":"2024-09-10T06:24:45.299397+0000","last_clean":"2024-09-10T06:24:45.299397+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:24:45.299397+0000","last_undegraded":"2024-09-10T06:24:45.299397+0000","last_fullsized":"2024-09-10T06:24:45.299397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.049587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.562583+0000","last_change":"2024-09-10T06:22:31.830265+0000","last_active":"2024-09-10T06:23:15.562583+0000","last_peered":"2024-09-10T06:23:15.562583+0000","last_clean":"2024-09-10T06:23:15.562583+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:23:15.562583+0000","last_undegraded":"2024-09-10T06:23:15.562583+0000","last_fullsized":"2024-09-10T06:23:15.562583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:05.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314012+0000","last_change":"2024-09-10T06:22:33.812296+0000","last_active":"2024-09-10T06:25:46.314012+0000","last_peered":"2024-09-10T06:25:46.314012+0000","last_clean":"2024-09-10T06:25:46.314012+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:25:46.314012+0000","last_undegraded":"2024-09-10T06:25:46.314012+0000","last_fullsized":"2024-09-10T06:25:46.314012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:01.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836937+0000","last_change":"2024-09-10T06:22:31.831741+0000","last_active":"2024-09-10T06:23:12.836937+0000","last_peered":"2024-09-10T06:23:12.836937+0000","last_clean":"2024-09-10T06:23:12.836937+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:23:12.836937+0000","last_undegraded":"2024-09-10T06:23:12.836937+0000","last_fullsized":"2024-09-10T06:23:12.836937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:47.297207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.272681+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:24:43.272681+0000","last_peered":"2024-09-10T06:24:43.272681+0000","last_clean":"2024-09-10T06:24:43.272681+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:24:43.272681+0000","last_undegraded":"2024-09-10T06:24:43.272681+0000","last_fullsized":"2024-09-10T06:24:43.272681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380630+0000","last_change":"2024-09-10T06:22:33.816970+0000","last_active":"2024-09-10T06:25:46.380630+0000","last_peered":"2024-09-10T06:25:46.380630+0000","last_clean":"2024-09-10T06:25:46.380630+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:25:46.380630+0000","last_undegraded":"2024-09-10T06:25:46.380630+0000","last_fullsized":"2024-09-10T06:25:46.380630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:13.014250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.234103+0000","last_change":"2024-09-10T06:23:12.901608+0000","last_active":"2024-09-10T06:24:45.234103+0000","last_peered":"2024-09-10T06:24:45.234103+0000","last_clean":"2024-09-10T06:24:45.234103+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:24:45.234103+0000","last_undegraded":"2024-09-10T06:24:45.234103+0000","last_fullsized":"2024-09-10T06:24:45.234103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:00.953898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838061+0000","last_change":"2024-09-10T06:22:31.821919+0000","last_active":"2024-09-10T06:23:12.838061+0000","last_peered":"2024-09-10T06:23:12.838061+0000","last_clean":"2024-09-10T06:23:12.838061+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:23:12.838061+0000","last_undegraded":"2024-09-10T06:23:12.838061+0000","last_fullsized":"2024-09-10T06:23:12.838061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:55.502929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844115+0000","last_change":"2024-09-10T06:22:35.836699+0000","last_active":"2024-09-10T06:23:12.844115+0000","last_peered":"2024-09-10T06:23:12.844115+0000","last_clean":"2024-09-10T06:23:12.844115+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:23:12.844115+0000","last_undegraded":"2024-09-10T06:23:12.844115+0000","last_fullsized":"2024-09-10T06:23:12.844115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:10.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.570616+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:25:46.570616+0000","last_peered":"2024-09-10T06:25:46.570616+0000","last_clean":"2024-09-10T06:25:46.570616+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:25:46.570616+0000","last_undegraded":"2024-09-10T06:25:46.570616+0000","last_fullsized":"2024-09-10T06:25:46.570616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.330277+0000","last_change":"2024-09-10T06:22:33.836449+0000","last_active":"2024-09-10T06:25:46.330277+0000","last_peered":"2024-09-10T06:25:46.330277+0000","last_clean":"2024-09-10T06:25:46.330277+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:25:46.330277+0000","last_undegraded":"2024-09-10T06:25:46.330277+0000","last_fullsized":"2024-09-10T06:25:46.330277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:54.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841665+0000","last_change":"2024-09-10T06:22:31.828040+0000","last_active":"2024-09-10T06:23:12.841665+0000","last_peered":"2024-09-10T06:23:12.841665+0000","last_clean":"2024-09-10T06:23:12.841665+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:23:12.841665+0000","last_undegraded":"2024-09-10T06:23:12.841665+0000","last_fullsized":"2024-09-10T06:23:12.841665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:07.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.265779+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:24:43.265779+0000","last_peered":"2024-09-10T06:24:43.265779+0000","last_clean":"2024-09-10T06:24:43.265779+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:24:43.265779+0000","last_undegraded":"2024-09-10T06:24:43.265779+0000","last_fullsized":"2024-09-10T06:24:43.265779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.389843+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:25:46.389843+0000","last_peered":"2024-09-10T06:25:46.389843+0000","last_clean":"2024-09-10T06:25:46.389843+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:25:46.389843+0000","last_undegraded":"2024-09-10T06:25:46.389843+0000","last_fullsized":"2024-09-10T06:25:46.389843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836656+0000","last_change":"2024-09-10T06:22:33.836542+0000","last_active":"2024-09-10T06:23:12.836656+0000","last_peered":"2024-09-10T06:23:12.836656+0000","last_clean":"2024-09-10T06:23:12.836656+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:23:12.836656+0000","last_undegraded":"2024-09-10T06:23:12.836656+0000","last_fullsized":"2024-09-10T06:23:12.836656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:35.885623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852424+0000","last_change":"2024-09-10T06:22:31.804588+0000","last_active":"2024-09-10T06:23:12.852424+0000","last_peered":"2024-09-10T06:23:12.852424+0000","last_clean":"2024-09-10T06:23:12.852424+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:23:12.852424+0000","last_undegraded":"2024-09-10T06:23:12.852424+0000","last_fullsized":"2024-09-10T06:23:12.852424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846399+0000","last_change":"2024-09-10T06:22:35.836358+0000","last_active":"2024-09-10T06:23:12.846399+0000","last_peered":"2024-09-10T06:23:12.846399+0000","last_clean":"2024-09-10T06:23:12.846399+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:23:12.846399+0000","last_undegraded":"2024-09-10T06:23:12.846399+0000","last_fullsized":"2024-09-10T06:23:12.846399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:19.610121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.278467+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:24:43.278467+0000","last_peered":"2024-09-10T06:24:43.278467+0000","last_clean":"2024-09-10T06:24:43.278467+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:24:43.278467+0000","last_undegraded":"2024-09-10T06:24:43.278467+0000","last_fullsized":"2024-09-10T06:24:43.278467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:10.147486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.165283+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:00.165283+0000","last_peered":"2024-09-10T06:24:00.165283+0000","last_clean":"2024-09-10T06:24:00.165283+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:00.165283+0000","last_undegraded":"2024-09-10T06:24:00.165283+0000","last_fullsized":"2024-09-10T06:24:00.165283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:04.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227310+0000","last_change":"2024-09-10T06:22:33.817819+0000","last_active":"2024-09-10T06:25:46.227310+0000","last_peered":"2024-09-10T06:25:46.227310+0000","last_clean":"2024-09-10T06:25:46.227310+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:25:46.227310+0000","last_undegraded":"2024-09-10T06:25:46.227310+0000","last_fullsized":"2024-09-10T06:25:46.227310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.471797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850929+0000","last_change":"2024-09-10T06:22:31.807466+0000","last_active":"2024-09-10T06:23:12.850929+0000","last_peered":"2024-09-10T06:23:12.850929+0000","last_clean":"2024-09-10T06:23:12.850929+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:23:12.850929+0000","last_undegraded":"2024-09-10T06:23:12.850929+0000","last_fullsized":"2024-09-10T06:23:12.850929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:02.579986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840472+0000","last_change":"2024-09-10T06:22:35.836298+0000","last_active":"2024-09-10T06:23:12.840472+0000","last_peered":"2024-09-10T06:23:12.840472+0000","last_clean":"2024-09-10T06:23:12.840472+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:23:12.840472+0000","last_undegraded":"2024-09-10T06:23:12.840472+0000","last_fullsized":"2024-09-10T06:23:12.840472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.251245+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:24:43.251245+0000","last_peered":"2024-09-10T06:24:43.251245+0000","last_clean":"2024-09-10T06:24:43.251245+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:24:43.251245+0000","last_undegraded":"2024-09-10T06:24:43.251245+0000","last_fullsized":"2024-09-10T06:24:43.251245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:54.521264+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:23:54.521264+0000","last_peered":"2024-09-10T06:23:54.521264+0000","last_clean":"2024-09-10T06:23:54.521264+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:23:54.521264+0000","last_undegraded":"2024-09-10T06:23:54.521264+0000","last_fullsized":"2024-09-10T06:23:54.521264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:15.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.277593+0000","last_change":"2024-09-10T06:22:33.841687+0000","last_active":"2024-09-10T06:24:45.277593+0000","last_peered":"2024-09-10T06:24:45.277593+0000","last_clean":"2024-09-10T06:24:45.277593+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:24:45.277593+0000","last_undegraded":"2024-09-10T06:24:45.277593+0000","last_fullsized":"2024-09-10T06:24:45.277593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:42.392550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563926+0000","last_change":"2024-09-10T06:22:31.836503+0000","last_active":"2024-09-10T06:23:15.563926+0000","last_peered":"2024-09-10T06:23:15.563926+0000","last_clean":"2024-09-10T06:23:15.563926+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:23:15.563926+0000","last_undegraded":"2024-09-10T06:23:15.563926+0000","last_fullsized":"2024-09-10T06:23:15.563926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:55.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846203+0000","last_change":"2024-09-10T06:22:35.835893+0000","last_active":"2024-09-10T06:23:12.846203+0000","last_peered":"2024-09-10T06:23:12.846203+0000","last_clean":"2024-09-10T06:23:12.846203+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:23:12.846203+0000","last_undegraded":"2024-09-10T06:23:12.846203+0000","last_fullsized":"2024-09-10T06:23:12.846203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:12.526918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.280485+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:24:43.280485+0000","last_peered":"2024-09-10T06:24:43.280485+0000","last_clean":"2024-09-10T06:24:43.280485+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:24:43.280485+0000","last_undegraded":"2024-09-10T06:24:43.280485+0000","last_fullsized":"2024-09-10T06:24:43.280485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:52.569579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.584430+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:25:46.584430+0000","last_peered":"2024-09-10T06:25:46.584430+0000","last_clean":"2024-09-10T06:25:46.584430+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:25:46.584430+0000","last_undegraded":"2024-09-10T06:25:46.584430+0000","last_fullsized":"2024-09-10T06:25:46.584430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156054+0000","last_change":"2024-09-10T06:22:33.822287+0000","last_active":"2024-09-10T06:24:00.156054+0000","last_peered":"2024-09-10T06:24:00.156054+0000","last_clean":"2024-09-10T06:24:00.156054+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:24:00.156054+0000","last_undegraded":"2024-09-10T06:24:00.156054+0000","last_fullsized":"2024-09-10T06:24:00.156054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:30.825794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.367831+0000","last_change":"2024-09-10T06:22:31.832982+0000","last_active":"2024-09-10T06:25:46.367831+0000","last_peered":"2024-09-10T06:25:46.367831+0000","last_clean":"2024-09-10T06:25:46.367831+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:25:46.367831+0000","last_undegraded":"2024-09-10T06:25:46.367831+0000","last_fullsized":"2024-09-10T06:25:46.367831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:28.916480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841000+0000","last_change":"2024-09-10T06:22:35.836376+0000","last_active":"2024-09-10T06:23:12.841000+0000","last_peered":"2024-09-10T06:23:12.841000+0000","last_clean":"2024-09-10T06:23:12.841000+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:23:12.841000+0000","last_undegraded":"2024-09-10T06:23:12.841000+0000","last_fullsized":"2024-09-10T06:23:12.841000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:11.310423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.857914+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:24:48.857914+0000","last_peered":"2024-09-10T06:24:48.857914+0000","last_clean":"2024-09-10T06:24:48.857914+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:24:48.857914+0000","last_undegraded":"2024-09-10T06:24:48.857914+0000","last_fullsized":"2024-09-10T06:24:48.857914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:32.138442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850212+0000","last_change":"2024-09-10T06:22:33.827668+0000","last_active":"2024-09-10T06:24:47.850212+0000","last_peered":"2024-09-10T06:24:47.850212+0000","last_clean":"2024-09-10T06:24:47.850212+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:24:47.850212+0000","last_undegraded":"2024-09-10T06:24:47.850212+0000","last_fullsized":"2024-09-10T06:24:47.850212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:10.516267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843566+0000","last_change":"2024-09-10T06:22:31.827415+0000","last_active":"2024-09-10T06:23:12.843566+0000","last_peered":"2024-09-10T06:23:12.843566+0000","last_clean":"2024-09-10T06:23:12.843566+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:23:12.843566+0000","last_undegraded":"2024-09-10T06:23:12.843566+0000","last_fullsized":"2024-09-10T06:23:12.843566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.483166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848722+0000","last_change":"2024-09-10T06:22:35.830686+0000","last_active":"2024-09-10T06:23:12.848722+0000","last_peered":"2024-09-10T06:23:12.848722+0000","last_clean":"2024-09-10T06:23:12.848722+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:23:12.848722+0000","last_undegraded":"2024-09-10T06:23:12.848722+0000","last_fullsized":"2024-09-10T06:23:12.848722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.256435+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:24:43.256435+0000","last_peered":"2024-09-10T06:24:43.256435+0000","last_clean":"2024-09-10T06:24:43.256435+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:24:43.256435+0000","last_undegraded":"2024-09-10T06:24:43.256435+0000","last_fullsized":"2024-09-10T06:24:43.256435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856817+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:24:43.856817+0000","last_peered":"2024-09-10T06:24:43.856817+0000","last_clean":"2024-09-10T06:24:43.856817+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:24:43.856817+0000","last_undegraded":"2024-09-10T06:24:43.856817+0000","last_fullsized":"2024-09-10T06:24:43.856817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:00.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.485815+0000","last_change":"2024-09-10T06:22:33.836732+0000","last_active":"2024-09-10T06:25:46.485815+0000","last_peered":"2024-09-10T06:25:46.485815+0000","last_clean":"2024-09-10T06:25:46.485815+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:25:46.485815+0000","last_undegraded":"2024-09-10T06:25:46.485815+0000","last_fullsized":"2024-09-10T06:25:46.485815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:58.953149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843151+0000","last_change":"2024-09-10T06:22:31.831869+0000","last_active":"2024-09-10T06:23:12.843151+0000","last_peered":"2024-09-10T06:23:12.843151+0000","last_clean":"2024-09-10T06:23:12.843151+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:23:12.843151+0000","last_undegraded":"2024-09-10T06:23:12.843151+0000","last_fullsized":"2024-09-10T06:23:12.843151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:08.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844174+0000","last_change":"2024-09-10T06:22:35.836278+0000","last_active":"2024-09-10T06:23:12.844174+0000","last_peered":"2024-09-10T06:23:12.844174+0000","last_clean":"2024-09-10T06:23:12.844174+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:23:12.844174+0000","last_undegraded":"2024-09-10T06:23:12.844174+0000","last_fullsized":"2024-09-10T06:23:12.844174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:25.749044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:53.875302+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:24:53.875302+0000","last_peered":"2024-09-10T06:24:53.875302+0000","last_clean":"2024-09-10T06:24:53.875302+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:24:53.875302+0000","last_undegraded":"2024-09-10T06:24:53.875302+0000","last_fullsized":"2024-09-10T06:24:53.875302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.556846+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:25:46.556846+0000","last_peered":"2024-09-10T06:25:46.556846+0000","last_clean":"2024-09-10T06:25:46.556846+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:25:46.556846+0000","last_undegraded":"2024-09-10T06:25:46.556846+0000","last_fullsized":"2024-09-10T06:25:46.556846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.844984+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:24:47.844984+0000","last_peered":"2024-09-10T06:24:47.844984+0000","last_clean":"2024-09-10T06:24:47.844984+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:24:47.844984+0000","last_undegraded":"2024-09-10T06:24:47.844984+0000","last_fullsized":"2024-09-10T06:24:47.844984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:41.565616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.030221+0000","last_change":"2024-09-10T06:22:33.844698+0000","last_active":"2024-09-10T06:25:46.030221+0000","last_peered":"2024-09-10T06:25:46.030221+0000","last_clean":"2024-09-10T06:25:46.030221+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:25:46.030221+0000","last_undegraded":"2024-09-10T06:25:46.030221+0000","last_fullsized":"2024-09-10T06:25:46.030221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:46.069087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844850+0000","last_change":"2024-09-10T06:22:31.826875+0000","last_active":"2024-09-10T06:23:12.844850+0000","last_peered":"2024-09-10T06:23:12.844850+0000","last_clean":"2024-09-10T06:23:12.844850+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:23:12.844850+0000","last_undegraded":"2024-09-10T06:23:12.844850+0000","last_fullsized":"2024-09-10T06:23:12.844850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.394900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.721931+0000","last_change":"2024-09-10T06:22:35.832300+0000","last_active":"2024-09-10T06:24:44.721931+0000","last_peered":"2024-09-10T06:24:44.721931+0000","last_clean":"2024-09-10T06:24:44.721931+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:24:44.721931+0000","last_undegraded":"2024-09-10T06:24:44.721931+0000","last_fullsized":"2024-09-10T06:24:44.721931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:47.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":467,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.495421+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:25:46.495421+0000","last_peered":"2024-09-10T06:25:46.495421+0000","last_clean":"2024-09-10T06:25:46.495421+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:25:46.495421+0000","last_undegraded":"2024-09-10T06:25:46.495421+0000","last_fullsized":"2024-09-10T06:25:46.495421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.871524+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:44.871524+0000","last_peered":"2024-09-10T06:24:44.871524+0000","last_clean":"2024-09-10T06:24:44.871524+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:44.871524+0000","last_undegraded":"2024-09-10T06:24:44.871524+0000","last_fullsized":"2024-09-10T06:24:44.871524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:02.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850321+0000","last_change":"2024-09-10T06:22:33.827862+0000","last_active":"2024-09-10T06:24:47.850321+0000","last_peered":"2024-09-10T06:24:47.850321+0000","last_clean":"2024-09-10T06:24:47.850321+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:24:47.850321+0000","last_undegraded":"2024-09-10T06:24:47.850321+0000","last_fullsized":"2024-09-10T06:24:47.850321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:49.916726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835639+0000","last_change":"2024-09-10T06:22:31.830812+0000","last_active":"2024-09-10T06:23:12.835639+0000","last_peered":"2024-09-10T06:23:12.835639+0000","last_clean":"2024-09-10T06:23:12.835639+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:23:12.835639+0000","last_undegraded":"2024-09-10T06:23:12.835639+0000","last_fullsized":"2024-09-10T06:23:12.835639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:07.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.274627+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:24:43.274627+0000","last_peered":"2024-09-10T06:24:43.274627+0000","last_clean":"2024-09-10T06:24:43.274627+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:24:43.274627+0000","last_undegraded":"2024-09-10T06:24:43.274627+0000","last_fullsized":"2024-09-10T06:24:43.274627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.454158+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.454158+0000","last_peered":"2024-09-10T06:25:46.454158+0000","last_clean":"2024-09-10T06:25:46.454158+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.454158+0000","last_undegraded":"2024-09-10T06:25:46.454158+0000","last_fullsized":"2024-09-10T06:25:46.454158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:28.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.085306+0000","last_change":"2024-09-10T06:22:33.830097+0000","last_active":"2024-09-10T06:24:41.085306+0000","last_peered":"2024-09-10T06:24:41.085306+0000","last_clean":"2024-09-10T06:24:41.085306+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:24:41.085306+0000","last_undegraded":"2024-09-10T06:24:41.085306+0000","last_fullsized":"2024-09-10T06:24:41.085306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:04.520654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841380+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:23:12.841380+0000","last_peered":"2024-09-10T06:23:12.841380+0000","last_clean":"2024-09-10T06:23:12.841380+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:23:12.841380+0000","last_undegraded":"2024-09-10T06:23:12.841380+0000","last_fullsized":"2024-09-10T06:23:12.841380+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838764+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:23:12.838764+0000","last_peered":"2024-09-10T06:23:12.838764+0000","last_clean":"2024-09-10T06:23:12.838764+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:23:12.838764+0000","last_undegraded":"2024-09-10T06:23:12.838764+0000","last_fullsized":"2024-09-10T06:23:12.838764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837151+0000","last_change":"2024-09-10T06:22:31.832148+0000","last_active":"2024-09-10T06:23:12.837151+0000","last_peered":"2024-09-10T06:23:12.837151+0000","last_clean":"2024-09-10T06:23:12.837151+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:23:12.837151+0000","last_undegraded":"2024-09-10T06:23:12.837151+0000","last_fullsized":"2024-09-10T06:23:12.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:07.514358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.855163+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:23:12.855163+0000","last_peered":"2024-09-10T06:23:12.855163+0000","last_clean":"2024-09-10T06:23:12.855163+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:23:12.855163+0000","last_undegraded":"2024-09-10T06:23:12.855163+0000","last_fullsized":"2024-09-10T06:23:12.855163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.965730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.289632+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:24:43.289632+0000","last_peered":"2024-09-10T06:24:43.289632+0000","last_clean":"2024-09-10T06:24:43.289632+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:24:43.289632+0000","last_undegraded":"2024-09-10T06:24:43.289632+0000","last_fullsized":"2024-09-10T06:24:43.289632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:21.725012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315520+0000","last_change":"2024-09-10T06:22:33.814130+0000","last_active":"2024-09-10T06:25:46.315520+0000","last_peered":"2024-09-10T06:25:46.315520+0000","last_clean":"2024-09-10T06:25:46.315520+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:25:46.315520+0000","last_undegraded":"2024-09-10T06:25:46.315520+0000","last_fullsized":"2024-09-10T06:25:46.315520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:11.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835614+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:23:12.835614+0000","last_peered":"2024-09-10T06:23:12.835614+0000","last_clean":"2024-09-10T06:23:12.835614+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:23:12.835614+0000","last_undegraded":"2024-09-10T06:23:12.835614+0000","last_fullsized":"2024-09-10T06:23:12.835614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839903+0000","last_change":"2024-09-10T06:22:31.813968+0000","last_active":"2024-09-10T06:23:12.839903+0000","last_peered":"2024-09-10T06:23:12.839903+0000","last_clean":"2024-09-10T06:23:12.839903+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:23:12.839903+0000","last_undegraded":"2024-09-10T06:23:12.839903+0000","last_fullsized":"2024-09-10T06:23:12.839903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854443+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:23:12.854443+0000","last_peered":"2024-09-10T06:23:12.854443+0000","last_clean":"2024-09-10T06:23:12.854443+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:23:12.854443+0000","last_undegraded":"2024-09-10T06:23:12.854443+0000","last_fullsized":"2024-09-10T06:23:12.854443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:04.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":479,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072427+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:25:46.072427+0000","last_peered":"2024-09-10T06:25:46.072427+0000","last_clean":"2024-09-10T06:25:46.072427+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:25:46.072427+0000","last_undegraded":"2024-09-10T06:25:46.072427+0000","last_fullsized":"2024-09-10T06:25:46.072427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:21.390056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838597+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:23:12.838597+0000","last_peered":"2024-09-10T06:23:12.838597+0000","last_clean":"2024-09-10T06:23:12.838597+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:23:12.838597+0000","last_undegraded":"2024-09-10T06:23:12.838597+0000","last_fullsized":"2024-09-10T06:23:12.838597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:35.775780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.379659+0000","last_change":"2024-09-10T06:22:33.830304+0000","last_active":"2024-09-10T06:25:46.379659+0000","last_peered":"2024-09-10T06:25:46.379659+0000","last_clean":"2024-09-10T06:25:46.379659+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:25:46.379659+0000","last_undegraded":"2024-09-10T06:25:46.379659+0000","last_fullsized":"2024-09-10T06:25:46.379659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842861+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:23:12.842861+0000","last_peered":"2024-09-10T06:23:12.842861+0000","last_clean":"2024-09-10T06:23:12.842861+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:23:12.842861+0000","last_undegraded":"2024-09-10T06:23:12.842861+0000","last_fullsized":"2024-09-10T06:23:12.842861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.213105+0000","last_change":"2024-09-10T06:22:31.813555+0000","last_active":"2024-09-10T06:25:46.213105+0000","last_peered":"2024-09-10T06:25:46.213105+0000","last_clean":"2024-09-10T06:25:46.213105+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:25:46.213105+0000","last_undegraded":"2024-09-10T06:25:46.213105+0000","last_fullsized":"2024-09-10T06:25:46.213105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851204+0000","last_change":"2024-09-10T06:22:35.819965+0000","last_active":"2024-09-10T06:23:12.851204+0000","last_peered":"2024-09-10T06:23:12.851204+0000","last_clean":"2024-09-10T06:23:12.851204+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:23:12.851204+0000","last_undegraded":"2024-09-10T06:23:12.851204+0000","last_fullsized":"2024-09-10T06:23:12.851204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:59.563244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.073073+0000","last_change":"2024-09-10T06:22:37.837514+0000","last_active":"2024-09-10T06:25:46.073073+0000","last_peered":"2024-09-10T06:25:46.073073+0000","last_clean":"2024-09-10T06:25:46.073073+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:25:46.073073+0000","last_undegraded":"2024-09-10T06:25:46.073073+0000","last_fullsized":"2024-09-10T06:25:46.073073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:10.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841192+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:23:12.841192+0000","last_peered":"2024-09-10T06:23:12.841192+0000","last_clean":"2024-09-10T06:23:12.841192+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:23:12.841192+0000","last_undegraded":"2024-09-10T06:23:12.841192+0000","last_fullsized":"2024-09-10T06:23:12.841192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:59.799041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380078+0000","last_change":"2024-09-10T06:22:33.843908+0000","last_active":"2024-09-10T06:25:46.380078+0000","last_peered":"2024-09-10T06:25:46.380078+0000","last_clean":"2024-09-10T06:25:46.380078+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:25:46.380078+0000","last_undegraded":"2024-09-10T06:25:46.380078+0000","last_fullsized":"2024-09-10T06:25:46.380078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836895+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:23:12.836895+0000","last_peered":"2024-09-10T06:23:12.836895+0000","last_clean":"2024-09-10T06:23:12.836895+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:23:12.836895+0000","last_undegraded":"2024-09-10T06:23:12.836895+0000","last_fullsized":"2024-09-10T06:23:12.836895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.840931+0000","last_change":"2024-09-10T06:22:31.810277+0000","last_active":"2024-09-10T06:25:45.840931+0000","last_peered":"2024-09-10T06:25:45.840931+0000","last_clean":"2024-09-10T06:25:45.840931+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:25:45.840931+0000","last_undegraded":"2024-09-10T06:25:45.840931+0000","last_fullsized":"2024-09-10T06:25:45.840931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:49.861302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844120+0000","last_change":"2024-09-10T06:22:35.817207+0000","last_active":"2024-09-10T06:23:12.844120+0000","last_peered":"2024-09-10T06:23:12.844120+0000","last_clean":"2024-09-10T06:23:12.844120+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:23:12.844120+0000","last_undegraded":"2024-09-10T06:23:12.844120+0000","last_fullsized":"2024-09-10T06:23:12.844120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:40.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.319710+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.319710+0000","last_peered":"2024-09-10T06:25:45.319710+0000","last_clean":"2024-09-10T06:25:45.319710+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.319710+0000","last_undegraded":"2024-09-10T06:25:45.319710+0000","last_fullsized":"2024-09-10T06:25:45.319710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:52.179158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029340+0000","last_change":"2024-09-10T06:22:33.829247+0000","last_active":"2024-09-10T06:25:46.029340+0000","last_peered":"2024-09-10T06:25:46.029340+0000","last_clean":"2024-09-10T06:25:46.029340+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:25:46.029340+0000","last_undegraded":"2024-09-10T06:25:46.029340+0000","last_fullsized":"2024-09-10T06:25:46.029340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852772+0000","last_change":"2024-09-10T06:22:31.810031+0000","last_active":"2024-09-10T06:23:12.852772+0000","last_peered":"2024-09-10T06:23:12.852772+0000","last_clean":"2024-09-10T06:23:12.852772+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:23:12.852772+0000","last_undegraded":"2024-09-10T06:23:12.852772+0000","last_fullsized":"2024-09-10T06:23:12.852772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:36.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840933+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:23:12.840933+0000","last_peered":"2024-09-10T06:23:12.840933+0000","last_clean":"2024-09-10T06:23:12.840933+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:23:12.840933+0000","last_undegraded":"2024-09-10T06:23:12.840933+0000","last_fullsized":"2024-09-10T06:23:12.840933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.843802+0000","last_change":"2024-09-10T06:22:35.823185+0000","last_active":"2024-09-10T06:24:42.843802+0000","last_peered":"2024-09-10T06:24:42.843802+0000","last_clean":"2024-09-10T06:24:42.843802+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:24:42.843802+0000","last_undegraded":"2024-09-10T06:24:42.843802+0000","last_fullsized":"2024-09-10T06:24:42.843802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:31.666424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.291459+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:24:43.291459+0000","last_peered":"2024-09-10T06:24:43.291459+0000","last_clean":"2024-09-10T06:24:43.291459+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:24:43.291459+0000","last_undegraded":"2024-09-10T06:24:43.291459+0000","last_fullsized":"2024-09-10T06:24:43.291459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.778947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843741+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:23:12.843741+0000","last_peered":"2024-09-10T06:23:12.843741+0000","last_clean":"2024-09-10T06:23:12.843741+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:23:12.843741+0000","last_undegraded":"2024-09-10T06:23:12.843741+0000","last_fullsized":"2024-09-10T06:23:12.843741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:07.724283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029418+0000","last_change":"2024-09-10T06:22:33.828093+0000","last_active":"2024-09-10T06:25:46.029418+0000","last_peered":"2024-09-10T06:25:46.029418+0000","last_clean":"2024-09-10T06:25:46.029418+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:25:46.029418+0000","last_undegraded":"2024-09-10T06:25:46.029418+0000","last_fullsized":"2024-09-10T06:25:46.029418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841646+0000","last_change":"2024-09-10T06:22:31.811783+0000","last_active":"2024-09-10T06:23:12.841646+0000","last_peered":"2024-09-10T06:23:12.841646+0000","last_clean":"2024-09-10T06:23:12.841646+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:23:12.841646+0000","last_undegraded":"2024-09-10T06:23:12.841646+0000","last_fullsized":"2024-09-10T06:23:12.841646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:00.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.697023+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:24:44.697023+0000","last_peered":"2024-09-10T06:24:44.697023+0000","last_clean":"2024-09-10T06:24:44.697023+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:24:44.697023+0000","last_undegraded":"2024-09-10T06:24:44.697023+0000","last_fullsized":"2024-09-10T06:24:44.697023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:58.162966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.404578+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:23:16.404578+0000","last_peered":"2024-09-10T06:23:16.404578+0000","last_clean":"2024-09-10T06:23:16.404578+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:23:16.404578+0000","last_undegraded":"2024-09-10T06:23:16.404578+0000","last_fullsized":"2024-09-10T06:23:16.404578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.073693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":357,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072302+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:25:46.072302+0000","last_peered":"2024-09-10T06:25:46.072302+0000","last_clean":"2024-09-10T06:25:46.072302+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:25:46.072302+0000","last_undegraded":"2024-09-10T06:25:46.072302+0000","last_fullsized":"2024-09-10T06:25:46.072302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:43.131319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226435+0000","last_change":"2024-09-10T06:22:33.835195+0000","last_active":"2024-09-10T06:25:46.226435+0000","last_peered":"2024-09-10T06:25:46.226435+0000","last_clean":"2024-09-10T06:25:46.226435+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:25:46.226435+0000","last_undegraded":"2024-09-10T06:25:46.226435+0000","last_fullsized":"2024-09-10T06:25:46.226435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:25.772911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.857059+0000","last_change":"2024-09-10T06:22:31.819349+0000","last_active":"2024-09-10T06:24:43.857059+0000","last_peered":"2024-09-10T06:24:43.857059+0000","last_clean":"2024-09-10T06:24:43.857059+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:24:43.857059+0000","last_undegraded":"2024-09-10T06:24:43.857059+0000","last_fullsized":"2024-09-10T06:24:43.857059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:40.037975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843900+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:23:12.843900+0000","last_peered":"2024-09-10T06:23:12.843900+0000","last_clean":"2024-09-10T06:23:12.843900+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:23:12.843900+0000","last_undegraded":"2024-09-10T06:23:12.843900+0000","last_fullsized":"2024-09-10T06:23:12.843900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844884+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:23:12.844884+0000","last_peered":"2024-09-10T06:23:12.844884+0000","last_clean":"2024-09-10T06:23:12.844884+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:23:12.844884+0000","last_undegraded":"2024-09-10T06:23:12.844884+0000","last_fullsized":"2024-09-10T06:23:12.844884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.465248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856935+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:24:43.856935+0000","last_peered":"2024-09-10T06:24:43.856935+0000","last_clean":"2024-09-10T06:24:43.856935+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:24:43.856935+0000","last_undegraded":"2024-09-10T06:24:43.856935+0000","last_fullsized":"2024-09-10T06:24:43.856935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:00.801970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.546362+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:25:46.546362+0000","last_peered":"2024-09-10T06:25:46.546362+0000","last_clean":"2024-09-10T06:25:46.546362+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:25:46.546362+0000","last_undegraded":"2024-09-10T06:25:46.546362+0000","last_fullsized":"2024-09-10T06:25:46.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:05.123690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314608+0000","last_change":"2024-09-10T06:22:33.836044+0000","last_active":"2024-09-10T06:25:46.314608+0000","last_peered":"2024-09-10T06:25:46.314608+0000","last_clean":"2024-09-10T06:25:46.314608+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:25:46.314608+0000","last_undegraded":"2024-09-10T06:25:46.314608+0000","last_fullsized":"2024-09-10T06:25:46.314608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:49.616370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863191+0000","last_change":"2024-09-10T06:22:31.817407+0000","last_active":"2024-09-10T06:23:12.863191+0000","last_peered":"2024-09-10T06:23:12.863191+0000","last_clean":"2024-09-10T06:23:12.863191+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:23:12.863191+0000","last_undegraded":"2024-09-10T06:23:12.863191+0000","last_fullsized":"2024-09-10T06:23:12.863191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:59.858776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852491+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:23:12.852491+0000","last_peered":"2024-09-10T06:23:12.852491+0000","last_clean":"2024-09-10T06:23:12.852491+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:23:12.852491+0000","last_undegraded":"2024-09-10T06:23:12.852491+0000","last_fullsized":"2024-09-10T06:23:12.852491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845740+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:23:12.845740+0000","last_peered":"2024-09-10T06:23:12.845740+0000","last_clean":"2024-09-10T06:23:12.845740+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:23:12.845740+0000","last_undegraded":"2024-09-10T06:23:12.845740+0000","last_fullsized":"2024-09-10T06:23:12.845740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:28.571689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'82","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.271773+0000","last_change":"2024-09-10T06:22:37.855099+0000","last_active":"2024-09-10T06:24:43.271773+0000","last_peered":"2024-09-10T06:24:43.271773+0000","last_clean":"2024-09-10T06:24:43.271773+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:24:43.271773+0000","last_undegraded":"2024-09-10T06:24:43.271773+0000","last_fullsized":"2024-09-10T06:24:43.271773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:05.079013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839680+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:23:12.839680+0000","last_peered":"2024-09-10T06:23:12.839680+0000","last_clean":"2024-09-10T06:23:12.839680+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:23:12.839680+0000","last_undegraded":"2024-09-10T06:23:12.839680+0000","last_fullsized":"2024-09-10T06:23:12.839680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:00.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851696+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:23:12.851696+0000","last_peered":"2024-09-10T06:23:12.851696+0000","last_clean":"2024-09-10T06:23:12.851696+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:23:12.851696+0000","last_undegraded":"2024-09-10T06:23:12.851696+0000","last_fullsized":"2024-09-10T06:23:12.851696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:18.366509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848875+0000","last_change":"2024-09-10T06:22:33.835614+0000","last_active":"2024-09-10T06:23:16.848875+0000","last_peered":"2024-09-10T06:23:16.848875+0000","last_clean":"2024-09-10T06:23:16.848875+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:23:16.848875+0000","last_undegraded":"2024-09-10T06:23:16.848875+0000","last_fullsized":"2024-09-10T06:23:16.848875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:36.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838231+0000","last_change":"2024-09-10T06:22:31.830987+0000","last_active":"2024-09-10T06:23:12.838231+0000","last_peered":"2024-09-10T06:23:12.838231+0000","last_clean":"2024-09-10T06:23:12.838231+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:23:12.838231+0000","last_undegraded":"2024-09-10T06:23:12.838231+0000","last_fullsized":"2024-09-10T06:23:12.838231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:06.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842492+0000","last_change":"2024-09-10T06:22:35.832868+0000","last_active":"2024-09-10T06:23:12.842492+0000","last_peered":"2024-09-10T06:23:12.842492+0000","last_clean":"2024-09-10T06:23:12.842492+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:23:12.842492+0000","last_undegraded":"2024-09-10T06:23:12.842492+0000","last_fullsized":"2024-09-10T06:23:12.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:22:51.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.279468+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:24:43.279468+0000","last_peered":"2024-09-10T06:24:43.279468+0000","last_clean":"2024-09-10T06:24:43.279468+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:24:43.279468+0000","last_undegraded":"2024-09-10T06:24:43.279468+0000","last_fullsized":"2024-09-10T06:24:43.279468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.872559+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.872559+0000","last_peered":"2024-09-10T06:24:42.872559+0000","last_clean":"2024-09-10T06:24:42.872559+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.872559+0000","last_undegraded":"2024-09-10T06:24:42.872559+0000","last_fullsized":"2024-09-10T06:24:42.872559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:14.600789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851337+0000","last_change":"2024-09-10T06:22:33.828670+0000","last_active":"2024-09-10T06:24:52.851337+0000","last_peered":"2024-09-10T06:24:52.851337+0000","last_clean":"2024-09-10T06:24:52.851337+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:24:52.851337+0000","last_undegraded":"2024-09-10T06:24:52.851337+0000","last_fullsized":"2024-09-10T06:24:52.851337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:58.876540+0000","last_change":"2024-09-10T06:22:31.834212+0000","last_active":"2024-09-10T06:24:58.876540+0000","last_peered":"2024-09-10T06:24:58.876540+0000","last_clean":"2024-09-10T06:24:58.876540+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:24:58.876540+0000","last_undegraded":"2024-09-10T06:24:58.876540+0000","last_fullsized":"2024-09-10T06:24:58.876540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:50.883361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427517+0000","last_change":"2024-09-10T06:22:33.817684+0000","last_active":"2024-09-10T06:24:00.427517+0000","last_peered":"2024-09-10T06:24:00.427517+0000","last_clean":"2024-09-10T06:24:00.427517+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:24:00.427517+0000","last_undegraded":"2024-09-10T06:24:00.427517+0000","last_fullsized":"2024-09-10T06:24:00.427517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.801071+0000","last_change":"2024-09-10T06:22:31.823765+0000","last_active":"2024-09-10T06:25:45.801071+0000","last_peered":"2024-09-10T06:25:45.801071+0000","last_clean":"2024-09-10T06:25:45.801071+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:25:45.801071+0000","last_undegraded":"2024-09-10T06:25:45.801071+0000","last_fullsized":"2024-09-10T06:25:45.801071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:55.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839169+0000","last_change":"2024-09-10T06:22:35.831394+0000","last_active":"2024-09-10T06:23:12.839169+0000","last_peered":"2024-09-10T06:23:12.839169+0000","last_clean":"2024-09-10T06:23:12.839169+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:23:12.839169+0000","last_undegraded":"2024-09-10T06:23:12.839169+0000","last_fullsized":"2024-09-10T06:23:12.839169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:22.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.412051+0000","last_change":"2024-09-10T06:22:37.836553+0000","last_active":"2024-09-10T06:25:45.412051+0000","last_peered":"2024-09-10T06:25:45.412051+0000","last_clean":"2024-09-10T06:25:45.412051+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:25:45.412051+0000","last_undegraded":"2024-09-10T06:25:45.412051+0000","last_fullsized":"2024-09-10T06:25:45.412051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:24.462240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226226+0000","last_change":"2024-09-10T06:22:33.837182+0000","last_active":"2024-09-10T06:25:46.226226+0000","last_peered":"2024-09-10T06:25:46.226226+0000","last_clean":"2024-09-10T06:25:46.226226+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:25:46.226226+0000","last_undegraded":"2024-09-10T06:25:46.226226+0000","last_fullsized":"2024-09-10T06:25:46.226226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:14.784269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.144585+0000","last_change":"2024-09-10T06:22:31.824675+0000","last_active":"2024-09-10T06:24:00.144585+0000","last_peered":"2024-09-10T06:24:00.144585+0000","last_clean":"2024-09-10T06:24:00.144585+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:24:00.144585+0000","last_undegraded":"2024-09-10T06:24:00.144585+0000","last_fullsized":"2024-09-10T06:24:00.144585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:27.214452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.260507+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:24:43.260507+0000","last_peered":"2024-09-10T06:24:43.260507+0000","last_clean":"2024-09-10T06:24:43.260507+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:24:43.260507+0000","last_undegraded":"2024-09-10T06:24:43.260507+0000","last_fullsized":"2024-09-10T06:24:43.260507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156644+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:00.156644+0000","last_peered":"2024-09-10T06:24:00.156644+0000","last_clean":"2024-09-10T06:24:00.156644+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:00.156644+0000","last_undegraded":"2024-09-10T06:24:00.156644+0000","last_fullsized":"2024-09-10T06:24:00.156644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:18.678529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835895+0000","last_change":"2024-09-10T06:22:31.835963+0000","last_active":"2024-09-10T06:23:12.835895+0000","last_peered":"2024-09-10T06:23:12.835895+0000","last_clean":"2024-09-10T06:23:12.835895+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:23:12.835895+0000","last_undegraded":"2024-09-10T06:23:12.835895+0000","last_fullsized":"2024-09-10T06:23:12.835895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:44.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:21.069402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.287272+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:24:43.287272+0000","last_peered":"2024-09-10T06:24:43.287272+0000","last_clean":"2024-09-10T06:24:43.287272+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:24:43.287272+0000","last_undegraded":"2024-09-10T06:24:43.287272+0000","last_fullsized":"2024-09-10T06:24:43.287272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.193472+0000","last_change":"2024-09-10T06:22:33.820528+0000","last_active":"2024-09-10T06:23:17.193472+0000","last_peered":"2024-09-10T06:23:17.193472+0000","last_clean":"2024-09-10T06:23:17.193472+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:23:17.193472+0000","last_undegraded":"2024-09-10T06:23:17.193472+0000","last_fullsized":"2024-09-10T06:23:17.193472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.199119+0000","last_change":"2024-09-10T06:22:31.824951+0000","last_active":"2024-09-10T06:25:46.199119+0000","last_peered":"2024-09-10T06:25:46.199119+0000","last_clean":"2024-09-10T06:25:46.199119+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:25:46.199119+0000","last_undegraded":"2024-09-10T06:25:46.199119+0000","last_fullsized":"2024-09-10T06:25:46.199119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:35.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.695966+0000","last_change":"2024-09-10T06:22:35.819614+0000","last_active":"2024-09-10T06:24:44.695966+0000","last_peered":"2024-09-10T06:24:44.695966+0000","last_clean":"2024-09-10T06:24:44.695966+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:24:44.695966+0000","last_undegraded":"2024-09-10T06:24:44.695966+0000","last_fullsized":"2024-09-10T06:24:44.695966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.909257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.261561+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:24:43.261561+0000","last_peered":"2024-09-10T06:24:43.261561+0000","last_clean":"2024-09-10T06:24:43.261561+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:24:43.261561+0000","last_undegraded":"2024-09-10T06:24:43.261561+0000","last_fullsized":"2024-09-10T06:24:43.261561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841976+0000","last_change":"2024-09-10T06:22:31.798967+0000","last_active":"2024-09-10T06:23:12.841976+0000","last_peered":"2024-09-10T06:23:12.841976+0000","last_clean":"2024-09-10T06:23:12.841976+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:23:12.841976+0000","last_undegraded":"2024-09-10T06:23:12.841976+0000","last_fullsized":"2024-09-10T06:23:12.841976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:44.941111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849600+0000","last_change":"2024-09-10T06:22:35.823165+0000","last_active":"2024-09-10T06:23:12.849600+0000","last_peered":"2024-09-10T06:23:12.849600+0000","last_clean":"2024-09-10T06:23:12.849600+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:23:12.849600+0000","last_undegraded":"2024-09-10T06:23:12.849600+0000","last_fullsized":"2024-09-10T06:23:12.849600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:33.329366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.855428+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:24:42.855428+0000","last_peered":"2024-09-10T06:24:42.855428+0000","last_clean":"2024-09-10T06:24:42.855428+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:24:42.855428+0000","last_undegraded":"2024-09-10T06:24:42.855428+0000","last_fullsized":"2024-09-10T06:24:42.855428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:01.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840875+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:23:12.840875+0000","last_peered":"2024-09-10T06:23:12.840875+0000","last_clean":"2024-09-10T06:23:12.840875+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:23:12.840875+0000","last_undegraded":"2024-09-10T06:23:12.840875+0000","last_fullsized":"2024-09-10T06:23:12.840875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:38.216965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.103075+0000","last_change":"2024-09-10T06:22:33.843181+0000","last_active":"2024-09-10T06:24:41.103075+0000","last_peered":"2024-09-10T06:24:41.103075+0000","last_clean":"2024-09-10T06:24:41.103075+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:24:41.103075+0000","last_undegraded":"2024-09-10T06:24:41.103075+0000","last_fullsized":"2024-09-10T06:24:41.103075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.994437+0000","last_change":"2024-09-10T06:22:31.819223+0000","last_active":"2024-09-10T06:24:44.994437+0000","last_peered":"2024-09-10T06:24:44.994437+0000","last_clean":"2024-09-10T06:24:44.994437+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:24:44.994437+0000","last_undegraded":"2024-09-10T06:24:44.994437+0000","last_fullsized":"2024-09-10T06:24:44.994437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:27.515537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843413+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:23:12.843413+0000","last_peered":"2024-09-10T06:23:12.843413+0000","last_clean":"2024-09-10T06:23:12.843413+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:23:12.843413+0000","last_undegraded":"2024-09-10T06:23:12.843413+0000","last_fullsized":"2024-09-10T06:23:12.843413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:11.280056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.395265+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:25:46.395265+0000","last_peered":"2024-09-10T06:25:46.395265+0000","last_clean":"2024-09-10T06:25:46.395265+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:25:46.395265+0000","last_undegraded":"2024-09-10T06:25:46.395265+0000","last_fullsized":"2024-09-10T06:25:46.395265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:40.193573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.877644+0000","last_change":"2024-09-10T06:22:33.840970+0000","last_active":"2024-09-10T06:25:03.877644+0000","last_peered":"2024-09-10T06:25:03.877644+0000","last_clean":"2024-09-10T06:25:03.877644+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:25:03.877644+0000","last_undegraded":"2024-09-10T06:25:03.877644+0000","last_fullsized":"2024-09-10T06:25:03.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:08.529180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:02.853853+0000","last_change":"2024-09-10T06:22:31.827656+0000","last_active":"2024-09-10T06:25:02.853853+0000","last_peered":"2024-09-10T06:25:02.853853+0000","last_clean":"2024-09-10T06:25:02.853853+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:25:02.853853+0000","last_undegraded":"2024-09-10T06:25:02.853853+0000","last_fullsized":"2024-09-10T06:25:02.853853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.248336+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:24:43.248336+0000","last_peered":"2024-09-10T06:24:43.248336+0000","last_clean":"2024-09-10T06:24:43.248336+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:24:43.248336+0000","last_undegraded":"2024-09-10T06:24:43.248336+0000","last_fullsized":"2024-09-10T06:24:43.248336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380753+0000","last_change":"2024-09-10T06:22:33.836076+0000","last_active":"2024-09-10T06:25:46.380753+0000","last_peered":"2024-09-10T06:25:46.380753+0000","last_clean":"2024-09-10T06:25:46.380753+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:25:46.380753+0000","last_undegraded":"2024-09-10T06:25:46.380753+0000","last_fullsized":"2024-09-10T06:25:46.380753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:36.039957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.862928+0000","last_change":"2024-09-10T06:22:31.836769+0000","last_active":"2024-09-10T06:25:03.862928+0000","last_peered":"2024-09-10T06:25:03.862928+0000","last_clean":"2024-09-10T06:25:03.862928+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:25:03.862928+0000","last_undegraded":"2024-09-10T06:25:03.862928+0000","last_fullsized":"2024-09-10T06:25:03.862928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:26.478355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850533+0000","last_change":"2024-09-10T06:22:35.826620+0000","last_active":"2024-09-10T06:23:12.850533+0000","last_peered":"2024-09-10T06:23:12.850533+0000","last_clean":"2024-09-10T06:23:12.850533+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:23:12.850533+0000","last_undegraded":"2024-09-10T06:23:12.850533+0000","last_fullsized":"2024-09-10T06:23:12.850533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:41.740450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.249824+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:24:43.249824+0000","last_peered":"2024-09-10T06:24:43.249824+0000","last_clean":"2024-09-10T06:24:43.249824+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:24:43.249824+0000","last_undegraded":"2024-09-10T06:24:43.249824+0000","last_fullsized":"2024-09-10T06:24:43.249824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.153703+0000","last_change":"2024-09-10T06:22:31.812723+0000","last_active":"2024-09-10T06:23:17.153703+0000","last_peered":"2024-09-10T06:23:17.153703+0000","last_clean":"2024-09-10T06:23:17.153703+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:23:17.153703+0000","last_undegraded":"2024-09-10T06:23:17.153703+0000","last_fullsized":"2024-09-10T06:23:17.153703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:06.179051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:08.864204+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:25:08.864204+0000","last_peered":"2024-09-10T06:25:08.864204+0000","last_clean":"2024-09-10T06:25:08.864204+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:25:08.864204+0000","last_undegraded":"2024-09-10T06:25:08.864204+0000","last_fullsized":"2024-09-10T06:25:08.864204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226520+0000","last_change":"2024-09-10T06:22:33.841332+0000","last_active":"2024-09-10T06:25:46.226520+0000","last_peered":"2024-09-10T06:25:46.226520+0000","last_clean":"2024-09-10T06:25:46.226520+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:25:46.226520+0000","last_undegraded":"2024-09-10T06:25:46.226520+0000","last_fullsized":"2024-09-10T06:25:46.226520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:29.424851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.183187+0000","last_change":"2024-09-10T06:22:31.803970+0000","last_active":"2024-09-10T06:25:46.183187+0000","last_peered":"2024-09-10T06:25:46.183187+0000","last_clean":"2024-09-10T06:25:46.183187+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:25:46.183187+0000","last_undegraded":"2024-09-10T06:25:46.183187+0000","last_fullsized":"2024-09-10T06:25:46.183187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.330768+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:25:45.330768+0000","last_peered":"2024-09-10T06:25:45.330768+0000","last_clean":"2024-09-10T06:25:45.330768+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:25:45.330768+0000","last_undegraded":"2024-09-10T06:25:45.330768+0000","last_fullsized":"2024-09-10T06:25:45.330768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.867864+0000","last_change":"2024-09-10T06:22:33.832724+0000","last_active":"2024-09-10T06:23:12.867864+0000","last_peered":"2024-09-10T06:23:12.867864+0000","last_clean":"2024-09-10T06:23:12.867864+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:23:12.867864+0000","last_undegraded":"2024-09-10T06:23:12.867864+0000","last_fullsized":"2024-09-10T06:23:12.867864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:20.127030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.872156+0000","last_change":"2024-09-10T06:22:31.809134+0000","last_active":"2024-09-10T06:24:38.872156+0000","last_peered":"2024-09-10T06:24:38.872156+0000","last_clean":"2024-09-10T06:24:38.872156+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:24:38.872156+0000","last_undegraded":"2024-09-10T06:24:38.872156+0000","last_fullsized":"2024-09-10T06:24:38.872156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:03.278295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.225482+0000","last_change":"2024-09-10T06:22:33.842763+0000","last_active":"2024-09-10T06:25:46.225482+0000","last_peered":"2024-09-10T06:25:46.225482+0000","last_clean":"2024-09-10T06:25:46.225482+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:25:46.225482+0000","last_undegraded":"2024-09-10T06:25:46.225482+0000","last_fullsized":"2024-09-10T06:25:46.225482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838799+0000","last_change":"2024-09-10T06:22:31.809874+0000","last_active":"2024-09-10T06:23:12.838799+0000","last_peered":"2024-09-10T06:23:12.838799+0000","last_clean":"2024-09-10T06:23:12.838799+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:23:12.838799+0000","last_undegraded":"2024-09-10T06:23:12.838799+0000","last_fullsized":"2024-09-10T06:23:12.838799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380807+0000","last_change":"2024-09-10T06:23:12.866962+0000","last_active":"2024-09-10T06:25:46.380807+0000","last_peered":"2024-09-10T06:25:46.380807+0000","last_clean":"2024-09-10T06:25:46.380807+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:25:46.380807+0000","last_undegraded":"2024-09-10T06:25:46.380807+0000","last_fullsized":"2024-09-10T06:25:46.380807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.062389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842517+0000","last_change":"2024-09-10T06:22:31.831565+0000","last_active":"2024-09-10T06:23:12.842517+0000","last_peered":"2024-09-10T06:23:12.842517+0000","last_clean":"2024-09-10T06:23:12.842517+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:23:12.842517+0000","last_undegraded":"2024-09-10T06:23:12.842517+0000","last_fullsized":"2024-09-10T06:23:12.842517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.130643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427522+0000","last_change":"2024-09-10T06:22:33.843784+0000","last_active":"2024-09-10T06:24:00.427522+0000","last_peered":"2024-09-10T06:24:00.427522+0000","last_clean":"2024-09-10T06:24:00.427522+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:24:00.427522+0000","last_undegraded":"2024-09-10T06:24:00.427522+0000","last_fullsized":"2024-09-10T06:24:00.427522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:08.793382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.413251+0000","last_change":"2024-09-10T06:22:31.813752+0000","last_active":"2024-09-10T06:24:00.413251+0000","last_peered":"2024-09-10T06:24:00.413251+0000","last_clean":"2024-09-10T06:24:00.413251+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:24:00.413251+0000","last_undegraded":"2024-09-10T06:24:00.413251+0000","last_fullsized":"2024-09-10T06:24:00.413251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:46.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380014+0000","last_change":"2024-09-10T06:22:33.818286+0000","last_active":"2024-09-10T06:25:46.380014+0000","last_peered":"2024-09-10T06:25:46.380014+0000","last_clean":"2024-09-10T06:25:46.380014+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:25:46.380014+0000","last_undegraded":"2024-09-10T06:25:46.380014+0000","last_fullsized":"2024-09-10T06:25:46.380014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841898+0000","last_change":"2024-09-10T06:22:31.809970+0000","last_active":"2024-09-10T06:23:12.841898+0000","last_peered":"2024-09-10T06:23:12.841898+0000","last_clean":"2024-09-10T06:23:12.841898+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:23:12.841898+0000","last_undegraded":"2024-09-10T06:23:12.841898+0000","last_fullsized":"2024-09-10T06:23:12.841898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:42.775634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.316095+0000","last_change":"2024-09-10T06:22:33.832194+0000","last_active":"2024-09-10T06:25:46.316095+0000","last_peered":"2024-09-10T06:25:46.316095+0000","last_clean":"2024-09-10T06:25:46.316095+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:25:46.316095+0000","last_undegraded":"2024-09-10T06:25:46.316095+0000","last_fullsized":"2024-09-10T06:25:46.316095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858710+0000","last_change":"2024-09-10T06:22:31.833838+0000","last_active":"2024-09-10T06:23:12.858710+0000","last_peered":"2024-09-10T06:23:12.858710+0000","last_clean":"2024-09-10T06:23:12.858710+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:23:12.858710+0000","last_undegraded":"2024-09-10T06:23:12.858710+0000","last_fullsized":"2024-09-10T06:23:12.858710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314627+0000","last_change":"2024-09-10T06:22:33.820714+0000","last_active":"2024-09-10T06:25:46.314627+0000","last_peered":"2024-09-10T06:25:46.314627+0000","last_clean":"2024-09-10T06:25:46.314627+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:25:46.314627+0000","last_undegraded":"2024-09-10T06:25:46.314627+0000","last_fullsized":"2024-09-10T06:25:46.314627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:18.899048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848587+0000","last_change":"2024-09-10T06:22:31.833522+0000","last_active":"2024-09-10T06:23:12.848587+0000","last_peered":"2024-09-10T06:23:12.848587+0000","last_clean":"2024-09-10T06:23:12.848587+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:23:12.848587+0000","last_undegraded":"2024-09-10T06:23:12.848587+0000","last_fullsized":"2024-09-10T06:23:12.848587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:11.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028535+0000","last_change":"2024-09-10T06:22:33.822155+0000","last_active":"2024-09-10T06:25:46.028535+0000","last_peered":"2024-09-10T06:25:46.028535+0000","last_clean":"2024-09-10T06:25:46.028535+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:25:46.028535+0000","last_undegraded":"2024-09-10T06:25:46.028535+0000","last_fullsized":"2024-09-10T06:25:46.028535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842016+0000","last_change":"2024-09-10T06:22:31.809583+0000","last_active":"2024-09-10T06:23:12.842016+0000","last_peered":"2024-09-10T06:23:12.842016+0000","last_clean":"2024-09-10T06:23:12.842016+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:23:12.842016+0000","last_undegraded":"2024-09-10T06:23:12.842016+0000","last_fullsized":"2024-09-10T06:23:12.842016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:53.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'15","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851583+0000","last_change":"2024-09-10T06:22:33.844903+0000","last_active":"2024-09-10T06:24:52.851583+0000","last_peered":"2024-09-10T06:24:52.851583+0000","last_clean":"2024-09-10T06:24:52.851583+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:24:52.851583+0000","last_undegraded":"2024-09-10T06:24:52.851583+0000","last_fullsized":"2024-09-10T06:24:52.851583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:16.098280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.564147+0000","last_change":"2024-09-10T06:22:31.828487+0000","last_active":"2024-09-10T06:23:15.564147+0000","last_peered":"2024-09-10T06:23:15.564147+0000","last_clean":"2024-09-10T06:23:15.564147+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:23:15.564147+0000","last_undegraded":"2024-09-10T06:23:15.564147+0000","last_fullsized":"2024-09-10T06:23:15.564147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:47.707056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563325+0000","last_change":"2024-09-10T06:22:31.813099+0000","last_active":"2024-09-10T06:23:15.563325+0000","last_peered":"2024-09-10T06:23:15.563325+0000","last_clean":"2024-09-10T06:23:15.563325+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:23:15.563325+0000","last_undegraded":"2024-09-10T06:23:15.563325+0000","last_fullsized":"2024-09-10T06:23:15.563325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.402083+0000","last_change":"2024-09-10T06:22:33.818285+0000","last_active":"2024-09-10T06:23:16.402083+0000","last_peered":"2024-09-10T06:23:16.402083+0000","last_clean":"2024-09-10T06:23:16.402083+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:23:16.402083+0000","last_undegraded":"2024-09-10T06:23:16.402083+0000","last_fullsized":"2024-09-10T06:23:16.402083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.081113+0000","last_change":"2024-09-10T06:22:31.812762+0000","last_active":"2024-09-10T06:24:41.081113+0000","last_peered":"2024-09-10T06:24:41.081113+0000","last_clean":"2024-09-10T06:24:41.081113+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:24:41.081113+0000","last_undegraded":"2024-09-10T06:24:41.081113+0000","last_fullsized":"2024-09-10T06:24:41.081113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:32.725312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.910497+0000","last_change":"2024-09-10T06:22:33.811540+0000","last_active":"2024-09-10T06:25:45.910497+0000","last_peered":"2024-09-10T06:25:45.910497+0000","last_clean":"2024-09-10T06:25:45.910497+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:25:45.910497+0000","last_undegraded":"2024-09-10T06:25:45.910497+0000","last_fullsized":"2024-09-10T06:25:45.910497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:40.528357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845567+0000","last_change":"2024-09-10T06:22:31.811935+0000","last_active":"2024-09-10T06:23:12.845567+0000","last_peered":"2024-09-10T06:23:12.845567+0000","last_clean":"2024-09-10T06:23:12.845567+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:23:12.845567+0000","last_undegraded":"2024-09-10T06:23:12.845567+0000","last_fullsized":"2024-09-10T06:23:12.845567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315934+0000","last_change":"2024-09-10T06:22:33.828847+0000","last_active":"2024-09-10T06:25:46.315934+0000","last_peered":"2024-09-10T06:25:46.315934+0000","last_clean":"2024-09-10T06:25:46.315934+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:25:46.315934+0000","last_undegraded":"2024-09-10T06:25:46.315934+0000","last_fullsized":"2024-09-10T06:25:46.315934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839176+0000","last_change":"2024-09-10T06:22:31.832535+0000","last_active":"2024-09-10T06:23:12.839176+0000","last_peered":"2024-09-10T06:23:12.839176+0000","last_clean":"2024-09-10T06:23:12.839176+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:23:12.839176+0000","last_undegraded":"2024-09-10T06:23:12.839176+0000","last_fullsized":"2024-09-10T06:23:12.839176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:34.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315089+0000","last_change":"2024-09-10T06:22:33.845847+0000","last_active":"2024-09-10T06:25:46.315089+0000","last_peered":"2024-09-10T06:25:46.315089+0000","last_clean":"2024-09-10T06:25:46.315089+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:25:46.315089+0000","last_undegraded":"2024-09-10T06:25:46.315089+0000","last_fullsized":"2024-09-10T06:25:46.315089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848612+0000","last_change":"2024-09-10T06:22:31.838658+0000","last_active":"2024-09-10T06:23:12.848612+0000","last_peered":"2024-09-10T06:23:12.848612+0000","last_clean":"2024-09-10T06:23:12.848612+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:23:12.848612+0000","last_undegraded":"2024-09-10T06:23:12.848612+0000","last_fullsized":"2024-09-10T06:23:12.848612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:56.723910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848557+0000","last_change":"2024-09-10T06:23:12.871593+0000","last_active":"2024-09-10T06:23:16.848557+0000","last_peered":"2024-09-10T06:23:16.848557+0000","last_clean":"2024-09-10T06:23:16.848557+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:23:16.848557+0000","last_undegraded":"2024-09-10T06:23:16.848557+0000","last_fullsized":"2024-09-10T06:23:16.848557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.458403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848766+0000","last_change":"2024-09-10T06:22:31.832744+0000","last_active":"2024-09-10T06:23:12.848766+0000","last_peered":"2024-09-10T06:23:12.848766+0000","last_clean":"2024-09-10T06:23:12.848766+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:23:12.848766+0000","last_undegraded":"2024-09-10T06:23:12.848766+0000","last_fullsized":"2024-09-10T06:23:12.848766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:59.824161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849028+0000","last_change":"2024-09-10T06:22:33.824001+0000","last_active":"2024-09-10T06:24:42.849028+0000","last_peered":"2024-09-10T06:24:42.849028+0000","last_clean":"2024-09-10T06:24:42.849028+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:24:42.849028+0000","last_undegraded":"2024-09-10T06:24:42.849028+0000","last_fullsized":"2024-09-10T06:24:42.849028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:04.705910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.190954+0000","last_change":"2024-09-10T06:22:31.828589+0000","last_active":"2024-09-10T06:25:46.190954+0000","last_peered":"2024-09-10T06:25:46.190954+0000","last_clean":"2024-09-10T06:25:46.190954+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:25:46.190954+0000","last_undegraded":"2024-09-10T06:25:46.190954+0000","last_fullsized":"2024-09-10T06:25:46.190954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:13.166658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836407+0000","last_change":"2024-09-10T06:22:31.822739+0000","last_active":"2024-09-10T06:23:12.836407+0000","last_peered":"2024-09-10T06:23:12.836407+0000","last_clean":"2024-09-10T06:23:12.836407+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:23:12.836407+0000","last_undegraded":"2024-09-10T06:23:12.836407+0000","last_fullsized":"2024-09-10T06:23:12.836407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:18.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427151+0000","last_change":"2024-09-10T06:22:33.834781+0000","last_active":"2024-09-10T06:24:00.427151+0000","last_peered":"2024-09-10T06:24:00.427151+0000","last_clean":"2024-09-10T06:24:00.427151+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:24:00.427151+0000","last_undegraded":"2024-09-10T06:24:00.427151+0000","last_fullsized":"2024-09-10T06:24:00.427151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.042356+0000","last_change":"2024-09-10T06:22:31.814239+0000","last_active":"2024-09-10T06:24:45.042356+0000","last_peered":"2024-09-10T06:24:45.042356+0000","last_clean":"2024-09-10T06:24:45.042356+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:24:45.042356+0000","last_undegraded":"2024-09-10T06:24:45.042356+0000","last_fullsized":"2024-09-10T06:24:45.042356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226303+0000","last_change":"2024-09-10T06:22:33.828192+0000","last_active":"2024-09-10T06:25:46.226303+0000","last_peered":"2024-09-10T06:25:46.226303+0000","last_clean":"2024-09-10T06:25:46.226303+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:25:46.226303+0000","last_undegraded":"2024-09-10T06:25:46.226303+0000","last_fullsized":"2024-09-10T06:25:46.226303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:17.430784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56276,"kb_used_data":20932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315564,"statfs":{"total":96636764160,"available":96579137536,"internally_reserved":0,"allocated":21434368,"data_stored":21108121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53324,"kb_used_data":17980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318516,"statfs":{"total":96636764160,"available":96582160384,"internally_reserved":0,"allocated":18411520,"data_stored":18144049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4918891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":9240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":9461760,"data_stored":9165923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:18.182 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8092e28640 1 Processor -- start 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8092e28640 1 -- start start 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8092e28640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f808c09c160 0x7f808c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8092e28640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808c09e460 con 0x7f808c09dbc0 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8092e28640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f808c073c10 con 0x7f808c09c160 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8090bc4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f808c09c160 0x7f808c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f808bfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f808c09dbc0 0x7f808c125770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53500/0 (socket says 172.21.15.84:53500) 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f808bfff640 1 -- 172.21.15.84:0/1326929220 learned_addr learned my addr 172.21.15.84:0/1326929220 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8090bc4640 1 -- 172.21.15.84:0/1326929220 >> v1:172.21.15.84:6789/0 conn(0x7f808c09dbc0 legacy=0x7f808c125770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.331+0000 7f8090bc4640 1 -- 172.21.15.84:0/1326929220 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808c09e770 con 0x7f808c09c160 2024-09-10T06:26:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 --2- 172.21.15.84:0/1326929220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c09c540 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f807c009740 tx=0x7f807c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca6a98750ef1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f808b7fe640 1 -- 172.21.15.84:0/1326929220 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0b0070 con 0x7f808c09c160 2024-09-10T06:26:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f808b7fe640 1 -- 172.21.15.84:0/1326929220 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c0ab530 con 0x7f808c09c160 2024-09-10T06:26:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f808b7fe640 1 -- 172.21.15.84:0/1326929220 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0ab830 con 0x7f808c09c160 2024-09-10T06:26:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/1326929220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 msgr2=0x7f808c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 --2- 172.21.15.84:0/1326929220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c09c540 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f807c009740 tx=0x7f807c01c370 comp rx=0 tx=0).stop 2024-09-10T06:26:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/1326929220 shutdown_connections 2024-09-10T06:26:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 --2- 172.21.15.84:0/1326929220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c09c540 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/1326929220 >> 172.21.15.84:0/1326929220 conn(0x7f808c0715c0 msgr2=0x7f808c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/1326929220 shutdown_connections 2024-09-10T06:26:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/1326929220 wait complete. 2024-09-10T06:26:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 Processor -- start 2024-09-10T06:26:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- start start 2024-09-10T06:26:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f808c134880 con 0x7f808c09c160 2024-09-10T06:26:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45792/0 (socket says 172.21.15.84:45792) 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 -- 172.21.15.84:0/3309891125 learned_addr learned my addr 172.21.15.84:0/3309891125 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 -- 172.21.15.84:0/3309891125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808c1c5050 con 0x7f808c09c160 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8090bc4640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f807c0ae040 tx=0x7f807c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0b8020 con 0x7f808c09c160 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c0b4410 con 0x7f808c09c160 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f808c117090 con 0x7f808c09c160 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0b0040 con 0x7f808c09c160 2024-09-10T06:26:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.335+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808c118930 con 0x7f808c09c160 2024-09-10T06:26:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f808c09c540 con 0x7f808c09c160 2024-09-10T06:26:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f807c0bb020 con 0x7f808c09c160 2024-09-10T06:26:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f80897fa640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 0x7f806c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f807c0e93f0 con 0x7f808c09c160 2024-09-10T06:26:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f808bfff640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 0x7f806c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.339+0000 7f808bfff640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 0x7f806c03d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8084005c10 tx=0x7f80840016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.343+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f807c0c2030 con 0x7f808c09c160 2024-09-10T06:26:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.507+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f808c125260 con 0x7f806c03b200 2024-09-10T06:26:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.535+0000 7f80897fa640 1 -- 172.21.15.84:0/3309891125 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665562 (secure 0 0 0) 0x7f808c125260 con 0x7f806c03b200 2024-09-10T06:26:18.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:18.552 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:26:18.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 msgr2=0x7f806c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 0x7f806c03d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8084005c10 tx=0x7f80840016c0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 msgr2=0x7f808c1c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f807c0ae040 tx=0x7f807c019110 comp rx=0 tx=0).stop 2024-09-10T06:26:18.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 shutdown_connections 2024-09-10T06:26:18.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f806c03b200 0x7f806c03d6c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 --2- 172.21.15.84:0/3309891125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f808c09c160 0x7f808c1c54a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 >> 172.21.15.84:0/3309891125 conn(0x7f808c0715c0 msgr2=0x7f808c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:18.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 shutdown_connections 2024-09-10T06:26:18.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.543+0000 7f8092e28640 1 -- 172.21.15.84:0/3309891125 wait complete. 2024-09-10T06:26:18.562 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-10T06:26:17.863835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4872,"num_read_kb":4458,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53336984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006310"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852214+0000","last_change":"2024-09-10T06:22:31.830584+0000","last_active":"2024-09-10T06:23:12.852214+0000","last_peered":"2024-09-10T06:23:12.852214+0000","last_clean":"2024-09-10T06:23:12.852214+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:23:12.852214+0000","last_undegraded":"2024-09-10T06:23:12.852214+0000","last_fullsized":"2024-09-10T06:23:12.852214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:16.702734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380991+0000","last_change":"2024-09-10T06:22:33.833535+0000","last_active":"2024-09-10T06:25:46.380991+0000","last_peered":"2024-09-10T06:25:46.380991+0000","last_clean":"2024-09-10T06:25:46.380991+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:25:46.380991+0000","last_undegraded":"2024-09-10T06:25:46.380991+0000","last_fullsized":"2024-09-10T06:25:46.380991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841367+0000","last_change":"2024-09-10T06:22:31.815930+0000","last_active":"2024-09-10T06:23:12.841367+0000","last_peered":"2024-09-10T06:23:12.841367+0000","last_clean":"2024-09-10T06:23:12.841367+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:23:12.841367+0000","last_undegraded":"2024-09-10T06:23:12.841367+0000","last_fullsized":"2024-09-10T06:23:12.841367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:10.113632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856201+0000","last_change":"2024-09-10T06:22:31.836564+0000","last_active":"2024-09-10T06:24:38.856201+0000","last_peered":"2024-09-10T06:24:38.856201+0000","last_clean":"2024-09-10T06:24:38.856201+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:24:38.856201+0000","last_undegraded":"2024-09-10T06:24:38.856201+0000","last_fullsized":"2024-09-10T06:24:38.856201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:18.259418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847960+0000","last_change":"2024-09-10T06:22:31.806993+0000","last_active":"2024-09-10T06:23:12.847960+0000","last_peered":"2024-09-10T06:23:12.847960+0000","last_clean":"2024-09-10T06:23:12.847960+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:23:12.847960+0000","last_undegraded":"2024-09-10T06:23:12.847960+0000","last_fullsized":"2024-09-10T06:23:12.847960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:10.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.401883+0000","last_change":"2024-09-10T06:23:12.860422+0000","last_active":"2024-09-10T06:25:46.401883+0000","last_peered":"2024-09-10T06:25:46.401883+0000","last_clean":"2024-09-10T06:25:46.401883+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:25:46.401883+0000","last_undegraded":"2024-09-10T06:25:46.401883+0000","last_fullsized":"2024-09-10T06:25:46.401883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:40.359356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838331+0000","last_change":"2024-09-10T06:22:31.826279+0000","last_active":"2024-09-10T06:23:12.838331+0000","last_peered":"2024-09-10T06:23:12.838331+0000","last_clean":"2024-09-10T06:23:12.838331+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:23:12.838331+0000","last_undegraded":"2024-09-10T06:23:12.838331+0000","last_fullsized":"2024-09-10T06:23:12.838331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:26.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.313495+0000","last_change":"2024-09-10T06:22:33.812237+0000","last_active":"2024-09-10T06:25:46.313495+0000","last_peered":"2024-09-10T06:25:46.313495+0000","last_clean":"2024-09-10T06:25:46.313495+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:25:46.313495+0000","last_undegraded":"2024-09-10T06:25:46.313495+0000","last_fullsized":"2024-09-10T06:25:46.313495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.206290+0000","last_change":"2024-09-10T06:22:31.809080+0000","last_active":"2024-09-10T06:25:46.206290+0000","last_peered":"2024-09-10T06:25:46.206290+0000","last_clean":"2024-09-10T06:25:46.206290+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:25:46.206290+0000","last_undegraded":"2024-09-10T06:25:46.206290+0000","last_fullsized":"2024-09-10T06:25:46.206290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:43.483133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843973+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:23:12.843973+0000","last_peered":"2024-09-10T06:23:12.843973+0000","last_clean":"2024-09-10T06:23:12.843973+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:23:12.843973+0000","last_undegraded":"2024-09-10T06:23:12.843973+0000","last_fullsized":"2024-09-10T06:23:12.843973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:50.427247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838841+0000","last_change":"2024-09-10T06:22:31.828678+0000","last_active":"2024-09-10T06:23:12.838841+0000","last_peered":"2024-09-10T06:23:12.838841+0000","last_clean":"2024-09-10T06:23:12.838841+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:23:12.838841+0000","last_undegraded":"2024-09-10T06:23:12.838841+0000","last_fullsized":"2024-09-10T06:23:12.838841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:33.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.426746+0000","last_change":"2024-09-10T06:22:33.841656+0000","last_active":"2024-09-10T06:24:00.426746+0000","last_peered":"2024-09-10T06:24:00.426746+0000","last_clean":"2024-09-10T06:24:00.426746+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:24:00.426746+0000","last_undegraded":"2024-09-10T06:24:00.426746+0000","last_fullsized":"2024-09-10T06:24:00.426746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.423672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.870547+0000","last_change":"2024-09-10T06:23:12.869310+0000","last_active":"2024-09-10T06:23:12.870547+0000","last_peered":"2024-09-10T06:23:12.870547+0000","last_clean":"2024-09-10T06:23:12.870547+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:23:12.870547+0000","last_undegraded":"2024-09-10T06:23:12.870547+0000","last_fullsized":"2024-09-10T06:23:12.870547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:34.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.027326+0000","last_change":"2024-09-10T06:23:12.857760+0000","last_active":"2024-09-10T06:25:46.027326+0000","last_peered":"2024-09-10T06:25:46.027326+0000","last_clean":"2024-09-10T06:25:46.027326+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:25:46.027326+0000","last_undegraded":"2024-09-10T06:25:46.027326+0000","last_fullsized":"2024-09-10T06:25:46.027326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.942980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.864475+0000","last_change":"2024-09-10T06:22:31.832009+0000","last_active":"2024-09-10T06:23:12.864475+0000","last_peered":"2024-09-10T06:23:12.864475+0000","last_clean":"2024-09-10T06:23:12.864475+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:23:12.864475+0000","last_undegraded":"2024-09-10T06:23:12.864475+0000","last_fullsized":"2024-09-10T06:23:12.864475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028692+0000","last_change":"2024-09-10T06:22:33.844939+0000","last_active":"2024-09-10T06:25:46.028692+0000","last_peered":"2024-09-10T06:25:46.028692+0000","last_clean":"2024-09-10T06:25:46.028692+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:25:46.028692+0000","last_undegraded":"2024-09-10T06:25:46.028692+0000","last_fullsized":"2024-09-10T06:25:46.028692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:54.074106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849914+0000","last_change":"2024-09-10T06:22:31.833253+0000","last_active":"2024-09-10T06:23:12.849914+0000","last_peered":"2024-09-10T06:23:12.849914+0000","last_clean":"2024-09-10T06:23:12.849914+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:23:12.849914+0000","last_undegraded":"2024-09-10T06:23:12.849914+0000","last_fullsized":"2024-09-10T06:23:12.849914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:12.255366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226464+0000","last_change":"2024-09-10T06:22:33.841628+0000","last_active":"2024-09-10T06:25:46.226464+0000","last_peered":"2024-09-10T06:25:46.226464+0000","last_clean":"2024-09-10T06:25:46.226464+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:25:46.226464+0000","last_undegraded":"2024-09-10T06:25:46.226464+0000","last_fullsized":"2024-09-10T06:25:46.226464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.857466+0000","last_change":"2024-09-10T06:22:31.828028+0000","last_active":"2024-09-10T06:23:12.857466+0000","last_peered":"2024-09-10T06:23:12.857466+0000","last_clean":"2024-09-10T06:23:12.857466+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:23:12.857466+0000","last_undegraded":"2024-09-10T06:23:12.857466+0000","last_fullsized":"2024-09-10T06:23:12.857466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.372084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026158+0000","last_change":"2024-09-10T06:22:33.822953+0000","last_active":"2024-09-10T06:25:46.026158+0000","last_peered":"2024-09-10T06:25:46.026158+0000","last_clean":"2024-09-10T06:25:46.026158+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:25:46.026158+0000","last_undegraded":"2024-09-10T06:25:46.026158+0000","last_fullsized":"2024-09-10T06:25:46.026158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.856102+0000","last_change":"2024-09-10T06:22:31.803614+0000","last_active":"2024-09-10T06:23:12.856102+0000","last_peered":"2024-09-10T06:23:12.856102+0000","last_clean":"2024-09-10T06:23:12.856102+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:23:12.856102+0000","last_undegraded":"2024-09-10T06:23:12.856102+0000","last_fullsized":"2024-09-10T06:23:12.856102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.894566+0000","last_change":"2024-09-10T06:22:33.841481+0000","last_active":"2024-09-10T06:25:45.894566+0000","last_peered":"2024-09-10T06:25:45.894566+0000","last_clean":"2024-09-10T06:25:45.894566+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:25:45.894566+0000","last_undegraded":"2024-09-10T06:25:45.894566+0000","last_fullsized":"2024-09-10T06:25:45.894566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:07.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844594+0000","last_change":"2024-09-10T06:22:31.814700+0000","last_active":"2024-09-10T06:23:12.844594+0000","last_peered":"2024-09-10T06:23:12.844594+0000","last_clean":"2024-09-10T06:23:12.844594+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:23:12.844594+0000","last_undegraded":"2024-09-10T06:23:12.844594+0000","last_fullsized":"2024-09-10T06:23:12.844594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.299397+0000","last_change":"2024-09-10T06:22:33.818692+0000","last_active":"2024-09-10T06:24:45.299397+0000","last_peered":"2024-09-10T06:24:45.299397+0000","last_clean":"2024-09-10T06:24:45.299397+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:24:45.299397+0000","last_undegraded":"2024-09-10T06:24:45.299397+0000","last_fullsized":"2024-09-10T06:24:45.299397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.049587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.562583+0000","last_change":"2024-09-10T06:22:31.830265+0000","last_active":"2024-09-10T06:23:15.562583+0000","last_peered":"2024-09-10T06:23:15.562583+0000","last_clean":"2024-09-10T06:23:15.562583+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:23:15.562583+0000","last_undegraded":"2024-09-10T06:23:15.562583+0000","last_fullsized":"2024-09-10T06:23:15.562583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:05.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314012+0000","last_change":"2024-09-10T06:22:33.812296+0000","last_active":"2024-09-10T06:25:46.314012+0000","last_peered":"2024-09-10T06:25:46.314012+0000","last_clean":"2024-09-10T06:25:46.314012+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:25:46.314012+0000","last_undegraded":"2024-09-10T06:25:46.314012+0000","last_fullsized":"2024-09-10T06:25:46.314012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:01.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836937+0000","last_change":"2024-09-10T06:22:31.831741+0000","last_active":"2024-09-10T06:23:12.836937+0000","last_peered":"2024-09-10T06:23:12.836937+0000","last_clean":"2024-09-10T06:23:12.836937+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:23:12.836937+0000","last_undegraded":"2024-09-10T06:23:12.836937+0000","last_fullsized":"2024-09-10T06:23:12.836937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:47.297207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.272681+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:24:43.272681+0000","last_peered":"2024-09-10T06:24:43.272681+0000","last_clean":"2024-09-10T06:24:43.272681+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:24:43.272681+0000","last_undegraded":"2024-09-10T06:24:43.272681+0000","last_fullsized":"2024-09-10T06:24:43.272681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380630+0000","last_change":"2024-09-10T06:22:33.816970+0000","last_active":"2024-09-10T06:25:46.380630+0000","last_peered":"2024-09-10T06:25:46.380630+0000","last_clean":"2024-09-10T06:25:46.380630+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:25:46.380630+0000","last_undegraded":"2024-09-10T06:25:46.380630+0000","last_fullsized":"2024-09-10T06:25:46.380630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:13.014250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.234103+0000","last_change":"2024-09-10T06:23:12.901608+0000","last_active":"2024-09-10T06:24:45.234103+0000","last_peered":"2024-09-10T06:24:45.234103+0000","last_clean":"2024-09-10T06:24:45.234103+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:24:45.234103+0000","last_undegraded":"2024-09-10T06:24:45.234103+0000","last_fullsized":"2024-09-10T06:24:45.234103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:00.953898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838061+0000","last_change":"2024-09-10T06:22:31.821919+0000","last_active":"2024-09-10T06:23:12.838061+0000","last_peered":"2024-09-10T06:23:12.838061+0000","last_clean":"2024-09-10T06:23:12.838061+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:23:12.838061+0000","last_undegraded":"2024-09-10T06:23:12.838061+0000","last_fullsized":"2024-09-10T06:23:12.838061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:55.502929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844115+0000","last_change":"2024-09-10T06:22:35.836699+0000","last_active":"2024-09-10T06:23:12.844115+0000","last_peered":"2024-09-10T06:23:12.844115+0000","last_clean":"2024-09-10T06:23:12.844115+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:23:12.844115+0000","last_undegraded":"2024-09-10T06:23:12.844115+0000","last_fullsized":"2024-09-10T06:23:12.844115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:10.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.570616+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:25:46.570616+0000","last_peered":"2024-09-10T06:25:46.570616+0000","last_clean":"2024-09-10T06:25:46.570616+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:25:46.570616+0000","last_undegraded":"2024-09-10T06:25:46.570616+0000","last_fullsized":"2024-09-10T06:25:46.570616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.330277+0000","last_change":"2024-09-10T06:22:33.836449+0000","last_active":"2024-09-10T06:25:46.330277+0000","last_peered":"2024-09-10T06:25:46.330277+0000","last_clean":"2024-09-10T06:25:46.330277+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:25:46.330277+0000","last_undegraded":"2024-09-10T06:25:46.330277+0000","last_fullsized":"2024-09-10T06:25:46.330277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:54.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841665+0000","last_change":"2024-09-10T06:22:31.828040+0000","last_active":"2024-09-10T06:23:12.841665+0000","last_peered":"2024-09-10T06:23:12.841665+0000","last_clean":"2024-09-10T06:23:12.841665+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:23:12.841665+0000","last_undegraded":"2024-09-10T06:23:12.841665+0000","last_fullsized":"2024-09-10T06:23:12.841665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:07.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.265779+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:24:43.265779+0000","last_peered":"2024-09-10T06:24:43.265779+0000","last_clean":"2024-09-10T06:24:43.265779+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:24:43.265779+0000","last_undegraded":"2024-09-10T06:24:43.265779+0000","last_fullsized":"2024-09-10T06:24:43.265779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.389843+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:25:46.389843+0000","last_peered":"2024-09-10T06:25:46.389843+0000","last_clean":"2024-09-10T06:25:46.389843+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:25:46.389843+0000","last_undegraded":"2024-09-10T06:25:46.389843+0000","last_fullsized":"2024-09-10T06:25:46.389843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836656+0000","last_change":"2024-09-10T06:22:33.836542+0000","last_active":"2024-09-10T06:23:12.836656+0000","last_peered":"2024-09-10T06:23:12.836656+0000","last_clean":"2024-09-10T06:23:12.836656+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:23:12.836656+0000","last_undegraded":"2024-09-10T06:23:12.836656+0000","last_fullsized":"2024-09-10T06:23:12.836656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:35.885623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852424+0000","last_change":"2024-09-10T06:22:31.804588+0000","last_active":"2024-09-10T06:23:12.852424+0000","last_peered":"2024-09-10T06:23:12.852424+0000","last_clean":"2024-09-10T06:23:12.852424+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:23:12.852424+0000","last_undegraded":"2024-09-10T06:23:12.852424+0000","last_fullsized":"2024-09-10T06:23:12.852424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846399+0000","last_change":"2024-09-10T06:22:35.836358+0000","last_active":"2024-09-10T06:23:12.846399+0000","last_peered":"2024-09-10T06:23:12.846399+0000","last_clean":"2024-09-10T06:23:12.846399+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:23:12.846399+0000","last_undegraded":"2024-09-10T06:23:12.846399+0000","last_fullsized":"2024-09-10T06:23:12.846399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:19.610121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.278467+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:24:43.278467+0000","last_peered":"2024-09-10T06:24:43.278467+0000","last_clean":"2024-09-10T06:24:43.278467+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:24:43.278467+0000","last_undegraded":"2024-09-10T06:24:43.278467+0000","last_fullsized":"2024-09-10T06:24:43.278467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:10.147486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.165283+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:00.165283+0000","last_peered":"2024-09-10T06:24:00.165283+0000","last_clean":"2024-09-10T06:24:00.165283+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:00.165283+0000","last_undegraded":"2024-09-10T06:24:00.165283+0000","last_fullsized":"2024-09-10T06:24:00.165283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:04.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227310+0000","last_change":"2024-09-10T06:22:33.817819+0000","last_active":"2024-09-10T06:25:46.227310+0000","last_peered":"2024-09-10T06:25:46.227310+0000","last_clean":"2024-09-10T06:25:46.227310+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:25:46.227310+0000","last_undegraded":"2024-09-10T06:25:46.227310+0000","last_fullsized":"2024-09-10T06:25:46.227310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.471797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850929+0000","last_change":"2024-09-10T06:22:31.807466+0000","last_active":"2024-09-10T06:23:12.850929+0000","last_peered":"2024-09-10T06:23:12.850929+0000","last_clean":"2024-09-10T06:23:12.850929+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:23:12.850929+0000","last_undegraded":"2024-09-10T06:23:12.850929+0000","last_fullsized":"2024-09-10T06:23:12.850929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:02.579986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840472+0000","last_change":"2024-09-10T06:22:35.836298+0000","last_active":"2024-09-10T06:23:12.840472+0000","last_peered":"2024-09-10T06:23:12.840472+0000","last_clean":"2024-09-10T06:23:12.840472+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:23:12.840472+0000","last_undegraded":"2024-09-10T06:23:12.840472+0000","last_fullsized":"2024-09-10T06:23:12.840472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.251245+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:24:43.251245+0000","last_peered":"2024-09-10T06:24:43.251245+0000","last_clean":"2024-09-10T06:24:43.251245+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:24:43.251245+0000","last_undegraded":"2024-09-10T06:24:43.251245+0000","last_fullsized":"2024-09-10T06:24:43.251245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:54.521264+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:23:54.521264+0000","last_peered":"2024-09-10T06:23:54.521264+0000","last_clean":"2024-09-10T06:23:54.521264+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:23:54.521264+0000","last_undegraded":"2024-09-10T06:23:54.521264+0000","last_fullsized":"2024-09-10T06:23:54.521264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:15.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.277593+0000","last_change":"2024-09-10T06:22:33.841687+0000","last_active":"2024-09-10T06:24:45.277593+0000","last_peered":"2024-09-10T06:24:45.277593+0000","last_clean":"2024-09-10T06:24:45.277593+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:24:45.277593+0000","last_undegraded":"2024-09-10T06:24:45.277593+0000","last_fullsized":"2024-09-10T06:24:45.277593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:42.392550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563926+0000","last_change":"2024-09-10T06:22:31.836503+0000","last_active":"2024-09-10T06:23:15.563926+0000","last_peered":"2024-09-10T06:23:15.563926+0000","last_clean":"2024-09-10T06:23:15.563926+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:23:15.563926+0000","last_undegraded":"2024-09-10T06:23:15.563926+0000","last_fullsized":"2024-09-10T06:23:15.563926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:55.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846203+0000","last_change":"2024-09-10T06:22:35.835893+0000","last_active":"2024-09-10T06:23:12.846203+0000","last_peered":"2024-09-10T06:23:12.846203+0000","last_clean":"2024-09-10T06:23:12.846203+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:23:12.846203+0000","last_undegraded":"2024-09-10T06:23:12.846203+0000","last_fullsized":"2024-09-10T06:23:12.846203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:12.526918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.280485+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:24:43.280485+0000","last_peered":"2024-09-10T06:24:43.280485+0000","last_clean":"2024-09-10T06:24:43.280485+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:24:43.280485+0000","last_undegraded":"2024-09-10T06:24:43.280485+0000","last_fullsized":"2024-09-10T06:24:43.280485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:52.569579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.584430+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:25:46.584430+0000","last_peered":"2024-09-10T06:25:46.584430+0000","last_clean":"2024-09-10T06:25:46.584430+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:25:46.584430+0000","last_undegraded":"2024-09-10T06:25:46.584430+0000","last_fullsized":"2024-09-10T06:25:46.584430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156054+0000","last_change":"2024-09-10T06:22:33.822287+0000","last_active":"2024-09-10T06:24:00.156054+0000","last_peered":"2024-09-10T06:24:00.156054+0000","last_clean":"2024-09-10T06:24:00.156054+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:24:00.156054+0000","last_undegraded":"2024-09-10T06:24:00.156054+0000","last_fullsized":"2024-09-10T06:24:00.156054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:30.825794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.367831+0000","last_change":"2024-09-10T06:22:31.832982+0000","last_active":"2024-09-10T06:25:46.367831+0000","last_peered":"2024-09-10T06:25:46.367831+0000","last_clean":"2024-09-10T06:25:46.367831+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:25:46.367831+0000","last_undegraded":"2024-09-10T06:25:46.367831+0000","last_fullsized":"2024-09-10T06:25:46.367831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:28.916480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841000+0000","last_change":"2024-09-10T06:22:35.836376+0000","last_active":"2024-09-10T06:23:12.841000+0000","last_peered":"2024-09-10T06:23:12.841000+0000","last_clean":"2024-09-10T06:23:12.841000+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:23:12.841000+0000","last_undegraded":"2024-09-10T06:23:12.841000+0000","last_fullsized":"2024-09-10T06:23:12.841000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:11.310423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.857914+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:24:48.857914+0000","last_peered":"2024-09-10T06:24:48.857914+0000","last_clean":"2024-09-10T06:24:48.857914+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:24:48.857914+0000","last_undegraded":"2024-09-10T06:24:48.857914+0000","last_fullsized":"2024-09-10T06:24:48.857914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:32.138442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850212+0000","last_change":"2024-09-10T06:22:33.827668+0000","last_active":"2024-09-10T06:24:47.850212+0000","last_peered":"2024-09-10T06:24:47.850212+0000","last_clean":"2024-09-10T06:24:47.850212+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:24:47.850212+0000","last_undegraded":"2024-09-10T06:24:47.850212+0000","last_fullsized":"2024-09-10T06:24:47.850212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:10.516267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843566+0000","last_change":"2024-09-10T06:22:31.827415+0000","last_active":"2024-09-10T06:23:12.843566+0000","last_peered":"2024-09-10T06:23:12.843566+0000","last_clean":"2024-09-10T06:23:12.843566+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:23:12.843566+0000","last_undegraded":"2024-09-10T06:23:12.843566+0000","last_fullsized":"2024-09-10T06:23:12.843566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.483166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848722+0000","last_change":"2024-09-10T06:22:35.830686+0000","last_active":"2024-09-10T06:23:12.848722+0000","last_peered":"2024-09-10T06:23:12.848722+0000","last_clean":"2024-09-10T06:23:12.848722+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:23:12.848722+0000","last_undegraded":"2024-09-10T06:23:12.848722+0000","last_fullsized":"2024-09-10T06:23:12.848722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.256435+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:24:43.256435+0000","last_peered":"2024-09-10T06:24:43.256435+0000","last_clean":"2024-09-10T06:24:43.256435+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:24:43.256435+0000","last_undegraded":"2024-09-10T06:24:43.256435+0000","last_fullsized":"2024-09-10T06:24:43.256435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856817+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:24:43.856817+0000","last_peered":"2024-09-10T06:24:43.856817+0000","last_clean":"2024-09-10T06:24:43.856817+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:24:43.856817+0000","last_undegraded":"2024-09-10T06:24:43.856817+0000","last_fullsized":"2024-09-10T06:24:43.856817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:00.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.485815+0000","last_change":"2024-09-10T06:22:33.836732+0000","last_active":"2024-09-10T06:25:46.485815+0000","last_peered":"2024-09-10T06:25:46.485815+0000","last_clean":"2024-09-10T06:25:46.485815+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:25:46.485815+0000","last_undegraded":"2024-09-10T06:25:46.485815+0000","last_fullsized":"2024-09-10T06:25:46.485815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:58.953149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843151+0000","last_change":"2024-09-10T06:22:31.831869+0000","last_active":"2024-09-10T06:23:12.843151+0000","last_peered":"2024-09-10T06:23:12.843151+0000","last_clean":"2024-09-10T06:23:12.843151+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:23:12.843151+0000","last_undegraded":"2024-09-10T06:23:12.843151+0000","last_fullsized":"2024-09-10T06:23:12.843151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:08.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844174+0000","last_change":"2024-09-10T06:22:35.836278+0000","last_active":"2024-09-10T06:23:12.844174+0000","last_peered":"2024-09-10T06:23:12.844174+0000","last_clean":"2024-09-10T06:23:12.844174+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:23:12.844174+0000","last_undegraded":"2024-09-10T06:23:12.844174+0000","last_fullsized":"2024-09-10T06:23:12.844174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:25.749044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:53.875302+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:24:53.875302+0000","last_peered":"2024-09-10T06:24:53.875302+0000","last_clean":"2024-09-10T06:24:53.875302+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:24:53.875302+0000","last_undegraded":"2024-09-10T06:24:53.875302+0000","last_fullsized":"2024-09-10T06:24:53.875302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.556846+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:25:46.556846+0000","last_peered":"2024-09-10T06:25:46.556846+0000","last_clean":"2024-09-10T06:25:46.556846+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:25:46.556846+0000","last_undegraded":"2024-09-10T06:25:46.556846+0000","last_fullsized":"2024-09-10T06:25:46.556846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.844984+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:24:47.844984+0000","last_peered":"2024-09-10T06:24:47.844984+0000","last_clean":"2024-09-10T06:24:47.844984+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:24:47.844984+0000","last_undegraded":"2024-09-10T06:24:47.844984+0000","last_fullsized":"2024-09-10T06:24:47.844984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:41.565616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.030221+0000","last_change":"2024-09-10T06:22:33.844698+0000","last_active":"2024-09-10T06:25:46.030221+0000","last_peered":"2024-09-10T06:25:46.030221+0000","last_clean":"2024-09-10T06:25:46.030221+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:25:46.030221+0000","last_undegraded":"2024-09-10T06:25:46.030221+0000","last_fullsized":"2024-09-10T06:25:46.030221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:46.069087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844850+0000","last_change":"2024-09-10T06:22:31.826875+0000","last_active":"2024-09-10T06:23:12.844850+0000","last_peered":"2024-09-10T06:23:12.844850+0000","last_clean":"2024-09-10T06:23:12.844850+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:23:12.844850+0000","last_undegraded":"2024-09-10T06:23:12.844850+0000","last_fullsized":"2024-09-10T06:23:12.844850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.394900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.721931+0000","last_change":"2024-09-10T06:22:35.832300+0000","last_active":"2024-09-10T06:24:44.721931+0000","last_peered":"2024-09-10T06:24:44.721931+0000","last_clean":"2024-09-10T06:24:44.721931+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:24:44.721931+0000","last_undegraded":"2024-09-10T06:24:44.721931+0000","last_fullsized":"2024-09-10T06:24:44.721931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:47.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":467,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.495421+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:25:46.495421+0000","last_peered":"2024-09-10T06:25:46.495421+0000","last_clean":"2024-09-10T06:25:46.495421+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:25:46.495421+0000","last_undegraded":"2024-09-10T06:25:46.495421+0000","last_fullsized":"2024-09-10T06:25:46.495421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.871524+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:44.871524+0000","last_peered":"2024-09-10T06:24:44.871524+0000","last_clean":"2024-09-10T06:24:44.871524+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:44.871524+0000","last_undegraded":"2024-09-10T06:24:44.871524+0000","last_fullsized":"2024-09-10T06:24:44.871524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:02.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850321+0000","last_change":"2024-09-10T06:22:33.827862+0000","last_active":"2024-09-10T06:24:47.850321+0000","last_peered":"2024-09-10T06:24:47.850321+0000","last_clean":"2024-09-10T06:24:47.850321+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:24:47.850321+0000","last_undegraded":"2024-09-10T06:24:47.850321+0000","last_fullsized":"2024-09-10T06:24:47.850321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:49.916726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835639+0000","last_change":"2024-09-10T06:22:31.830812+0000","last_active":"2024-09-10T06:23:12.835639+0000","last_peered":"2024-09-10T06:23:12.835639+0000","last_clean":"2024-09-10T06:23:12.835639+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:23:12.835639+0000","last_undegraded":"2024-09-10T06:23:12.835639+0000","last_fullsized":"2024-09-10T06:23:12.835639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:07.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.274627+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:24:43.274627+0000","last_peered":"2024-09-10T06:24:43.274627+0000","last_clean":"2024-09-10T06:24:43.274627+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:24:43.274627+0000","last_undegraded":"2024-09-10T06:24:43.274627+0000","last_fullsized":"2024-09-10T06:24:43.274627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.454158+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.454158+0000","last_peered":"2024-09-10T06:25:46.454158+0000","last_clean":"2024-09-10T06:25:46.454158+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.454158+0000","last_undegraded":"2024-09-10T06:25:46.454158+0000","last_fullsized":"2024-09-10T06:25:46.454158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:28.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.085306+0000","last_change":"2024-09-10T06:22:33.830097+0000","last_active":"2024-09-10T06:24:41.085306+0000","last_peered":"2024-09-10T06:24:41.085306+0000","last_clean":"2024-09-10T06:24:41.085306+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:24:41.085306+0000","last_undegraded":"2024-09-10T06:24:41.085306+0000","last_fullsized":"2024-09-10T06:24:41.085306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:04.520654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841380+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:23:12.841380+0000","last_peered":"2024-09-10T06:23:12.841380+0000","last_clean":"2024-09-10T06:23:12.841380+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:23:12.841380+0000","last_undegraded":"2024-09-10T06:23:12.841380+0000","last_fullsized":"2024-09-10T06:23:12.841380+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838764+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:23:12.838764+0000","last_peered":"2024-09-10T06:23:12.838764+0000","last_clean":"2024-09-10T06:23:12.838764+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:23:12.838764+0000","last_undegraded":"2024-09-10T06:23:12.838764+0000","last_fullsized":"2024-09-10T06:23:12.838764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837151+0000","last_change":"2024-09-10T06:22:31.832148+0000","last_active":"2024-09-10T06:23:12.837151+0000","last_peered":"2024-09-10T06:23:12.837151+0000","last_clean":"2024-09-10T06:23:12.837151+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:23:12.837151+0000","last_undegraded":"2024-09-10T06:23:12.837151+0000","last_fullsized":"2024-09-10T06:23:12.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:07.514358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.855163+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:23:12.855163+0000","last_peered":"2024-09-10T06:23:12.855163+0000","last_clean":"2024-09-10T06:23:12.855163+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:23:12.855163+0000","last_undegraded":"2024-09-10T06:23:12.855163+0000","last_fullsized":"2024-09-10T06:23:12.855163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.965730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.289632+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:24:43.289632+0000","last_peered":"2024-09-10T06:24:43.289632+0000","last_clean":"2024-09-10T06:24:43.289632+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:24:43.289632+0000","last_undegraded":"2024-09-10T06:24:43.289632+0000","last_fullsized":"2024-09-10T06:24:43.289632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:21.725012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315520+0000","last_change":"2024-09-10T06:22:33.814130+0000","last_active":"2024-09-10T06:25:46.315520+0000","last_peered":"2024-09-10T06:25:46.315520+0000","last_clean":"2024-09-10T06:25:46.315520+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:25:46.315520+0000","last_undegraded":"2024-09-10T06:25:46.315520+0000","last_fullsized":"2024-09-10T06:25:46.315520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:11.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835614+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:23:12.835614+0000","last_peered":"2024-09-10T06:23:12.835614+0000","last_clean":"2024-09-10T06:23:12.835614+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:23:12.835614+0000","last_undegraded":"2024-09-10T06:23:12.835614+0000","last_fullsized":"2024-09-10T06:23:12.835614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839903+0000","last_change":"2024-09-10T06:22:31.813968+0000","last_active":"2024-09-10T06:23:12.839903+0000","last_peered":"2024-09-10T06:23:12.839903+0000","last_clean":"2024-09-10T06:23:12.839903+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:23:12.839903+0000","last_undegraded":"2024-09-10T06:23:12.839903+0000","last_fullsized":"2024-09-10T06:23:12.839903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854443+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:23:12.854443+0000","last_peered":"2024-09-10T06:23:12.854443+0000","last_clean":"2024-09-10T06:23:12.854443+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:23:12.854443+0000","last_undegraded":"2024-09-10T06:23:12.854443+0000","last_fullsized":"2024-09-10T06:23:12.854443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:04.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":479,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072427+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:25:46.072427+0000","last_peered":"2024-09-10T06:25:46.072427+0000","last_clean":"2024-09-10T06:25:46.072427+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:25:46.072427+0000","last_undegraded":"2024-09-10T06:25:46.072427+0000","last_fullsized":"2024-09-10T06:25:46.072427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:21.390056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838597+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:23:12.838597+0000","last_peered":"2024-09-10T06:23:12.838597+0000","last_clean":"2024-09-10T06:23:12.838597+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:23:12.838597+0000","last_undegraded":"2024-09-10T06:23:12.838597+0000","last_fullsized":"2024-09-10T06:23:12.838597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:35.775780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.379659+0000","last_change":"2024-09-10T06:22:33.830304+0000","last_active":"2024-09-10T06:25:46.379659+0000","last_peered":"2024-09-10T06:25:46.379659+0000","last_clean":"2024-09-10T06:25:46.379659+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:25:46.379659+0000","last_undegraded":"2024-09-10T06:25:46.379659+0000","last_fullsized":"2024-09-10T06:25:46.379659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842861+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:23:12.842861+0000","last_peered":"2024-09-10T06:23:12.842861+0000","last_clean":"2024-09-10T06:23:12.842861+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:23:12.842861+0000","last_undegraded":"2024-09-10T06:23:12.842861+0000","last_fullsized":"2024-09-10T06:23:12.842861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.213105+0000","last_change":"2024-09-10T06:22:31.813555+0000","last_active":"2024-09-10T06:25:46.213105+0000","last_peered":"2024-09-10T06:25:46.213105+0000","last_clean":"2024-09-10T06:25:46.213105+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:25:46.213105+0000","last_undegraded":"2024-09-10T06:25:46.213105+0000","last_fullsized":"2024-09-10T06:25:46.213105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851204+0000","last_change":"2024-09-10T06:22:35.819965+0000","last_active":"2024-09-10T06:23:12.851204+0000","last_peered":"2024-09-10T06:23:12.851204+0000","last_clean":"2024-09-10T06:23:12.851204+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:23:12.851204+0000","last_undegraded":"2024-09-10T06:23:12.851204+0000","last_fullsized":"2024-09-10T06:23:12.851204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:59.563244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.073073+0000","last_change":"2024-09-10T06:22:37.837514+0000","last_active":"2024-09-10T06:25:46.073073+0000","last_peered":"2024-09-10T06:25:46.073073+0000","last_clean":"2024-09-10T06:25:46.073073+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:25:46.073073+0000","last_undegraded":"2024-09-10T06:25:46.073073+0000","last_fullsized":"2024-09-10T06:25:46.073073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:10.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841192+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:23:12.841192+0000","last_peered":"2024-09-10T06:23:12.841192+0000","last_clean":"2024-09-10T06:23:12.841192+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:23:12.841192+0000","last_undegraded":"2024-09-10T06:23:12.841192+0000","last_fullsized":"2024-09-10T06:23:12.841192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:59.799041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380078+0000","last_change":"2024-09-10T06:22:33.843908+0000","last_active":"2024-09-10T06:25:46.380078+0000","last_peered":"2024-09-10T06:25:46.380078+0000","last_clean":"2024-09-10T06:25:46.380078+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:25:46.380078+0000","last_undegraded":"2024-09-10T06:25:46.380078+0000","last_fullsized":"2024-09-10T06:25:46.380078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836895+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:23:12.836895+0000","last_peered":"2024-09-10T06:23:12.836895+0000","last_clean":"2024-09-10T06:23:12.836895+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:23:12.836895+0000","last_undegraded":"2024-09-10T06:23:12.836895+0000","last_fullsized":"2024-09-10T06:23:12.836895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.840931+0000","last_change":"2024-09-10T06:22:31.810277+0000","last_active":"2024-09-10T06:25:45.840931+0000","last_peered":"2024-09-10T06:25:45.840931+0000","last_clean":"2024-09-10T06:25:45.840931+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:25:45.840931+0000","last_undegraded":"2024-09-10T06:25:45.840931+0000","last_fullsized":"2024-09-10T06:25:45.840931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:49.861302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844120+0000","last_change":"2024-09-10T06:22:35.817207+0000","last_active":"2024-09-10T06:23:12.844120+0000","last_peered":"2024-09-10T06:23:12.844120+0000","last_clean":"2024-09-10T06:23:12.844120+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:23:12.844120+0000","last_undegraded":"2024-09-10T06:23:12.844120+0000","last_fullsized":"2024-09-10T06:23:12.844120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:40.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.319710+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.319710+0000","last_peered":"2024-09-10T06:25:45.319710+0000","last_clean":"2024-09-10T06:25:45.319710+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.319710+0000","last_undegraded":"2024-09-10T06:25:45.319710+0000","last_fullsized":"2024-09-10T06:25:45.319710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:52.179158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029340+0000","last_change":"2024-09-10T06:22:33.829247+0000","last_active":"2024-09-10T06:25:46.029340+0000","last_peered":"2024-09-10T06:25:46.029340+0000","last_clean":"2024-09-10T06:25:46.029340+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:25:46.029340+0000","last_undegraded":"2024-09-10T06:25:46.029340+0000","last_fullsized":"2024-09-10T06:25:46.029340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852772+0000","last_change":"2024-09-10T06:22:31.810031+0000","last_active":"2024-09-10T06:23:12.852772+0000","last_peered":"2024-09-10T06:23:12.852772+0000","last_clean":"2024-09-10T06:23:12.852772+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:23:12.852772+0000","last_undegraded":"2024-09-10T06:23:12.852772+0000","last_fullsized":"2024-09-10T06:23:12.852772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:36.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840933+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:23:12.840933+0000","last_peered":"2024-09-10T06:23:12.840933+0000","last_clean":"2024-09-10T06:23:12.840933+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:23:12.840933+0000","last_undegraded":"2024-09-10T06:23:12.840933+0000","last_fullsized":"2024-09-10T06:23:12.840933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.843802+0000","last_change":"2024-09-10T06:22:35.823185+0000","last_active":"2024-09-10T06:24:42.843802+0000","last_peered":"2024-09-10T06:24:42.843802+0000","last_clean":"2024-09-10T06:24:42.843802+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:24:42.843802+0000","last_undegraded":"2024-09-10T06:24:42.843802+0000","last_fullsized":"2024-09-10T06:24:42.843802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:31.666424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.291459+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:24:43.291459+0000","last_peered":"2024-09-10T06:24:43.291459+0000","last_clean":"2024-09-10T06:24:43.291459+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:24:43.291459+0000","last_undegraded":"2024-09-10T06:24:43.291459+0000","last_fullsized":"2024-09-10T06:24:43.291459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.778947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843741+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:23:12.843741+0000","last_peered":"2024-09-10T06:23:12.843741+0000","last_clean":"2024-09-10T06:23:12.843741+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:23:12.843741+0000","last_undegraded":"2024-09-10T06:23:12.843741+0000","last_fullsized":"2024-09-10T06:23:12.843741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:07.724283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029418+0000","last_change":"2024-09-10T06:22:33.828093+0000","last_active":"2024-09-10T06:25:46.029418+0000","last_peered":"2024-09-10T06:25:46.029418+0000","last_clean":"2024-09-10T06:25:46.029418+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:25:46.029418+0000","last_undegraded":"2024-09-10T06:25:46.029418+0000","last_fullsized":"2024-09-10T06:25:46.029418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841646+0000","last_change":"2024-09-10T06:22:31.811783+0000","last_active":"2024-09-10T06:23:12.841646+0000","last_peered":"2024-09-10T06:23:12.841646+0000","last_clean":"2024-09-10T06:23:12.841646+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:23:12.841646+0000","last_undegraded":"2024-09-10T06:23:12.841646+0000","last_fullsized":"2024-09-10T06:23:12.841646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:00.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.697023+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:24:44.697023+0000","last_peered":"2024-09-10T06:24:44.697023+0000","last_clean":"2024-09-10T06:24:44.697023+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:24:44.697023+0000","last_undegraded":"2024-09-10T06:24:44.697023+0000","last_fullsized":"2024-09-10T06:24:44.697023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:58.162966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.404578+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:23:16.404578+0000","last_peered":"2024-09-10T06:23:16.404578+0000","last_clean":"2024-09-10T06:23:16.404578+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:23:16.404578+0000","last_undegraded":"2024-09-10T06:23:16.404578+0000","last_fullsized":"2024-09-10T06:23:16.404578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.073693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":357,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072302+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:25:46.072302+0000","last_peered":"2024-09-10T06:25:46.072302+0000","last_clean":"2024-09-10T06:25:46.072302+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:25:46.072302+0000","last_undegraded":"2024-09-10T06:25:46.072302+0000","last_fullsized":"2024-09-10T06:25:46.072302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:43.131319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226435+0000","last_change":"2024-09-10T06:22:33.835195+0000","last_active":"2024-09-10T06:25:46.226435+0000","last_peered":"2024-09-10T06:25:46.226435+0000","last_clean":"2024-09-10T06:25:46.226435+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:25:46.226435+0000","last_undegraded":"2024-09-10T06:25:46.226435+0000","last_fullsized":"2024-09-10T06:25:46.226435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:25.772911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.857059+0000","last_change":"2024-09-10T06:22:31.819349+0000","last_active":"2024-09-10T06:24:43.857059+0000","last_peered":"2024-09-10T06:24:43.857059+0000","last_clean":"2024-09-10T06:24:43.857059+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:24:43.857059+0000","last_undegraded":"2024-09-10T06:24:43.857059+0000","last_fullsized":"2024-09-10T06:24:43.857059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:40.037975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843900+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:23:12.843900+0000","last_peered":"2024-09-10T06:23:12.843900+0000","last_clean":"2024-09-10T06:23:12.843900+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:23:12.843900+0000","last_undegraded":"2024-09-10T06:23:12.843900+0000","last_fullsized":"2024-09-10T06:23:12.843900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844884+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:23:12.844884+0000","last_peered":"2024-09-10T06:23:12.844884+0000","last_clean":"2024-09-10T06:23:12.844884+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:23:12.844884+0000","last_undegraded":"2024-09-10T06:23:12.844884+0000","last_fullsized":"2024-09-10T06:23:12.844884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.465248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856935+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:24:43.856935+0000","last_peered":"2024-09-10T06:24:43.856935+0000","last_clean":"2024-09-10T06:24:43.856935+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:24:43.856935+0000","last_undegraded":"2024-09-10T06:24:43.856935+0000","last_fullsized":"2024-09-10T06:24:43.856935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:00.801970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.546362+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:25:46.546362+0000","last_peered":"2024-09-10T06:25:46.546362+0000","last_clean":"2024-09-10T06:25:46.546362+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:25:46.546362+0000","last_undegraded":"2024-09-10T06:25:46.546362+0000","last_fullsized":"2024-09-10T06:25:46.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:05.123690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314608+0000","last_change":"2024-09-10T06:22:33.836044+0000","last_active":"2024-09-10T06:25:46.314608+0000","last_peered":"2024-09-10T06:25:46.314608+0000","last_clean":"2024-09-10T06:25:46.314608+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:25:46.314608+0000","last_undegraded":"2024-09-10T06:25:46.314608+0000","last_fullsized":"2024-09-10T06:25:46.314608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:49.616370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863191+0000","last_change":"2024-09-10T06:22:31.817407+0000","last_active":"2024-09-10T06:23:12.863191+0000","last_peered":"2024-09-10T06:23:12.863191+0000","last_clean":"2024-09-10T06:23:12.863191+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:23:12.863191+0000","last_undegraded":"2024-09-10T06:23:12.863191+0000","last_fullsized":"2024-09-10T06:23:12.863191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:59.858776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852491+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:23:12.852491+0000","last_peered":"2024-09-10T06:23:12.852491+0000","last_clean":"2024-09-10T06:23:12.852491+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:23:12.852491+0000","last_undegraded":"2024-09-10T06:23:12.852491+0000","last_fullsized":"2024-09-10T06:23:12.852491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845740+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:23:12.845740+0000","last_peered":"2024-09-10T06:23:12.845740+0000","last_clean":"2024-09-10T06:23:12.845740+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:23:12.845740+0000","last_undegraded":"2024-09-10T06:23:12.845740+0000","last_fullsized":"2024-09-10T06:23:12.845740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:28.571689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'82","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.271773+0000","last_change":"2024-09-10T06:22:37.855099+0000","last_active":"2024-09-10T06:24:43.271773+0000","last_peered":"2024-09-10T06:24:43.271773+0000","last_clean":"2024-09-10T06:24:43.271773+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:24:43.271773+0000","last_undegraded":"2024-09-10T06:24:43.271773+0000","last_fullsized":"2024-09-10T06:24:43.271773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:05.079013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839680+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:23:12.839680+0000","last_peered":"2024-09-10T06:23:12.839680+0000","last_clean":"2024-09-10T06:23:12.839680+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:23:12.839680+0000","last_undegraded":"2024-09-10T06:23:12.839680+0000","last_fullsized":"2024-09-10T06:23:12.839680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:00.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851696+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:23:12.851696+0000","last_peered":"2024-09-10T06:23:12.851696+0000","last_clean":"2024-09-10T06:23:12.851696+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:23:12.851696+0000","last_undegraded":"2024-09-10T06:23:12.851696+0000","last_fullsized":"2024-09-10T06:23:12.851696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:18.366509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848875+0000","last_change":"2024-09-10T06:22:33.835614+0000","last_active":"2024-09-10T06:23:16.848875+0000","last_peered":"2024-09-10T06:23:16.848875+0000","last_clean":"2024-09-10T06:23:16.848875+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:23:16.848875+0000","last_undegraded":"2024-09-10T06:23:16.848875+0000","last_fullsized":"2024-09-10T06:23:16.848875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:36.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838231+0000","last_change":"2024-09-10T06:22:31.830987+0000","last_active":"2024-09-10T06:23:12.838231+0000","last_peered":"2024-09-10T06:23:12.838231+0000","last_clean":"2024-09-10T06:23:12.838231+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:23:12.838231+0000","last_undegraded":"2024-09-10T06:23:12.838231+0000","last_fullsized":"2024-09-10T06:23:12.838231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:06.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842492+0000","last_change":"2024-09-10T06:22:35.832868+0000","last_active":"2024-09-10T06:23:12.842492+0000","last_peered":"2024-09-10T06:23:12.842492+0000","last_clean":"2024-09-10T06:23:12.842492+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:23:12.842492+0000","last_undegraded":"2024-09-10T06:23:12.842492+0000","last_fullsized":"2024-09-10T06:23:12.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:22:51.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.279468+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:24:43.279468+0000","last_peered":"2024-09-10T06:24:43.279468+0000","last_clean":"2024-09-10T06:24:43.279468+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:24:43.279468+0000","last_undegraded":"2024-09-10T06:24:43.279468+0000","last_fullsized":"2024-09-10T06:24:43.279468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.872559+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.872559+0000","last_peered":"2024-09-10T06:24:42.872559+0000","last_clean":"2024-09-10T06:24:42.872559+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.872559+0000","last_undegraded":"2024-09-10T06:24:42.872559+0000","last_fullsized":"2024-09-10T06:24:42.872559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:14.600789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851337+0000","last_change":"2024-09-10T06:22:33.828670+0000","last_active":"2024-09-10T06:24:52.851337+0000","last_peered":"2024-09-10T06:24:52.851337+0000","last_clean":"2024-09-10T06:24:52.851337+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:24:52.851337+0000","last_undegraded":"2024-09-10T06:24:52.851337+0000","last_fullsized":"2024-09-10T06:24:52.851337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:58.876540+0000","last_change":"2024-09-10T06:22:31.834212+0000","last_active":"2024-09-10T06:24:58.876540+0000","last_peered":"2024-09-10T06:24:58.876540+0000","last_clean":"2024-09-10T06:24:58.876540+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:24:58.876540+0000","last_undegraded":"2024-09-10T06:24:58.876540+0000","last_fullsized":"2024-09-10T06:24:58.876540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:50.883361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427517+0000","last_change":"2024-09-10T06:22:33.817684+0000","last_active":"2024-09-10T06:24:00.427517+0000","last_peered":"2024-09-10T06:24:00.427517+0000","last_clean":"2024-09-10T06:24:00.427517+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:24:00.427517+0000","last_undegraded":"2024-09-10T06:24:00.427517+0000","last_fullsized":"2024-09-10T06:24:00.427517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.801071+0000","last_change":"2024-09-10T06:22:31.823765+0000","last_active":"2024-09-10T06:25:45.801071+0000","last_peered":"2024-09-10T06:25:45.801071+0000","last_clean":"2024-09-10T06:25:45.801071+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:25:45.801071+0000","last_undegraded":"2024-09-10T06:25:45.801071+0000","last_fullsized":"2024-09-10T06:25:45.801071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:55.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839169+0000","last_change":"2024-09-10T06:22:35.831394+0000","last_active":"2024-09-10T06:23:12.839169+0000","last_peered":"2024-09-10T06:23:12.839169+0000","last_clean":"2024-09-10T06:23:12.839169+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:23:12.839169+0000","last_undegraded":"2024-09-10T06:23:12.839169+0000","last_fullsized":"2024-09-10T06:23:12.839169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:22.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.412051+0000","last_change":"2024-09-10T06:22:37.836553+0000","last_active":"2024-09-10T06:25:45.412051+0000","last_peered":"2024-09-10T06:25:45.412051+0000","last_clean":"2024-09-10T06:25:45.412051+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:25:45.412051+0000","last_undegraded":"2024-09-10T06:25:45.412051+0000","last_fullsized":"2024-09-10T06:25:45.412051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:24.462240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226226+0000","last_change":"2024-09-10T06:22:33.837182+0000","last_active":"2024-09-10T06:25:46.226226+0000","last_peered":"2024-09-10T06:25:46.226226+0000","last_clean":"2024-09-10T06:25:46.226226+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:25:46.226226+0000","last_undegraded":"2024-09-10T06:25:46.226226+0000","last_fullsized":"2024-09-10T06:25:46.226226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:14.784269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.144585+0000","last_change":"2024-09-10T06:22:31.824675+0000","last_active":"2024-09-10T06:24:00.144585+0000","last_peered":"2024-09-10T06:24:00.144585+0000","last_clean":"2024-09-10T06:24:00.144585+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:24:00.144585+0000","last_undegraded":"2024-09-10T06:24:00.144585+0000","last_fullsized":"2024-09-10T06:24:00.144585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:27.214452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.260507+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:24:43.260507+0000","last_peered":"2024-09-10T06:24:43.260507+0000","last_clean":"2024-09-10T06:24:43.260507+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:24:43.260507+0000","last_undegraded":"2024-09-10T06:24:43.260507+0000","last_fullsized":"2024-09-10T06:24:43.260507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156644+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:00.156644+0000","last_peered":"2024-09-10T06:24:00.156644+0000","last_clean":"2024-09-10T06:24:00.156644+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:00.156644+0000","last_undegraded":"2024-09-10T06:24:00.156644+0000","last_fullsized":"2024-09-10T06:24:00.156644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:18.678529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835895+0000","last_change":"2024-09-10T06:22:31.835963+0000","last_active":"2024-09-10T06:23:12.835895+0000","last_peered":"2024-09-10T06:23:12.835895+0000","last_clean":"2024-09-10T06:23:12.835895+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:23:12.835895+0000","last_undegraded":"2024-09-10T06:23:12.835895+0000","last_fullsized":"2024-09-10T06:23:12.835895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:44.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:21.069402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.287272+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:24:43.287272+0000","last_peered":"2024-09-10T06:24:43.287272+0000","last_clean":"2024-09-10T06:24:43.287272+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:24:43.287272+0000","last_undegraded":"2024-09-10T06:24:43.287272+0000","last_fullsized":"2024-09-10T06:24:43.287272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.193472+0000","last_change":"2024-09-10T06:22:33.820528+0000","last_active":"2024-09-10T06:23:17.193472+0000","last_peered":"2024-09-10T06:23:17.193472+0000","last_clean":"2024-09-10T06:23:17.193472+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:23:17.193472+0000","last_undegraded":"2024-09-10T06:23:17.193472+0000","last_fullsized":"2024-09-10T06:23:17.193472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.199119+0000","last_change":"2024-09-10T06:22:31.824951+0000","last_active":"2024-09-10T06:25:46.199119+0000","last_peered":"2024-09-10T06:25:46.199119+0000","last_clean":"2024-09-10T06:25:46.199119+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:25:46.199119+0000","last_undegraded":"2024-09-10T06:25:46.199119+0000","last_fullsized":"2024-09-10T06:25:46.199119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:35.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.695966+0000","last_change":"2024-09-10T06:22:35.819614+0000","last_active":"2024-09-10T06:24:44.695966+0000","last_peered":"2024-09-10T06:24:44.695966+0000","last_clean":"2024-09-10T06:24:44.695966+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:24:44.695966+0000","last_undegraded":"2024-09-10T06:24:44.695966+0000","last_fullsized":"2024-09-10T06:24:44.695966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.909257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.261561+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:24:43.261561+0000","last_peered":"2024-09-10T06:24:43.261561+0000","last_clean":"2024-09-10T06:24:43.261561+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:24:43.261561+0000","last_undegraded":"2024-09-10T06:24:43.261561+0000","last_fullsized":"2024-09-10T06:24:43.261561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841976+0000","last_change":"2024-09-10T06:22:31.798967+0000","last_active":"2024-09-10T06:23:12.841976+0000","last_peered":"2024-09-10T06:23:12.841976+0000","last_clean":"2024-09-10T06:23:12.841976+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:23:12.841976+0000","last_undegraded":"2024-09-10T06:23:12.841976+0000","last_fullsized":"2024-09-10T06:23:12.841976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:44.941111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849600+0000","last_change":"2024-09-10T06:22:35.823165+0000","last_active":"2024-09-10T06:23:12.849600+0000","last_peered":"2024-09-10T06:23:12.849600+0000","last_clean":"2024-09-10T06:23:12.849600+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:23:12.849600+0000","last_undegraded":"2024-09-10T06:23:12.849600+0000","last_fullsized":"2024-09-10T06:23:12.849600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:33.329366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.855428+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:24:42.855428+0000","last_peered":"2024-09-10T06:24:42.855428+0000","last_clean":"2024-09-10T06:24:42.855428+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:24:42.855428+0000","last_undegraded":"2024-09-10T06:24:42.855428+0000","last_fullsized":"2024-09-10T06:24:42.855428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:01.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840875+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:23:12.840875+0000","last_peered":"2024-09-10T06:23:12.840875+0000","last_clean":"2024-09-10T06:23:12.840875+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:23:12.840875+0000","last_undegraded":"2024-09-10T06:23:12.840875+0000","last_fullsized":"2024-09-10T06:23:12.840875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:38.216965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.103075+0000","last_change":"2024-09-10T06:22:33.843181+0000","last_active":"2024-09-10T06:24:41.103075+0000","last_peered":"2024-09-10T06:24:41.103075+0000","last_clean":"2024-09-10T06:24:41.103075+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:24:41.103075+0000","last_undegraded":"2024-09-10T06:24:41.103075+0000","last_fullsized":"2024-09-10T06:24:41.103075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.994437+0000","last_change":"2024-09-10T06:22:31.819223+0000","last_active":"2024-09-10T06:24:44.994437+0000","last_peered":"2024-09-10T06:24:44.994437+0000","last_clean":"2024-09-10T06:24:44.994437+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:24:44.994437+0000","last_undegraded":"2024-09-10T06:24:44.994437+0000","last_fullsized":"2024-09-10T06:24:44.994437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:27.515537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843413+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:23:12.843413+0000","last_peered":"2024-09-10T06:23:12.843413+0000","last_clean":"2024-09-10T06:23:12.843413+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:23:12.843413+0000","last_undegraded":"2024-09-10T06:23:12.843413+0000","last_fullsized":"2024-09-10T06:23:12.843413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:11.280056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.395265+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:25:46.395265+0000","last_peered":"2024-09-10T06:25:46.395265+0000","last_clean":"2024-09-10T06:25:46.395265+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:25:46.395265+0000","last_undegraded":"2024-09-10T06:25:46.395265+0000","last_fullsized":"2024-09-10T06:25:46.395265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:40.193573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.877644+0000","last_change":"2024-09-10T06:22:33.840970+0000","last_active":"2024-09-10T06:25:03.877644+0000","last_peered":"2024-09-10T06:25:03.877644+0000","last_clean":"2024-09-10T06:25:03.877644+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:25:03.877644+0000","last_undegraded":"2024-09-10T06:25:03.877644+0000","last_fullsized":"2024-09-10T06:25:03.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:08.529180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:02.853853+0000","last_change":"2024-09-10T06:22:31.827656+0000","last_active":"2024-09-10T06:25:02.853853+0000","last_peered":"2024-09-10T06:25:02.853853+0000","last_clean":"2024-09-10T06:25:02.853853+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:25:02.853853+0000","last_undegraded":"2024-09-10T06:25:02.853853+0000","last_fullsized":"2024-09-10T06:25:02.853853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.248336+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:24:43.248336+0000","last_peered":"2024-09-10T06:24:43.248336+0000","last_clean":"2024-09-10T06:24:43.248336+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:24:43.248336+0000","last_undegraded":"2024-09-10T06:24:43.248336+0000","last_fullsized":"2024-09-10T06:24:43.248336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380753+0000","last_change":"2024-09-10T06:22:33.836076+0000","last_active":"2024-09-10T06:25:46.380753+0000","last_peered":"2024-09-10T06:25:46.380753+0000","last_clean":"2024-09-10T06:25:46.380753+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:25:46.380753+0000","last_undegraded":"2024-09-10T06:25:46.380753+0000","last_fullsized":"2024-09-10T06:25:46.380753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:36.039957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.862928+0000","last_change":"2024-09-10T06:22:31.836769+0000","last_active":"2024-09-10T06:25:03.862928+0000","last_peered":"2024-09-10T06:25:03.862928+0000","last_clean":"2024-09-10T06:25:03.862928+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:25:03.862928+0000","last_undegraded":"2024-09-10T06:25:03.862928+0000","last_fullsized":"2024-09-10T06:25:03.862928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:26.478355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850533+0000","last_change":"2024-09-10T06:22:35.826620+0000","last_active":"2024-09-10T06:23:12.850533+0000","last_peered":"2024-09-10T06:23:12.850533+0000","last_clean":"2024-09-10T06:23:12.850533+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:23:12.850533+0000","last_undegraded":"2024-09-10T06:23:12.850533+0000","last_fullsized":"2024-09-10T06:23:12.850533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:41.740450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.249824+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:24:43.249824+0000","last_peered":"2024-09-10T06:24:43.249824+0000","last_clean":"2024-09-10T06:24:43.249824+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:24:43.249824+0000","last_undegraded":"2024-09-10T06:24:43.249824+0000","last_fullsized":"2024-09-10T06:24:43.249824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.153703+0000","last_change":"2024-09-10T06:22:31.812723+0000","last_active":"2024-09-10T06:23:17.153703+0000","last_peered":"2024-09-10T06:23:17.153703+0000","last_clean":"2024-09-10T06:23:17.153703+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:23:17.153703+0000","last_undegraded":"2024-09-10T06:23:17.153703+0000","last_fullsized":"2024-09-10T06:23:17.153703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:06.179051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:08.864204+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:25:08.864204+0000","last_peered":"2024-09-10T06:25:08.864204+0000","last_clean":"2024-09-10T06:25:08.864204+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:25:08.864204+0000","last_undegraded":"2024-09-10T06:25:08.864204+0000","last_fullsized":"2024-09-10T06:25:08.864204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226520+0000","last_change":"2024-09-10T06:22:33.841332+0000","last_active":"2024-09-10T06:25:46.226520+0000","last_peered":"2024-09-10T06:25:46.226520+0000","last_clean":"2024-09-10T06:25:46.226520+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:25:46.226520+0000","last_undegraded":"2024-09-10T06:25:46.226520+0000","last_fullsized":"2024-09-10T06:25:46.226520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:29.424851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.183187+0000","last_change":"2024-09-10T06:22:31.803970+0000","last_active":"2024-09-10T06:25:46.183187+0000","last_peered":"2024-09-10T06:25:46.183187+0000","last_clean":"2024-09-10T06:25:46.183187+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:25:46.183187+0000","last_undegraded":"2024-09-10T06:25:46.183187+0000","last_fullsized":"2024-09-10T06:25:46.183187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.330768+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:25:45.330768+0000","last_peered":"2024-09-10T06:25:45.330768+0000","last_clean":"2024-09-10T06:25:45.330768+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:25:45.330768+0000","last_undegraded":"2024-09-10T06:25:45.330768+0000","last_fullsized":"2024-09-10T06:25:45.330768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.867864+0000","last_change":"2024-09-10T06:22:33.832724+0000","last_active":"2024-09-10T06:23:12.867864+0000","last_peered":"2024-09-10T06:23:12.867864+0000","last_clean":"2024-09-10T06:23:12.867864+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:23:12.867864+0000","last_undegraded":"2024-09-10T06:23:12.867864+0000","last_fullsized":"2024-09-10T06:23:12.867864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:20.127030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.872156+0000","last_change":"2024-09-10T06:22:31.809134+0000","last_active":"2024-09-10T06:24:38.872156+0000","last_peered":"2024-09-10T06:24:38.872156+0000","last_clean":"2024-09-10T06:24:38.872156+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:24:38.872156+0000","last_undegraded":"2024-09-10T06:24:38.872156+0000","last_fullsized":"2024-09-10T06:24:38.872156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:03.278295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.225482+0000","last_change":"2024-09-10T06:22:33.842763+0000","last_active":"2024-09-10T06:25:46.225482+0000","last_peered":"2024-09-10T06:25:46.225482+0000","last_clean":"2024-09-10T06:25:46.225482+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:25:46.225482+0000","last_undegraded":"2024-09-10T06:25:46.225482+0000","last_fullsized":"2024-09-10T06:25:46.225482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838799+0000","last_change":"2024-09-10T06:22:31.809874+0000","last_active":"2024-09-10T06:23:12.838799+0000","last_peered":"2024-09-10T06:23:12.838799+0000","last_clean":"2024-09-10T06:23:12.838799+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:23:12.838799+0000","last_undegraded":"2024-09-10T06:23:12.838799+0000","last_fullsized":"2024-09-10T06:23:12.838799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380807+0000","last_change":"2024-09-10T06:23:12.866962+0000","last_active":"2024-09-10T06:25:46.380807+0000","last_peered":"2024-09-10T06:25:46.380807+0000","last_clean":"2024-09-10T06:25:46.380807+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:25:46.380807+0000","last_undegraded":"2024-09-10T06:25:46.380807+0000","last_fullsized":"2024-09-10T06:25:46.380807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.062389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842517+0000","last_change":"2024-09-10T06:22:31.831565+0000","last_active":"2024-09-10T06:23:12.842517+0000","last_peered":"2024-09-10T06:23:12.842517+0000","last_clean":"2024-09-10T06:23:12.842517+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:23:12.842517+0000","last_undegraded":"2024-09-10T06:23:12.842517+0000","last_fullsized":"2024-09-10T06:23:12.842517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.130643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427522+0000","last_change":"2024-09-10T06:22:33.843784+0000","last_active":"2024-09-10T06:24:00.427522+0000","last_peered":"2024-09-10T06:24:00.427522+0000","last_clean":"2024-09-10T06:24:00.427522+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:24:00.427522+0000","last_undegraded":"2024-09-10T06:24:00.427522+0000","last_fullsized":"2024-09-10T06:24:00.427522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:08.793382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.413251+0000","last_change":"2024-09-10T06:22:31.813752+0000","last_active":"2024-09-10T06:24:00.413251+0000","last_peered":"2024-09-10T06:24:00.413251+0000","last_clean":"2024-09-10T06:24:00.413251+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:24:00.413251+0000","last_undegraded":"2024-09-10T06:24:00.413251+0000","last_fullsized":"2024-09-10T06:24:00.413251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:46.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380014+0000","last_change":"2024-09-10T06:22:33.818286+0000","last_active":"2024-09-10T06:25:46.380014+0000","last_peered":"2024-09-10T06:25:46.380014+0000","last_clean":"2024-09-10T06:25:46.380014+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:25:46.380014+0000","last_undegraded":"2024-09-10T06:25:46.380014+0000","last_fullsized":"2024-09-10T06:25:46.380014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841898+0000","last_change":"2024-09-10T06:22:31.809970+0000","last_active":"2024-09-10T06:23:12.841898+0000","last_peered":"2024-09-10T06:23:12.841898+0000","last_clean":"2024-09-10T06:23:12.841898+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:23:12.841898+0000","last_undegraded":"2024-09-10T06:23:12.841898+0000","last_fullsized":"2024-09-10T06:23:12.841898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:42.775634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.316095+0000","last_change":"2024-09-10T06:22:33.832194+0000","last_active":"2024-09-10T06:25:46.316095+0000","last_peered":"2024-09-10T06:25:46.316095+0000","last_clean":"2024-09-10T06:25:46.316095+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:25:46.316095+0000","last_undegraded":"2024-09-10T06:25:46.316095+0000","last_fullsized":"2024-09-10T06:25:46.316095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858710+0000","last_change":"2024-09-10T06:22:31.833838+0000","last_active":"2024-09-10T06:23:12.858710+0000","last_peered":"2024-09-10T06:23:12.858710+0000","last_clean":"2024-09-10T06:23:12.858710+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:23:12.858710+0000","last_undegraded":"2024-09-10T06:23:12.858710+0000","last_fullsized":"2024-09-10T06:23:12.858710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314627+0000","last_change":"2024-09-10T06:22:33.820714+0000","last_active":"2024-09-10T06:25:46.314627+0000","last_peered":"2024-09-10T06:25:46.314627+0000","last_clean":"2024-09-10T06:25:46.314627+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:25:46.314627+0000","last_undegraded":"2024-09-10T06:25:46.314627+0000","last_fullsized":"2024-09-10T06:25:46.314627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:18.899048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848587+0000","last_change":"2024-09-10T06:22:31.833522+0000","last_active":"2024-09-10T06:23:12.848587+0000","last_peered":"2024-09-10T06:23:12.848587+0000","last_clean":"2024-09-10T06:23:12.848587+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:23:12.848587+0000","last_undegraded":"2024-09-10T06:23:12.848587+0000","last_fullsized":"2024-09-10T06:23:12.848587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:11.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028535+0000","last_change":"2024-09-10T06:22:33.822155+0000","last_active":"2024-09-10T06:25:46.028535+0000","last_peered":"2024-09-10T06:25:46.028535+0000","last_clean":"2024-09-10T06:25:46.028535+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:25:46.028535+0000","last_undegraded":"2024-09-10T06:25:46.028535+0000","last_fullsized":"2024-09-10T06:25:46.028535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842016+0000","last_change":"2024-09-10T06:22:31.809583+0000","last_active":"2024-09-10T06:23:12.842016+0000","last_peered":"2024-09-10T06:23:12.842016+0000","last_clean":"2024-09-10T06:23:12.842016+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:23:12.842016+0000","last_undegraded":"2024-09-10T06:23:12.842016+0000","last_fullsized":"2024-09-10T06:23:12.842016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:53.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'15","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851583+0000","last_change":"2024-09-10T06:22:33.844903+0000","last_active":"2024-09-10T06:24:52.851583+0000","last_peered":"2024-09-10T06:24:52.851583+0000","last_clean":"2024-09-10T06:24:52.851583+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:24:52.851583+0000","last_undegraded":"2024-09-10T06:24:52.851583+0000","last_fullsized":"2024-09-10T06:24:52.851583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:16.098280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.564147+0000","last_change":"2024-09-10T06:22:31.828487+0000","last_active":"2024-09-10T06:23:15.564147+0000","last_peered":"2024-09-10T06:23:15.564147+0000","last_clean":"2024-09-10T06:23:15.564147+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:23:15.564147+0000","last_undegraded":"2024-09-10T06:23:15.564147+0000","last_fullsized":"2024-09-10T06:23:15.564147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:47.707056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563325+0000","last_change":"2024-09-10T06:22:31.813099+0000","last_active":"2024-09-10T06:23:15.563325+0000","last_peered":"2024-09-10T06:23:15.563325+0000","last_clean":"2024-09-10T06:23:15.563325+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:23:15.563325+0000","last_undegraded":"2024-09-10T06:23:15.563325+0000","last_fullsized":"2024-09-10T06:23:15.563325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.402083+0000","last_change":"2024-09-10T06:22:33.818285+0000","last_active":"2024-09-10T06:23:16.402083+0000","last_peered":"2024-09-10T06:23:16.402083+0000","last_clean":"2024-09-10T06:23:16.402083+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:23:16.402083+0000","last_undegraded":"2024-09-10T06:23:16.402083+0000","last_fullsized":"2024-09-10T06:23:16.402083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.081113+0000","last_change":"2024-09-10T06:22:31.812762+0000","last_active":"2024-09-10T06:24:41.081113+0000","last_peered":"2024-09-10T06:24:41.081113+0000","last_clean":"2024-09-10T06:24:41.081113+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:24:41.081113+0000","last_undegraded":"2024-09-10T06:24:41.081113+0000","last_fullsized":"2024-09-10T06:24:41.081113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:32.725312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.910497+0000","last_change":"2024-09-10T06:22:33.811540+0000","last_active":"2024-09-10T06:25:45.910497+0000","last_peered":"2024-09-10T06:25:45.910497+0000","last_clean":"2024-09-10T06:25:45.910497+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:25:45.910497+0000","last_undegraded":"2024-09-10T06:25:45.910497+0000","last_fullsized":"2024-09-10T06:25:45.910497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:40.528357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845567+0000","last_change":"2024-09-10T06:22:31.811935+0000","last_active":"2024-09-10T06:23:12.845567+0000","last_peered":"2024-09-10T06:23:12.845567+0000","last_clean":"2024-09-10T06:23:12.845567+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:23:12.845567+0000","last_undegraded":"2024-09-10T06:23:12.845567+0000","last_fullsized":"2024-09-10T06:23:12.845567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315934+0000","last_change":"2024-09-10T06:22:33.828847+0000","last_active":"2024-09-10T06:25:46.315934+0000","last_peered":"2024-09-10T06:25:46.315934+0000","last_clean":"2024-09-10T06:25:46.315934+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:25:46.315934+0000","last_undegraded":"2024-09-10T06:25:46.315934+0000","last_fullsized":"2024-09-10T06:25:46.315934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839176+0000","last_change":"2024-09-10T06:22:31.832535+0000","last_active":"2024-09-10T06:23:12.839176+0000","last_peered":"2024-09-10T06:23:12.839176+0000","last_clean":"2024-09-10T06:23:12.839176+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:23:12.839176+0000","last_undegraded":"2024-09-10T06:23:12.839176+0000","last_fullsized":"2024-09-10T06:23:12.839176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:34.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315089+0000","last_change":"2024-09-10T06:22:33.845847+0000","last_active":"2024-09-10T06:25:46.315089+0000","last_peered":"2024-09-10T06:25:46.315089+0000","last_clean":"2024-09-10T06:25:46.315089+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:25:46.315089+0000","last_undegraded":"2024-09-10T06:25:46.315089+0000","last_fullsized":"2024-09-10T06:25:46.315089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848612+0000","last_change":"2024-09-10T06:22:31.838658+0000","last_active":"2024-09-10T06:23:12.848612+0000","last_peered":"2024-09-10T06:23:12.848612+0000","last_clean":"2024-09-10T06:23:12.848612+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:23:12.848612+0000","last_undegraded":"2024-09-10T06:23:12.848612+0000","last_fullsized":"2024-09-10T06:23:12.848612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:56.723910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848557+0000","last_change":"2024-09-10T06:23:12.871593+0000","last_active":"2024-09-10T06:23:16.848557+0000","last_peered":"2024-09-10T06:23:16.848557+0000","last_clean":"2024-09-10T06:23:16.848557+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:23:16.848557+0000","last_undegraded":"2024-09-10T06:23:16.848557+0000","last_fullsized":"2024-09-10T06:23:16.848557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.458403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848766+0000","last_change":"2024-09-10T06:22:31.832744+0000","last_active":"2024-09-10T06:23:12.848766+0000","last_peered":"2024-09-10T06:23:12.848766+0000","last_clean":"2024-09-10T06:23:12.848766+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:23:12.848766+0000","last_undegraded":"2024-09-10T06:23:12.848766+0000","last_fullsized":"2024-09-10T06:23:12.848766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:59.824161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849028+0000","last_change":"2024-09-10T06:22:33.824001+0000","last_active":"2024-09-10T06:24:42.849028+0000","last_peered":"2024-09-10T06:24:42.849028+0000","last_clean":"2024-09-10T06:24:42.849028+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:24:42.849028+0000","last_undegraded":"2024-09-10T06:24:42.849028+0000","last_fullsized":"2024-09-10T06:24:42.849028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:04.705910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.190954+0000","last_change":"2024-09-10T06:22:31.828589+0000","last_active":"2024-09-10T06:25:46.190954+0000","last_peered":"2024-09-10T06:25:46.190954+0000","last_clean":"2024-09-10T06:25:46.190954+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:25:46.190954+0000","last_undegraded":"2024-09-10T06:25:46.190954+0000","last_fullsized":"2024-09-10T06:25:46.190954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:13.166658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836407+0000","last_change":"2024-09-10T06:22:31.822739+0000","last_active":"2024-09-10T06:23:12.836407+0000","last_peered":"2024-09-10T06:23:12.836407+0000","last_clean":"2024-09-10T06:23:12.836407+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:23:12.836407+0000","last_undegraded":"2024-09-10T06:23:12.836407+0000","last_fullsized":"2024-09-10T06:23:12.836407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:18.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427151+0000","last_change":"2024-09-10T06:22:33.834781+0000","last_active":"2024-09-10T06:24:00.427151+0000","last_peered":"2024-09-10T06:24:00.427151+0000","last_clean":"2024-09-10T06:24:00.427151+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:24:00.427151+0000","last_undegraded":"2024-09-10T06:24:00.427151+0000","last_fullsized":"2024-09-10T06:24:00.427151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.042356+0000","last_change":"2024-09-10T06:22:31.814239+0000","last_active":"2024-09-10T06:24:45.042356+0000","last_peered":"2024-09-10T06:24:45.042356+0000","last_clean":"2024-09-10T06:24:45.042356+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:24:45.042356+0000","last_undegraded":"2024-09-10T06:24:45.042356+0000","last_fullsized":"2024-09-10T06:24:45.042356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226303+0000","last_change":"2024-09-10T06:22:33.828192+0000","last_active":"2024-09-10T06:25:46.226303+0000","last_peered":"2024-09-10T06:25:46.226303+0000","last_clean":"2024-09-10T06:25:46.226303+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:25:46.226303+0000","last_undegraded":"2024-09-10T06:25:46.226303+0000","last_fullsized":"2024-09-10T06:25:46.226303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:17.430784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56276,"kb_used_data":20932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315564,"statfs":{"total":96636764160,"available":96579137536,"internally_reserved":0,"allocated":21434368,"data_stored":21108121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53324,"kb_used_data":17980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318516,"statfs":{"total":96636764160,"available":96582160384,"internally_reserved":0,"allocated":18411520,"data_stored":18144049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4918891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":9240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":9461760,"data_stored":9165923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:18.572 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T06:26:18.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.723+0000 7fc1833a2640 1 Processor -- start 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc1833a2640 1 -- start start 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc1833a2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc17c111890 0x7fc17c138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc1833a2640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17c1127a0 con 0x7fc17c110da0 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc1833a2640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc17c111fc0 con 0x7fc17c111890 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc18093d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc17c111890 0x7fc17c138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc18113e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc17c110da0 0x7fc17c111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53502/0 (socket says 172.21.15.84:53502) 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc18113e640 1 -- 172.21.15.84:0/2376761814 learned_addr learned my addr 172.21.15.84:0/2376761814 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc18093d640 1 -- 172.21.15.84:0/2376761814 >> v1:172.21.15.84:6789/0 conn(0x7fc17c110da0 legacy=0x7fc17c111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc173fff640 1 -- 172.21.15.84:0/2376761814 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777883497 0 0) 0x7fc17c1127a0 con 0x7fc17c110da0 2024-09-10T06:26:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.727+0000 7fc18093d640 1 -- 172.21.15.84:0/2376761814 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c112b70 con 0x7fc17c111890 2024-09-10T06:26:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc18093d640 1 --2- 172.21.15.84:0/2376761814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c111890 0x7fc17c138ac0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc174009d90 tx=0x7fc17401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e44a1a87e90a6f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc173fff640 1 -- 172.21.15.84:0/2376761814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1740a6640 con 0x7fc17c111890 2024-09-10T06:26:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc173fff640 1 -- 172.21.15.84:0/2376761814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1740a67e0 con 0x7fc17c111890 2024-09-10T06:26:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc173fff640 1 -- 172.21.15.84:0/2376761814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1740a6ae0 con 0x7fc17c111890 2024-09-10T06:26:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 -- 172.21.15.84:0/2376761814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c111890 msgr2=0x7fc17c138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 --2- 172.21.15.84:0/2376761814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c111890 0x7fc17c138ac0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc174009d90 tx=0x7fc17401c8c0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 -- 172.21.15.84:0/2376761814 shutdown_connections 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 --2- 172.21.15.84:0/2376761814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c111890 0x7fc17c138ac0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 -- 172.21.15.84:0/2376761814 >> 172.21.15.84:0/2376761814 conn(0x7fc17c070900 msgr2=0x7fc17c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 -- 172.21.15.84:0/2376761814 shutdown_connections 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.731+0000 7fc1833a2640 1 -- 172.21.15.84:0/2376761814 wait complete. 2024-09-10T06:26:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 Processor -- start 2024-09-10T06:26:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 -- start start 2024-09-10T06:26:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c13ba30 con 0x7fc17c110da0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18113e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18113e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45798/0 (socket says 172.21.15.84:45798) 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18113e640 1 -- 172.21.15.84:0/3730417460 learned_addr learned my addr 172.21.15.84:0/3730417460 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18113e640 1 -- 172.21.15.84:0/3730417460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c115ac0 con 0x7fc17c110da0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18113e640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c3d0 tx=0x7fc17800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc178007410 con 0x7fc17c110da0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1780075d0 con 0x7fc17c110da0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c116750 con 0x7fc17c110da0 2024-09-10T06:26:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc178004960 con 0x7fc17c110da0 2024-09-10T06:26:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c12d540 con 0x7fc17c110da0 2024-09-10T06:26:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc178011070 con 0x7fc17c110da0 2024-09-10T06:26:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c111180 con 0x7fc17c110da0 2024-09-10T06:26:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 0x7fc16003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc17804f220 con 0x7fc17c110da0 2024-09-10T06:26:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.735+0000 7fc18093d640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 0x7fc16003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.739+0000 7fc18093d640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 0x7fc16003d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc1740af000 tx=0x7fc1740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:18.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.739+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc178010d50 con 0x7fc17c110da0 2024-09-10T06:26:18.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.907+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc17c068e50 con 0x7fc16003b1d0 2024-09-10T06:26:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.935+0000 7fc171ffb640 1 -- 172.21.15.84:0/3730417460 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665562 (secure 0 0 0) 0x7fc17c068e50 con 0x7fc16003b1d0 2024-09-10T06:26:18.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:18.951 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 msgr2=0x7fc16003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 0x7fc16003d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc1740af000 tx=0x7fc1740a7000 comp rx=0 tx=0).stop 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 msgr2=0x7fc17c12d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c3d0 tx=0x7fc17800c890 comp rx=0 tx=0).stop 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 shutdown_connections 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fc16003b1d0 0x7fc16003d690 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 --2- 172.21.15.84:0/3730417460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc17c110da0 0x7fc17c12d000 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 >> 172.21.15.84:0/3730417460 conn(0x7fc17c070900 msgr2=0x7fc17c133360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:18.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 shutdown_connections 2024-09-10T06:26:18.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:18.943+0000 7fc1833a2640 1 -- 172.21.15.84:0/3730417460 wait complete. 2024-09-10T06:26:18.968 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-10T06:26:17.863835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4872,"num_read_kb":4458,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198768,"kb_used_data":53232,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288592,"statfs":{"total":386547056640,"available":386343518208,"internally_reserved":0,"allocated":54509568,"data_stored":53336984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006310"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852214+0000","last_change":"2024-09-10T06:22:31.830584+0000","last_active":"2024-09-10T06:23:12.852214+0000","last_peered":"2024-09-10T06:23:12.852214+0000","last_clean":"2024-09-10T06:23:12.852214+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:23:12.852214+0000","last_undegraded":"2024-09-10T06:23:12.852214+0000","last_fullsized":"2024-09-10T06:23:12.852214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:16.702734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380991+0000","last_change":"2024-09-10T06:22:33.833535+0000","last_active":"2024-09-10T06:25:46.380991+0000","last_peered":"2024-09-10T06:25:46.380991+0000","last_clean":"2024-09-10T06:25:46.380991+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:25:46.380991+0000","last_undegraded":"2024-09-10T06:25:46.380991+0000","last_fullsized":"2024-09-10T06:25:46.380991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841367+0000","last_change":"2024-09-10T06:22:31.815930+0000","last_active":"2024-09-10T06:23:12.841367+0000","last_peered":"2024-09-10T06:23:12.841367+0000","last_clean":"2024-09-10T06:23:12.841367+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:23:12.841367+0000","last_undegraded":"2024-09-10T06:23:12.841367+0000","last_fullsized":"2024-09-10T06:23:12.841367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:10.113632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856201+0000","last_change":"2024-09-10T06:22:31.836564+0000","last_active":"2024-09-10T06:24:38.856201+0000","last_peered":"2024-09-10T06:24:38.856201+0000","last_clean":"2024-09-10T06:24:38.856201+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:24:38.856201+0000","last_undegraded":"2024-09-10T06:24:38.856201+0000","last_fullsized":"2024-09-10T06:24:38.856201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:18.259418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847960+0000","last_change":"2024-09-10T06:22:31.806993+0000","last_active":"2024-09-10T06:23:12.847960+0000","last_peered":"2024-09-10T06:23:12.847960+0000","last_clean":"2024-09-10T06:23:12.847960+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:23:12.847960+0000","last_undegraded":"2024-09-10T06:23:12.847960+0000","last_fullsized":"2024-09-10T06:23:12.847960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:10.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.401883+0000","last_change":"2024-09-10T06:23:12.860422+0000","last_active":"2024-09-10T06:25:46.401883+0000","last_peered":"2024-09-10T06:25:46.401883+0000","last_clean":"2024-09-10T06:25:46.401883+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:25:46.401883+0000","last_undegraded":"2024-09-10T06:25:46.401883+0000","last_fullsized":"2024-09-10T06:25:46.401883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:40.359356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838331+0000","last_change":"2024-09-10T06:22:31.826279+0000","last_active":"2024-09-10T06:23:12.838331+0000","last_peered":"2024-09-10T06:23:12.838331+0000","last_clean":"2024-09-10T06:23:12.838331+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:23:12.838331+0000","last_undegraded":"2024-09-10T06:23:12.838331+0000","last_fullsized":"2024-09-10T06:23:12.838331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:26.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.313495+0000","last_change":"2024-09-10T06:22:33.812237+0000","last_active":"2024-09-10T06:25:46.313495+0000","last_peered":"2024-09-10T06:25:46.313495+0000","last_clean":"2024-09-10T06:25:46.313495+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:25:46.313495+0000","last_undegraded":"2024-09-10T06:25:46.313495+0000","last_fullsized":"2024-09-10T06:25:46.313495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.206290+0000","last_change":"2024-09-10T06:22:31.809080+0000","last_active":"2024-09-10T06:25:46.206290+0000","last_peered":"2024-09-10T06:25:46.206290+0000","last_clean":"2024-09-10T06:25:46.206290+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:25:46.206290+0000","last_undegraded":"2024-09-10T06:25:46.206290+0000","last_fullsized":"2024-09-10T06:25:46.206290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:43.483133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843973+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:23:12.843973+0000","last_peered":"2024-09-10T06:23:12.843973+0000","last_clean":"2024-09-10T06:23:12.843973+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:23:12.843973+0000","last_undegraded":"2024-09-10T06:23:12.843973+0000","last_fullsized":"2024-09-10T06:23:12.843973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:50.427247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838841+0000","last_change":"2024-09-10T06:22:31.828678+0000","last_active":"2024-09-10T06:23:12.838841+0000","last_peered":"2024-09-10T06:23:12.838841+0000","last_clean":"2024-09-10T06:23:12.838841+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:23:12.838841+0000","last_undegraded":"2024-09-10T06:23:12.838841+0000","last_fullsized":"2024-09-10T06:23:12.838841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:33.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.426746+0000","last_change":"2024-09-10T06:22:33.841656+0000","last_active":"2024-09-10T06:24:00.426746+0000","last_peered":"2024-09-10T06:24:00.426746+0000","last_clean":"2024-09-10T06:24:00.426746+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:24:00.426746+0000","last_undegraded":"2024-09-10T06:24:00.426746+0000","last_fullsized":"2024-09-10T06:24:00.426746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.423672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.870547+0000","last_change":"2024-09-10T06:23:12.869310+0000","last_active":"2024-09-10T06:23:12.870547+0000","last_peered":"2024-09-10T06:23:12.870547+0000","last_clean":"2024-09-10T06:23:12.870547+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:23:12.870547+0000","last_undegraded":"2024-09-10T06:23:12.870547+0000","last_fullsized":"2024-09-10T06:23:12.870547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:34.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.027326+0000","last_change":"2024-09-10T06:23:12.857760+0000","last_active":"2024-09-10T06:25:46.027326+0000","last_peered":"2024-09-10T06:25:46.027326+0000","last_clean":"2024-09-10T06:25:46.027326+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:25:46.027326+0000","last_undegraded":"2024-09-10T06:25:46.027326+0000","last_fullsized":"2024-09-10T06:25:46.027326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.942980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.864475+0000","last_change":"2024-09-10T06:22:31.832009+0000","last_active":"2024-09-10T06:23:12.864475+0000","last_peered":"2024-09-10T06:23:12.864475+0000","last_clean":"2024-09-10T06:23:12.864475+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:23:12.864475+0000","last_undegraded":"2024-09-10T06:23:12.864475+0000","last_fullsized":"2024-09-10T06:23:12.864475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028692+0000","last_change":"2024-09-10T06:22:33.844939+0000","last_active":"2024-09-10T06:25:46.028692+0000","last_peered":"2024-09-10T06:25:46.028692+0000","last_clean":"2024-09-10T06:25:46.028692+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:25:46.028692+0000","last_undegraded":"2024-09-10T06:25:46.028692+0000","last_fullsized":"2024-09-10T06:25:46.028692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:54.074106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849914+0000","last_change":"2024-09-10T06:22:31.833253+0000","last_active":"2024-09-10T06:23:12.849914+0000","last_peered":"2024-09-10T06:23:12.849914+0000","last_clean":"2024-09-10T06:23:12.849914+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:23:12.849914+0000","last_undegraded":"2024-09-10T06:23:12.849914+0000","last_fullsized":"2024-09-10T06:23:12.849914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:12.255366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226464+0000","last_change":"2024-09-10T06:22:33.841628+0000","last_active":"2024-09-10T06:25:46.226464+0000","last_peered":"2024-09-10T06:25:46.226464+0000","last_clean":"2024-09-10T06:25:46.226464+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:25:46.226464+0000","last_undegraded":"2024-09-10T06:25:46.226464+0000","last_fullsized":"2024-09-10T06:25:46.226464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.857466+0000","last_change":"2024-09-10T06:22:31.828028+0000","last_active":"2024-09-10T06:23:12.857466+0000","last_peered":"2024-09-10T06:23:12.857466+0000","last_clean":"2024-09-10T06:23:12.857466+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:23:12.857466+0000","last_undegraded":"2024-09-10T06:23:12.857466+0000","last_fullsized":"2024-09-10T06:23:12.857466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.372084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026158+0000","last_change":"2024-09-10T06:22:33.822953+0000","last_active":"2024-09-10T06:25:46.026158+0000","last_peered":"2024-09-10T06:25:46.026158+0000","last_clean":"2024-09-10T06:25:46.026158+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:25:46.026158+0000","last_undegraded":"2024-09-10T06:25:46.026158+0000","last_fullsized":"2024-09-10T06:25:46.026158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.856102+0000","last_change":"2024-09-10T06:22:31.803614+0000","last_active":"2024-09-10T06:23:12.856102+0000","last_peered":"2024-09-10T06:23:12.856102+0000","last_clean":"2024-09-10T06:23:12.856102+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:23:12.856102+0000","last_undegraded":"2024-09-10T06:23:12.856102+0000","last_fullsized":"2024-09-10T06:23:12.856102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.894566+0000","last_change":"2024-09-10T06:22:33.841481+0000","last_active":"2024-09-10T06:25:45.894566+0000","last_peered":"2024-09-10T06:25:45.894566+0000","last_clean":"2024-09-10T06:25:45.894566+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:25:45.894566+0000","last_undegraded":"2024-09-10T06:25:45.894566+0000","last_fullsized":"2024-09-10T06:25:45.894566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:07.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844594+0000","last_change":"2024-09-10T06:22:31.814700+0000","last_active":"2024-09-10T06:23:12.844594+0000","last_peered":"2024-09-10T06:23:12.844594+0000","last_clean":"2024-09-10T06:23:12.844594+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:23:12.844594+0000","last_undegraded":"2024-09-10T06:23:12.844594+0000","last_fullsized":"2024-09-10T06:23:12.844594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.299397+0000","last_change":"2024-09-10T06:22:33.818692+0000","last_active":"2024-09-10T06:24:45.299397+0000","last_peered":"2024-09-10T06:24:45.299397+0000","last_clean":"2024-09-10T06:24:45.299397+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:24:45.299397+0000","last_undegraded":"2024-09-10T06:24:45.299397+0000","last_fullsized":"2024-09-10T06:24:45.299397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.049587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.562583+0000","last_change":"2024-09-10T06:22:31.830265+0000","last_active":"2024-09-10T06:23:15.562583+0000","last_peered":"2024-09-10T06:23:15.562583+0000","last_clean":"2024-09-10T06:23:15.562583+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:23:15.562583+0000","last_undegraded":"2024-09-10T06:23:15.562583+0000","last_fullsized":"2024-09-10T06:23:15.562583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:05.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314012+0000","last_change":"2024-09-10T06:22:33.812296+0000","last_active":"2024-09-10T06:25:46.314012+0000","last_peered":"2024-09-10T06:25:46.314012+0000","last_clean":"2024-09-10T06:25:46.314012+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:25:46.314012+0000","last_undegraded":"2024-09-10T06:25:46.314012+0000","last_fullsized":"2024-09-10T06:25:46.314012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:01.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836937+0000","last_change":"2024-09-10T06:22:31.831741+0000","last_active":"2024-09-10T06:23:12.836937+0000","last_peered":"2024-09-10T06:23:12.836937+0000","last_clean":"2024-09-10T06:23:12.836937+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:23:12.836937+0000","last_undegraded":"2024-09-10T06:23:12.836937+0000","last_fullsized":"2024-09-10T06:23:12.836937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:47.297207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.272681+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:24:43.272681+0000","last_peered":"2024-09-10T06:24:43.272681+0000","last_clean":"2024-09-10T06:24:43.272681+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:24:43.272681+0000","last_undegraded":"2024-09-10T06:24:43.272681+0000","last_fullsized":"2024-09-10T06:24:43.272681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380630+0000","last_change":"2024-09-10T06:22:33.816970+0000","last_active":"2024-09-10T06:25:46.380630+0000","last_peered":"2024-09-10T06:25:46.380630+0000","last_clean":"2024-09-10T06:25:46.380630+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:25:46.380630+0000","last_undegraded":"2024-09-10T06:25:46.380630+0000","last_fullsized":"2024-09-10T06:25:46.380630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:13.014250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.234103+0000","last_change":"2024-09-10T06:23:12.901608+0000","last_active":"2024-09-10T06:24:45.234103+0000","last_peered":"2024-09-10T06:24:45.234103+0000","last_clean":"2024-09-10T06:24:45.234103+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:24:45.234103+0000","last_undegraded":"2024-09-10T06:24:45.234103+0000","last_fullsized":"2024-09-10T06:24:45.234103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:00.953898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838061+0000","last_change":"2024-09-10T06:22:31.821919+0000","last_active":"2024-09-10T06:23:12.838061+0000","last_peered":"2024-09-10T06:23:12.838061+0000","last_clean":"2024-09-10T06:23:12.838061+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:23:12.838061+0000","last_undegraded":"2024-09-10T06:23:12.838061+0000","last_fullsized":"2024-09-10T06:23:12.838061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:55.502929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844115+0000","last_change":"2024-09-10T06:22:35.836699+0000","last_active":"2024-09-10T06:23:12.844115+0000","last_peered":"2024-09-10T06:23:12.844115+0000","last_clean":"2024-09-10T06:23:12.844115+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:23:12.844115+0000","last_undegraded":"2024-09-10T06:23:12.844115+0000","last_fullsized":"2024-09-10T06:23:12.844115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:10.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.570616+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:25:46.570616+0000","last_peered":"2024-09-10T06:25:46.570616+0000","last_clean":"2024-09-10T06:25:46.570616+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:25:46.570616+0000","last_undegraded":"2024-09-10T06:25:46.570616+0000","last_fullsized":"2024-09-10T06:25:46.570616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.330277+0000","last_change":"2024-09-10T06:22:33.836449+0000","last_active":"2024-09-10T06:25:46.330277+0000","last_peered":"2024-09-10T06:25:46.330277+0000","last_clean":"2024-09-10T06:25:46.330277+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:25:46.330277+0000","last_undegraded":"2024-09-10T06:25:46.330277+0000","last_fullsized":"2024-09-10T06:25:46.330277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:54.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841665+0000","last_change":"2024-09-10T06:22:31.828040+0000","last_active":"2024-09-10T06:23:12.841665+0000","last_peered":"2024-09-10T06:23:12.841665+0000","last_clean":"2024-09-10T06:23:12.841665+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:23:12.841665+0000","last_undegraded":"2024-09-10T06:23:12.841665+0000","last_fullsized":"2024-09-10T06:23:12.841665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:07.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.265779+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:24:43.265779+0000","last_peered":"2024-09-10T06:24:43.265779+0000","last_clean":"2024-09-10T06:24:43.265779+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:24:43.265779+0000","last_undegraded":"2024-09-10T06:24:43.265779+0000","last_fullsized":"2024-09-10T06:24:43.265779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.389843+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:25:46.389843+0000","last_peered":"2024-09-10T06:25:46.389843+0000","last_clean":"2024-09-10T06:25:46.389843+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:25:46.389843+0000","last_undegraded":"2024-09-10T06:25:46.389843+0000","last_fullsized":"2024-09-10T06:25:46.389843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836656+0000","last_change":"2024-09-10T06:22:33.836542+0000","last_active":"2024-09-10T06:23:12.836656+0000","last_peered":"2024-09-10T06:23:12.836656+0000","last_clean":"2024-09-10T06:23:12.836656+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:23:12.836656+0000","last_undegraded":"2024-09-10T06:23:12.836656+0000","last_fullsized":"2024-09-10T06:23:12.836656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:35.885623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852424+0000","last_change":"2024-09-10T06:22:31.804588+0000","last_active":"2024-09-10T06:23:12.852424+0000","last_peered":"2024-09-10T06:23:12.852424+0000","last_clean":"2024-09-10T06:23:12.852424+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:23:12.852424+0000","last_undegraded":"2024-09-10T06:23:12.852424+0000","last_fullsized":"2024-09-10T06:23:12.852424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846399+0000","last_change":"2024-09-10T06:22:35.836358+0000","last_active":"2024-09-10T06:23:12.846399+0000","last_peered":"2024-09-10T06:23:12.846399+0000","last_clean":"2024-09-10T06:23:12.846399+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:23:12.846399+0000","last_undegraded":"2024-09-10T06:23:12.846399+0000","last_fullsized":"2024-09-10T06:23:12.846399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:19.610121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.278467+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:24:43.278467+0000","last_peered":"2024-09-10T06:24:43.278467+0000","last_clean":"2024-09-10T06:24:43.278467+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:24:43.278467+0000","last_undegraded":"2024-09-10T06:24:43.278467+0000","last_fullsized":"2024-09-10T06:24:43.278467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:10.147486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.165283+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:00.165283+0000","last_peered":"2024-09-10T06:24:00.165283+0000","last_clean":"2024-09-10T06:24:00.165283+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:00.165283+0000","last_undegraded":"2024-09-10T06:24:00.165283+0000","last_fullsized":"2024-09-10T06:24:00.165283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:04.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227310+0000","last_change":"2024-09-10T06:22:33.817819+0000","last_active":"2024-09-10T06:25:46.227310+0000","last_peered":"2024-09-10T06:25:46.227310+0000","last_clean":"2024-09-10T06:25:46.227310+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:25:46.227310+0000","last_undegraded":"2024-09-10T06:25:46.227310+0000","last_fullsized":"2024-09-10T06:25:46.227310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.471797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850929+0000","last_change":"2024-09-10T06:22:31.807466+0000","last_active":"2024-09-10T06:23:12.850929+0000","last_peered":"2024-09-10T06:23:12.850929+0000","last_clean":"2024-09-10T06:23:12.850929+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:23:12.850929+0000","last_undegraded":"2024-09-10T06:23:12.850929+0000","last_fullsized":"2024-09-10T06:23:12.850929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:02.579986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840472+0000","last_change":"2024-09-10T06:22:35.836298+0000","last_active":"2024-09-10T06:23:12.840472+0000","last_peered":"2024-09-10T06:23:12.840472+0000","last_clean":"2024-09-10T06:23:12.840472+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:23:12.840472+0000","last_undegraded":"2024-09-10T06:23:12.840472+0000","last_fullsized":"2024-09-10T06:23:12.840472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.251245+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:24:43.251245+0000","last_peered":"2024-09-10T06:24:43.251245+0000","last_clean":"2024-09-10T06:24:43.251245+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:24:43.251245+0000","last_undegraded":"2024-09-10T06:24:43.251245+0000","last_fullsized":"2024-09-10T06:24:43.251245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:54.521264+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:23:54.521264+0000","last_peered":"2024-09-10T06:23:54.521264+0000","last_clean":"2024-09-10T06:23:54.521264+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:23:54.521264+0000","last_undegraded":"2024-09-10T06:23:54.521264+0000","last_fullsized":"2024-09-10T06:23:54.521264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:15.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.277593+0000","last_change":"2024-09-10T06:22:33.841687+0000","last_active":"2024-09-10T06:24:45.277593+0000","last_peered":"2024-09-10T06:24:45.277593+0000","last_clean":"2024-09-10T06:24:45.277593+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:24:45.277593+0000","last_undegraded":"2024-09-10T06:24:45.277593+0000","last_fullsized":"2024-09-10T06:24:45.277593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:42.392550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563926+0000","last_change":"2024-09-10T06:22:31.836503+0000","last_active":"2024-09-10T06:23:15.563926+0000","last_peered":"2024-09-10T06:23:15.563926+0000","last_clean":"2024-09-10T06:23:15.563926+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:23:15.563926+0000","last_undegraded":"2024-09-10T06:23:15.563926+0000","last_fullsized":"2024-09-10T06:23:15.563926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:55.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846203+0000","last_change":"2024-09-10T06:22:35.835893+0000","last_active":"2024-09-10T06:23:12.846203+0000","last_peered":"2024-09-10T06:23:12.846203+0000","last_clean":"2024-09-10T06:23:12.846203+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:23:12.846203+0000","last_undegraded":"2024-09-10T06:23:12.846203+0000","last_fullsized":"2024-09-10T06:23:12.846203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:12.526918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.280485+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:24:43.280485+0000","last_peered":"2024-09-10T06:24:43.280485+0000","last_clean":"2024-09-10T06:24:43.280485+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:24:43.280485+0000","last_undegraded":"2024-09-10T06:24:43.280485+0000","last_fullsized":"2024-09-10T06:24:43.280485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:52.569579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.584430+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:25:46.584430+0000","last_peered":"2024-09-10T06:25:46.584430+0000","last_clean":"2024-09-10T06:25:46.584430+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:25:46.584430+0000","last_undegraded":"2024-09-10T06:25:46.584430+0000","last_fullsized":"2024-09-10T06:25:46.584430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156054+0000","last_change":"2024-09-10T06:22:33.822287+0000","last_active":"2024-09-10T06:24:00.156054+0000","last_peered":"2024-09-10T06:24:00.156054+0000","last_clean":"2024-09-10T06:24:00.156054+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:24:00.156054+0000","last_undegraded":"2024-09-10T06:24:00.156054+0000","last_fullsized":"2024-09-10T06:24:00.156054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:30.825794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.367831+0000","last_change":"2024-09-10T06:22:31.832982+0000","last_active":"2024-09-10T06:25:46.367831+0000","last_peered":"2024-09-10T06:25:46.367831+0000","last_clean":"2024-09-10T06:25:46.367831+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:25:46.367831+0000","last_undegraded":"2024-09-10T06:25:46.367831+0000","last_fullsized":"2024-09-10T06:25:46.367831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:28.916480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841000+0000","last_change":"2024-09-10T06:22:35.836376+0000","last_active":"2024-09-10T06:23:12.841000+0000","last_peered":"2024-09-10T06:23:12.841000+0000","last_clean":"2024-09-10T06:23:12.841000+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:23:12.841000+0000","last_undegraded":"2024-09-10T06:23:12.841000+0000","last_fullsized":"2024-09-10T06:23:12.841000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:11.310423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'55","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.857914+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:24:48.857914+0000","last_peered":"2024-09-10T06:24:48.857914+0000","last_clean":"2024-09-10T06:24:48.857914+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:24:48.857914+0000","last_undegraded":"2024-09-10T06:24:48.857914+0000","last_fullsized":"2024-09-10T06:24:48.857914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:32.138442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850212+0000","last_change":"2024-09-10T06:22:33.827668+0000","last_active":"2024-09-10T06:24:47.850212+0000","last_peered":"2024-09-10T06:24:47.850212+0000","last_clean":"2024-09-10T06:24:47.850212+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:24:47.850212+0000","last_undegraded":"2024-09-10T06:24:47.850212+0000","last_fullsized":"2024-09-10T06:24:47.850212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:10.516267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843566+0000","last_change":"2024-09-10T06:22:31.827415+0000","last_active":"2024-09-10T06:23:12.843566+0000","last_peered":"2024-09-10T06:23:12.843566+0000","last_clean":"2024-09-10T06:23:12.843566+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:23:12.843566+0000","last_undegraded":"2024-09-10T06:23:12.843566+0000","last_fullsized":"2024-09-10T06:23:12.843566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.483166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848722+0000","last_change":"2024-09-10T06:22:35.830686+0000","last_active":"2024-09-10T06:23:12.848722+0000","last_peered":"2024-09-10T06:23:12.848722+0000","last_clean":"2024-09-10T06:23:12.848722+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:23:12.848722+0000","last_undegraded":"2024-09-10T06:23:12.848722+0000","last_fullsized":"2024-09-10T06:23:12.848722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.256435+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:24:43.256435+0000","last_peered":"2024-09-10T06:24:43.256435+0000","last_clean":"2024-09-10T06:24:43.256435+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:24:43.256435+0000","last_undegraded":"2024-09-10T06:24:43.256435+0000","last_fullsized":"2024-09-10T06:24:43.256435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856817+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:24:43.856817+0000","last_peered":"2024-09-10T06:24:43.856817+0000","last_clean":"2024-09-10T06:24:43.856817+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:24:43.856817+0000","last_undegraded":"2024-09-10T06:24:43.856817+0000","last_fullsized":"2024-09-10T06:24:43.856817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:00.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.485815+0000","last_change":"2024-09-10T06:22:33.836732+0000","last_active":"2024-09-10T06:25:46.485815+0000","last_peered":"2024-09-10T06:25:46.485815+0000","last_clean":"2024-09-10T06:25:46.485815+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:25:46.485815+0000","last_undegraded":"2024-09-10T06:25:46.485815+0000","last_fullsized":"2024-09-10T06:25:46.485815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:58.953149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843151+0000","last_change":"2024-09-10T06:22:31.831869+0000","last_active":"2024-09-10T06:23:12.843151+0000","last_peered":"2024-09-10T06:23:12.843151+0000","last_clean":"2024-09-10T06:23:12.843151+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:23:12.843151+0000","last_undegraded":"2024-09-10T06:23:12.843151+0000","last_fullsized":"2024-09-10T06:23:12.843151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:08.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844174+0000","last_change":"2024-09-10T06:22:35.836278+0000","last_active":"2024-09-10T06:23:12.844174+0000","last_peered":"2024-09-10T06:23:12.844174+0000","last_clean":"2024-09-10T06:23:12.844174+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:23:12.844174+0000","last_undegraded":"2024-09-10T06:23:12.844174+0000","last_fullsized":"2024-09-10T06:23:12.844174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:25.749044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:53.875302+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:24:53.875302+0000","last_peered":"2024-09-10T06:24:53.875302+0000","last_clean":"2024-09-10T06:24:53.875302+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:24:53.875302+0000","last_undegraded":"2024-09-10T06:24:53.875302+0000","last_fullsized":"2024-09-10T06:24:53.875302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.556846+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:25:46.556846+0000","last_peered":"2024-09-10T06:25:46.556846+0000","last_clean":"2024-09-10T06:25:46.556846+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:25:46.556846+0000","last_undegraded":"2024-09-10T06:25:46.556846+0000","last_fullsized":"2024-09-10T06:25:46.556846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.844984+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:24:47.844984+0000","last_peered":"2024-09-10T06:24:47.844984+0000","last_clean":"2024-09-10T06:24:47.844984+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:24:47.844984+0000","last_undegraded":"2024-09-10T06:24:47.844984+0000","last_fullsized":"2024-09-10T06:24:47.844984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:41.565616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.030221+0000","last_change":"2024-09-10T06:22:33.844698+0000","last_active":"2024-09-10T06:25:46.030221+0000","last_peered":"2024-09-10T06:25:46.030221+0000","last_clean":"2024-09-10T06:25:46.030221+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:25:46.030221+0000","last_undegraded":"2024-09-10T06:25:46.030221+0000","last_fullsized":"2024-09-10T06:25:46.030221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:46.069087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844850+0000","last_change":"2024-09-10T06:22:31.826875+0000","last_active":"2024-09-10T06:23:12.844850+0000","last_peered":"2024-09-10T06:23:12.844850+0000","last_clean":"2024-09-10T06:23:12.844850+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:23:12.844850+0000","last_undegraded":"2024-09-10T06:23:12.844850+0000","last_fullsized":"2024-09-10T06:23:12.844850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.394900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.721931+0000","last_change":"2024-09-10T06:22:35.832300+0000","last_active":"2024-09-10T06:24:44.721931+0000","last_peered":"2024-09-10T06:24:44.721931+0000","last_clean":"2024-09-10T06:24:44.721931+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:24:44.721931+0000","last_undegraded":"2024-09-10T06:24:44.721931+0000","last_fullsized":"2024-09-10T06:24:44.721931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:47.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":467,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.495421+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:25:46.495421+0000","last_peered":"2024-09-10T06:25:46.495421+0000","last_clean":"2024-09-10T06:25:46.495421+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:25:46.495421+0000","last_undegraded":"2024-09-10T06:25:46.495421+0000","last_fullsized":"2024-09-10T06:25:46.495421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.871524+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:44.871524+0000","last_peered":"2024-09-10T06:24:44.871524+0000","last_clean":"2024-09-10T06:24:44.871524+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:44.871524+0000","last_undegraded":"2024-09-10T06:24:44.871524+0000","last_fullsized":"2024-09-10T06:24:44.871524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:02.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850321+0000","last_change":"2024-09-10T06:22:33.827862+0000","last_active":"2024-09-10T06:24:47.850321+0000","last_peered":"2024-09-10T06:24:47.850321+0000","last_clean":"2024-09-10T06:24:47.850321+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:24:47.850321+0000","last_undegraded":"2024-09-10T06:24:47.850321+0000","last_fullsized":"2024-09-10T06:24:47.850321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:49.916726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835639+0000","last_change":"2024-09-10T06:22:31.830812+0000","last_active":"2024-09-10T06:23:12.835639+0000","last_peered":"2024-09-10T06:23:12.835639+0000","last_clean":"2024-09-10T06:23:12.835639+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:23:12.835639+0000","last_undegraded":"2024-09-10T06:23:12.835639+0000","last_fullsized":"2024-09-10T06:23:12.835639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:07.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.274627+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:24:43.274627+0000","last_peered":"2024-09-10T06:24:43.274627+0000","last_clean":"2024-09-10T06:24:43.274627+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:24:43.274627+0000","last_undegraded":"2024-09-10T06:24:43.274627+0000","last_fullsized":"2024-09-10T06:24:43.274627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.454158+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.454158+0000","last_peered":"2024-09-10T06:25:46.454158+0000","last_clean":"2024-09-10T06:25:46.454158+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.454158+0000","last_undegraded":"2024-09-10T06:25:46.454158+0000","last_fullsized":"2024-09-10T06:25:46.454158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:28.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.085306+0000","last_change":"2024-09-10T06:22:33.830097+0000","last_active":"2024-09-10T06:24:41.085306+0000","last_peered":"2024-09-10T06:24:41.085306+0000","last_clean":"2024-09-10T06:24:41.085306+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:24:41.085306+0000","last_undegraded":"2024-09-10T06:24:41.085306+0000","last_fullsized":"2024-09-10T06:24:41.085306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:04.520654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841380+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:23:12.841380+0000","last_peered":"2024-09-10T06:23:12.841380+0000","last_clean":"2024-09-10T06:23:12.841380+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:23:12.841380+0000","last_undegraded":"2024-09-10T06:23:12.841380+0000","last_fullsized":"2024-09-10T06:23:12.841380+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838764+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:23:12.838764+0000","last_peered":"2024-09-10T06:23:12.838764+0000","last_clean":"2024-09-10T06:23:12.838764+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:23:12.838764+0000","last_undegraded":"2024-09-10T06:23:12.838764+0000","last_fullsized":"2024-09-10T06:23:12.838764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837151+0000","last_change":"2024-09-10T06:22:31.832148+0000","last_active":"2024-09-10T06:23:12.837151+0000","last_peered":"2024-09-10T06:23:12.837151+0000","last_clean":"2024-09-10T06:23:12.837151+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:23:12.837151+0000","last_undegraded":"2024-09-10T06:23:12.837151+0000","last_fullsized":"2024-09-10T06:23:12.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:07.514358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.855163+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:23:12.855163+0000","last_peered":"2024-09-10T06:23:12.855163+0000","last_clean":"2024-09-10T06:23:12.855163+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:23:12.855163+0000","last_undegraded":"2024-09-10T06:23:12.855163+0000","last_fullsized":"2024-09-10T06:23:12.855163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.965730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.289632+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:24:43.289632+0000","last_peered":"2024-09-10T06:24:43.289632+0000","last_clean":"2024-09-10T06:24:43.289632+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:24:43.289632+0000","last_undegraded":"2024-09-10T06:24:43.289632+0000","last_fullsized":"2024-09-10T06:24:43.289632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:21.725012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315520+0000","last_change":"2024-09-10T06:22:33.814130+0000","last_active":"2024-09-10T06:25:46.315520+0000","last_peered":"2024-09-10T06:25:46.315520+0000","last_clean":"2024-09-10T06:25:46.315520+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:25:46.315520+0000","last_undegraded":"2024-09-10T06:25:46.315520+0000","last_fullsized":"2024-09-10T06:25:46.315520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:11.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835614+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:23:12.835614+0000","last_peered":"2024-09-10T06:23:12.835614+0000","last_clean":"2024-09-10T06:23:12.835614+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:23:12.835614+0000","last_undegraded":"2024-09-10T06:23:12.835614+0000","last_fullsized":"2024-09-10T06:23:12.835614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839903+0000","last_change":"2024-09-10T06:22:31.813968+0000","last_active":"2024-09-10T06:23:12.839903+0000","last_peered":"2024-09-10T06:23:12.839903+0000","last_clean":"2024-09-10T06:23:12.839903+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:23:12.839903+0000","last_undegraded":"2024-09-10T06:23:12.839903+0000","last_fullsized":"2024-09-10T06:23:12.839903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854443+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:23:12.854443+0000","last_peered":"2024-09-10T06:23:12.854443+0000","last_clean":"2024-09-10T06:23:12.854443+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:23:12.854443+0000","last_undegraded":"2024-09-10T06:23:12.854443+0000","last_fullsized":"2024-09-10T06:23:12.854443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:04.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'274","reported_seq":479,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072427+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:25:46.072427+0000","last_peered":"2024-09-10T06:25:46.072427+0000","last_clean":"2024-09-10T06:25:46.072427+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:25:46.072427+0000","last_undegraded":"2024-09-10T06:25:46.072427+0000","last_fullsized":"2024-09-10T06:25:46.072427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:21.390056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838597+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:23:12.838597+0000","last_peered":"2024-09-10T06:23:12.838597+0000","last_clean":"2024-09-10T06:23:12.838597+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:23:12.838597+0000","last_undegraded":"2024-09-10T06:23:12.838597+0000","last_fullsized":"2024-09-10T06:23:12.838597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:35.775780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.379659+0000","last_change":"2024-09-10T06:22:33.830304+0000","last_active":"2024-09-10T06:25:46.379659+0000","last_peered":"2024-09-10T06:25:46.379659+0000","last_clean":"2024-09-10T06:25:46.379659+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:25:46.379659+0000","last_undegraded":"2024-09-10T06:25:46.379659+0000","last_fullsized":"2024-09-10T06:25:46.379659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842861+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:23:12.842861+0000","last_peered":"2024-09-10T06:23:12.842861+0000","last_clean":"2024-09-10T06:23:12.842861+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:23:12.842861+0000","last_undegraded":"2024-09-10T06:23:12.842861+0000","last_fullsized":"2024-09-10T06:23:12.842861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.213105+0000","last_change":"2024-09-10T06:22:31.813555+0000","last_active":"2024-09-10T06:25:46.213105+0000","last_peered":"2024-09-10T06:25:46.213105+0000","last_clean":"2024-09-10T06:25:46.213105+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:25:46.213105+0000","last_undegraded":"2024-09-10T06:25:46.213105+0000","last_fullsized":"2024-09-10T06:25:46.213105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851204+0000","last_change":"2024-09-10T06:22:35.819965+0000","last_active":"2024-09-10T06:23:12.851204+0000","last_peered":"2024-09-10T06:23:12.851204+0000","last_clean":"2024-09-10T06:23:12.851204+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:23:12.851204+0000","last_undegraded":"2024-09-10T06:23:12.851204+0000","last_fullsized":"2024-09-10T06:23:12.851204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:59.563244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.073073+0000","last_change":"2024-09-10T06:22:37.837514+0000","last_active":"2024-09-10T06:25:46.073073+0000","last_peered":"2024-09-10T06:25:46.073073+0000","last_clean":"2024-09-10T06:25:46.073073+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:25:46.073073+0000","last_undegraded":"2024-09-10T06:25:46.073073+0000","last_fullsized":"2024-09-10T06:25:46.073073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:10.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841192+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:23:12.841192+0000","last_peered":"2024-09-10T06:23:12.841192+0000","last_clean":"2024-09-10T06:23:12.841192+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:23:12.841192+0000","last_undegraded":"2024-09-10T06:23:12.841192+0000","last_fullsized":"2024-09-10T06:23:12.841192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:59.799041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380078+0000","last_change":"2024-09-10T06:22:33.843908+0000","last_active":"2024-09-10T06:25:46.380078+0000","last_peered":"2024-09-10T06:25:46.380078+0000","last_clean":"2024-09-10T06:25:46.380078+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:25:46.380078+0000","last_undegraded":"2024-09-10T06:25:46.380078+0000","last_fullsized":"2024-09-10T06:25:46.380078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836895+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:23:12.836895+0000","last_peered":"2024-09-10T06:23:12.836895+0000","last_clean":"2024-09-10T06:23:12.836895+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:23:12.836895+0000","last_undegraded":"2024-09-10T06:23:12.836895+0000","last_fullsized":"2024-09-10T06:23:12.836895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.840931+0000","last_change":"2024-09-10T06:22:31.810277+0000","last_active":"2024-09-10T06:25:45.840931+0000","last_peered":"2024-09-10T06:25:45.840931+0000","last_clean":"2024-09-10T06:25:45.840931+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:25:45.840931+0000","last_undegraded":"2024-09-10T06:25:45.840931+0000","last_fullsized":"2024-09-10T06:25:45.840931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:49.861302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844120+0000","last_change":"2024-09-10T06:22:35.817207+0000","last_active":"2024-09-10T06:23:12.844120+0000","last_peered":"2024-09-10T06:23:12.844120+0000","last_clean":"2024-09-10T06:23:12.844120+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:23:12.844120+0000","last_undegraded":"2024-09-10T06:23:12.844120+0000","last_fullsized":"2024-09-10T06:23:12.844120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:40.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.319710+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.319710+0000","last_peered":"2024-09-10T06:25:45.319710+0000","last_clean":"2024-09-10T06:25:45.319710+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.319710+0000","last_undegraded":"2024-09-10T06:25:45.319710+0000","last_fullsized":"2024-09-10T06:25:45.319710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:52.179158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029340+0000","last_change":"2024-09-10T06:22:33.829247+0000","last_active":"2024-09-10T06:25:46.029340+0000","last_peered":"2024-09-10T06:25:46.029340+0000","last_clean":"2024-09-10T06:25:46.029340+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:25:46.029340+0000","last_undegraded":"2024-09-10T06:25:46.029340+0000","last_fullsized":"2024-09-10T06:25:46.029340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852772+0000","last_change":"2024-09-10T06:22:31.810031+0000","last_active":"2024-09-10T06:23:12.852772+0000","last_peered":"2024-09-10T06:23:12.852772+0000","last_clean":"2024-09-10T06:23:12.852772+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:23:12.852772+0000","last_undegraded":"2024-09-10T06:23:12.852772+0000","last_fullsized":"2024-09-10T06:23:12.852772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:36.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840933+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:23:12.840933+0000","last_peered":"2024-09-10T06:23:12.840933+0000","last_clean":"2024-09-10T06:23:12.840933+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:23:12.840933+0000","last_undegraded":"2024-09-10T06:23:12.840933+0000","last_fullsized":"2024-09-10T06:23:12.840933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.843802+0000","last_change":"2024-09-10T06:22:35.823185+0000","last_active":"2024-09-10T06:24:42.843802+0000","last_peered":"2024-09-10T06:24:42.843802+0000","last_clean":"2024-09-10T06:24:42.843802+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:24:42.843802+0000","last_undegraded":"2024-09-10T06:24:42.843802+0000","last_fullsized":"2024-09-10T06:24:42.843802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:31.666424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'63","reported_seq":123,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.291459+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:24:43.291459+0000","last_peered":"2024-09-10T06:24:43.291459+0000","last_clean":"2024-09-10T06:24:43.291459+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:24:43.291459+0000","last_undegraded":"2024-09-10T06:24:43.291459+0000","last_fullsized":"2024-09-10T06:24:43.291459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.778947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843741+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:23:12.843741+0000","last_peered":"2024-09-10T06:23:12.843741+0000","last_clean":"2024-09-10T06:23:12.843741+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:23:12.843741+0000","last_undegraded":"2024-09-10T06:23:12.843741+0000","last_fullsized":"2024-09-10T06:23:12.843741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:07.724283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029418+0000","last_change":"2024-09-10T06:22:33.828093+0000","last_active":"2024-09-10T06:25:46.029418+0000","last_peered":"2024-09-10T06:25:46.029418+0000","last_clean":"2024-09-10T06:25:46.029418+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:25:46.029418+0000","last_undegraded":"2024-09-10T06:25:46.029418+0000","last_fullsized":"2024-09-10T06:25:46.029418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841646+0000","last_change":"2024-09-10T06:22:31.811783+0000","last_active":"2024-09-10T06:23:12.841646+0000","last_peered":"2024-09-10T06:23:12.841646+0000","last_clean":"2024-09-10T06:23:12.841646+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:23:12.841646+0000","last_undegraded":"2024-09-10T06:23:12.841646+0000","last_fullsized":"2024-09-10T06:23:12.841646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:00.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.697023+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:24:44.697023+0000","last_peered":"2024-09-10T06:24:44.697023+0000","last_clean":"2024-09-10T06:24:44.697023+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:24:44.697023+0000","last_undegraded":"2024-09-10T06:24:44.697023+0000","last_fullsized":"2024-09-10T06:24:44.697023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:58.162966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.404578+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:23:16.404578+0000","last_peered":"2024-09-10T06:23:16.404578+0000","last_clean":"2024-09-10T06:23:16.404578+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:23:16.404578+0000","last_undegraded":"2024-09-10T06:23:16.404578+0000","last_fullsized":"2024-09-10T06:23:16.404578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.073693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":357,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.072302+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:25:46.072302+0000","last_peered":"2024-09-10T06:25:46.072302+0000","last_clean":"2024-09-10T06:25:46.072302+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:25:46.072302+0000","last_undegraded":"2024-09-10T06:25:46.072302+0000","last_fullsized":"2024-09-10T06:25:46.072302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:43.131319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226435+0000","last_change":"2024-09-10T06:22:33.835195+0000","last_active":"2024-09-10T06:25:46.226435+0000","last_peered":"2024-09-10T06:25:46.226435+0000","last_clean":"2024-09-10T06:25:46.226435+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:25:46.226435+0000","last_undegraded":"2024-09-10T06:25:46.226435+0000","last_fullsized":"2024-09-10T06:25:46.226435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:25.772911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.857059+0000","last_change":"2024-09-10T06:22:31.819349+0000","last_active":"2024-09-10T06:24:43.857059+0000","last_peered":"2024-09-10T06:24:43.857059+0000","last_clean":"2024-09-10T06:24:43.857059+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:24:43.857059+0000","last_undegraded":"2024-09-10T06:24:43.857059+0000","last_fullsized":"2024-09-10T06:24:43.857059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:40.037975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843900+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:23:12.843900+0000","last_peered":"2024-09-10T06:23:12.843900+0000","last_clean":"2024-09-10T06:23:12.843900+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:23:12.843900+0000","last_undegraded":"2024-09-10T06:23:12.843900+0000","last_fullsized":"2024-09-10T06:23:12.843900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844884+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:23:12.844884+0000","last_peered":"2024-09-10T06:23:12.844884+0000","last_clean":"2024-09-10T06:23:12.844884+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:23:12.844884+0000","last_undegraded":"2024-09-10T06:23:12.844884+0000","last_fullsized":"2024-09-10T06:23:12.844884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.465248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856935+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:24:43.856935+0000","last_peered":"2024-09-10T06:24:43.856935+0000","last_clean":"2024-09-10T06:24:43.856935+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:24:43.856935+0000","last_undegraded":"2024-09-10T06:24:43.856935+0000","last_fullsized":"2024-09-10T06:24:43.856935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:00.801970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.546362+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:25:46.546362+0000","last_peered":"2024-09-10T06:25:46.546362+0000","last_clean":"2024-09-10T06:25:46.546362+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:25:46.546362+0000","last_undegraded":"2024-09-10T06:25:46.546362+0000","last_fullsized":"2024-09-10T06:25:46.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:05.123690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314608+0000","last_change":"2024-09-10T06:22:33.836044+0000","last_active":"2024-09-10T06:25:46.314608+0000","last_peered":"2024-09-10T06:25:46.314608+0000","last_clean":"2024-09-10T06:25:46.314608+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:25:46.314608+0000","last_undegraded":"2024-09-10T06:25:46.314608+0000","last_fullsized":"2024-09-10T06:25:46.314608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:49.616370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863191+0000","last_change":"2024-09-10T06:22:31.817407+0000","last_active":"2024-09-10T06:23:12.863191+0000","last_peered":"2024-09-10T06:23:12.863191+0000","last_clean":"2024-09-10T06:23:12.863191+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:23:12.863191+0000","last_undegraded":"2024-09-10T06:23:12.863191+0000","last_fullsized":"2024-09-10T06:23:12.863191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:59.858776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852491+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:23:12.852491+0000","last_peered":"2024-09-10T06:23:12.852491+0000","last_clean":"2024-09-10T06:23:12.852491+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:23:12.852491+0000","last_undegraded":"2024-09-10T06:23:12.852491+0000","last_fullsized":"2024-09-10T06:23:12.852491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845740+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:23:12.845740+0000","last_peered":"2024-09-10T06:23:12.845740+0000","last_clean":"2024-09-10T06:23:12.845740+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:23:12.845740+0000","last_undegraded":"2024-09-10T06:23:12.845740+0000","last_fullsized":"2024-09-10T06:23:12.845740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:28.571689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'82","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.271773+0000","last_change":"2024-09-10T06:22:37.855099+0000","last_active":"2024-09-10T06:24:43.271773+0000","last_peered":"2024-09-10T06:24:43.271773+0000","last_clean":"2024-09-10T06:24:43.271773+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:24:43.271773+0000","last_undegraded":"2024-09-10T06:24:43.271773+0000","last_fullsized":"2024-09-10T06:24:43.271773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:05.079013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839680+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:23:12.839680+0000","last_peered":"2024-09-10T06:23:12.839680+0000","last_clean":"2024-09-10T06:23:12.839680+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:23:12.839680+0000","last_undegraded":"2024-09-10T06:23:12.839680+0000","last_fullsized":"2024-09-10T06:23:12.839680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:00.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851696+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:23:12.851696+0000","last_peered":"2024-09-10T06:23:12.851696+0000","last_clean":"2024-09-10T06:23:12.851696+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:23:12.851696+0000","last_undegraded":"2024-09-10T06:23:12.851696+0000","last_fullsized":"2024-09-10T06:23:12.851696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:18.366509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848875+0000","last_change":"2024-09-10T06:22:33.835614+0000","last_active":"2024-09-10T06:23:16.848875+0000","last_peered":"2024-09-10T06:23:16.848875+0000","last_clean":"2024-09-10T06:23:16.848875+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:23:16.848875+0000","last_undegraded":"2024-09-10T06:23:16.848875+0000","last_fullsized":"2024-09-10T06:23:16.848875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:36.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838231+0000","last_change":"2024-09-10T06:22:31.830987+0000","last_active":"2024-09-10T06:23:12.838231+0000","last_peered":"2024-09-10T06:23:12.838231+0000","last_clean":"2024-09-10T06:23:12.838231+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:23:12.838231+0000","last_undegraded":"2024-09-10T06:23:12.838231+0000","last_fullsized":"2024-09-10T06:23:12.838231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:06.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842492+0000","last_change":"2024-09-10T06:22:35.832868+0000","last_active":"2024-09-10T06:23:12.842492+0000","last_peered":"2024-09-10T06:23:12.842492+0000","last_clean":"2024-09-10T06:23:12.842492+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:23:12.842492+0000","last_undegraded":"2024-09-10T06:23:12.842492+0000","last_fullsized":"2024-09-10T06:23:12.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:22:51.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.279468+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:24:43.279468+0000","last_peered":"2024-09-10T06:24:43.279468+0000","last_clean":"2024-09-10T06:24:43.279468+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:24:43.279468+0000","last_undegraded":"2024-09-10T06:24:43.279468+0000","last_fullsized":"2024-09-10T06:24:43.279468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.872559+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.872559+0000","last_peered":"2024-09-10T06:24:42.872559+0000","last_clean":"2024-09-10T06:24:42.872559+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.872559+0000","last_undegraded":"2024-09-10T06:24:42.872559+0000","last_fullsized":"2024-09-10T06:24:42.872559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:14.600789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851337+0000","last_change":"2024-09-10T06:22:33.828670+0000","last_active":"2024-09-10T06:24:52.851337+0000","last_peered":"2024-09-10T06:24:52.851337+0000","last_clean":"2024-09-10T06:24:52.851337+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:24:52.851337+0000","last_undegraded":"2024-09-10T06:24:52.851337+0000","last_fullsized":"2024-09-10T06:24:52.851337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:58.876540+0000","last_change":"2024-09-10T06:22:31.834212+0000","last_active":"2024-09-10T06:24:58.876540+0000","last_peered":"2024-09-10T06:24:58.876540+0000","last_clean":"2024-09-10T06:24:58.876540+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:24:58.876540+0000","last_undegraded":"2024-09-10T06:24:58.876540+0000","last_fullsized":"2024-09-10T06:24:58.876540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:50.883361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427517+0000","last_change":"2024-09-10T06:22:33.817684+0000","last_active":"2024-09-10T06:24:00.427517+0000","last_peered":"2024-09-10T06:24:00.427517+0000","last_clean":"2024-09-10T06:24:00.427517+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:24:00.427517+0000","last_undegraded":"2024-09-10T06:24:00.427517+0000","last_fullsized":"2024-09-10T06:24:00.427517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.801071+0000","last_change":"2024-09-10T06:22:31.823765+0000","last_active":"2024-09-10T06:25:45.801071+0000","last_peered":"2024-09-10T06:25:45.801071+0000","last_clean":"2024-09-10T06:25:45.801071+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:25:45.801071+0000","last_undegraded":"2024-09-10T06:25:45.801071+0000","last_fullsized":"2024-09-10T06:25:45.801071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:55.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839169+0000","last_change":"2024-09-10T06:22:35.831394+0000","last_active":"2024-09-10T06:23:12.839169+0000","last_peered":"2024-09-10T06:23:12.839169+0000","last_clean":"2024-09-10T06:23:12.839169+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:23:12.839169+0000","last_undegraded":"2024-09-10T06:23:12.839169+0000","last_fullsized":"2024-09-10T06:23:12.839169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:22.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.412051+0000","last_change":"2024-09-10T06:22:37.836553+0000","last_active":"2024-09-10T06:25:45.412051+0000","last_peered":"2024-09-10T06:25:45.412051+0000","last_clean":"2024-09-10T06:25:45.412051+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:25:45.412051+0000","last_undegraded":"2024-09-10T06:25:45.412051+0000","last_fullsized":"2024-09-10T06:25:45.412051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:24.462240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226226+0000","last_change":"2024-09-10T06:22:33.837182+0000","last_active":"2024-09-10T06:25:46.226226+0000","last_peered":"2024-09-10T06:25:46.226226+0000","last_clean":"2024-09-10T06:25:46.226226+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:25:46.226226+0000","last_undegraded":"2024-09-10T06:25:46.226226+0000","last_fullsized":"2024-09-10T06:25:46.226226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:14.784269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.144585+0000","last_change":"2024-09-10T06:22:31.824675+0000","last_active":"2024-09-10T06:24:00.144585+0000","last_peered":"2024-09-10T06:24:00.144585+0000","last_clean":"2024-09-10T06:24:00.144585+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:24:00.144585+0000","last_undegraded":"2024-09-10T06:24:00.144585+0000","last_fullsized":"2024-09-10T06:24:00.144585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:27.214452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.260507+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:24:43.260507+0000","last_peered":"2024-09-10T06:24:43.260507+0000","last_clean":"2024-09-10T06:24:43.260507+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:24:43.260507+0000","last_undegraded":"2024-09-10T06:24:43.260507+0000","last_fullsized":"2024-09-10T06:24:43.260507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156644+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:00.156644+0000","last_peered":"2024-09-10T06:24:00.156644+0000","last_clean":"2024-09-10T06:24:00.156644+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:00.156644+0000","last_undegraded":"2024-09-10T06:24:00.156644+0000","last_fullsized":"2024-09-10T06:24:00.156644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:18.678529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835895+0000","last_change":"2024-09-10T06:22:31.835963+0000","last_active":"2024-09-10T06:23:12.835895+0000","last_peered":"2024-09-10T06:23:12.835895+0000","last_clean":"2024-09-10T06:23:12.835895+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:23:12.835895+0000","last_undegraded":"2024-09-10T06:23:12.835895+0000","last_fullsized":"2024-09-10T06:23:12.835895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:44.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:21.069402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.287272+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:24:43.287272+0000","last_peered":"2024-09-10T06:24:43.287272+0000","last_clean":"2024-09-10T06:24:43.287272+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:24:43.287272+0000","last_undegraded":"2024-09-10T06:24:43.287272+0000","last_fullsized":"2024-09-10T06:24:43.287272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.193472+0000","last_change":"2024-09-10T06:22:33.820528+0000","last_active":"2024-09-10T06:23:17.193472+0000","last_peered":"2024-09-10T06:23:17.193472+0000","last_clean":"2024-09-10T06:23:17.193472+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:23:17.193472+0000","last_undegraded":"2024-09-10T06:23:17.193472+0000","last_fullsized":"2024-09-10T06:23:17.193472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.199119+0000","last_change":"2024-09-10T06:22:31.824951+0000","last_active":"2024-09-10T06:25:46.199119+0000","last_peered":"2024-09-10T06:25:46.199119+0000","last_clean":"2024-09-10T06:25:46.199119+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:25:46.199119+0000","last_undegraded":"2024-09-10T06:25:46.199119+0000","last_fullsized":"2024-09-10T06:25:46.199119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:35.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.695966+0000","last_change":"2024-09-10T06:22:35.819614+0000","last_active":"2024-09-10T06:24:44.695966+0000","last_peered":"2024-09-10T06:24:44.695966+0000","last_clean":"2024-09-10T06:24:44.695966+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:24:44.695966+0000","last_undegraded":"2024-09-10T06:24:44.695966+0000","last_fullsized":"2024-09-10T06:24:44.695966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.909257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.261561+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:24:43.261561+0000","last_peered":"2024-09-10T06:24:43.261561+0000","last_clean":"2024-09-10T06:24:43.261561+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:24:43.261561+0000","last_undegraded":"2024-09-10T06:24:43.261561+0000","last_fullsized":"2024-09-10T06:24:43.261561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841976+0000","last_change":"2024-09-10T06:22:31.798967+0000","last_active":"2024-09-10T06:23:12.841976+0000","last_peered":"2024-09-10T06:23:12.841976+0000","last_clean":"2024-09-10T06:23:12.841976+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:23:12.841976+0000","last_undegraded":"2024-09-10T06:23:12.841976+0000","last_fullsized":"2024-09-10T06:23:12.841976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:44.941111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849600+0000","last_change":"2024-09-10T06:22:35.823165+0000","last_active":"2024-09-10T06:23:12.849600+0000","last_peered":"2024-09-10T06:23:12.849600+0000","last_clean":"2024-09-10T06:23:12.849600+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:23:12.849600+0000","last_undegraded":"2024-09-10T06:23:12.849600+0000","last_fullsized":"2024-09-10T06:23:12.849600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:33.329366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'33","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.855428+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:24:42.855428+0000","last_peered":"2024-09-10T06:24:42.855428+0000","last_clean":"2024-09-10T06:24:42.855428+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:24:42.855428+0000","last_undegraded":"2024-09-10T06:24:42.855428+0000","last_fullsized":"2024-09-10T06:24:42.855428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:01.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840875+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:23:12.840875+0000","last_peered":"2024-09-10T06:23:12.840875+0000","last_clean":"2024-09-10T06:23:12.840875+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:23:12.840875+0000","last_undegraded":"2024-09-10T06:23:12.840875+0000","last_fullsized":"2024-09-10T06:23:12.840875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:38.216965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.103075+0000","last_change":"2024-09-10T06:22:33.843181+0000","last_active":"2024-09-10T06:24:41.103075+0000","last_peered":"2024-09-10T06:24:41.103075+0000","last_clean":"2024-09-10T06:24:41.103075+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:24:41.103075+0000","last_undegraded":"2024-09-10T06:24:41.103075+0000","last_fullsized":"2024-09-10T06:24:41.103075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.994437+0000","last_change":"2024-09-10T06:22:31.819223+0000","last_active":"2024-09-10T06:24:44.994437+0000","last_peered":"2024-09-10T06:24:44.994437+0000","last_clean":"2024-09-10T06:24:44.994437+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:24:44.994437+0000","last_undegraded":"2024-09-10T06:24:44.994437+0000","last_fullsized":"2024-09-10T06:24:44.994437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:27.515537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843413+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:23:12.843413+0000","last_peered":"2024-09-10T06:23:12.843413+0000","last_clean":"2024-09-10T06:23:12.843413+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:23:12.843413+0000","last_undegraded":"2024-09-10T06:23:12.843413+0000","last_fullsized":"2024-09-10T06:23:12.843413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:11.280056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.395265+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:25:46.395265+0000","last_peered":"2024-09-10T06:25:46.395265+0000","last_clean":"2024-09-10T06:25:46.395265+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:25:46.395265+0000","last_undegraded":"2024-09-10T06:25:46.395265+0000","last_fullsized":"2024-09-10T06:25:46.395265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:40.193573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.877644+0000","last_change":"2024-09-10T06:22:33.840970+0000","last_active":"2024-09-10T06:25:03.877644+0000","last_peered":"2024-09-10T06:25:03.877644+0000","last_clean":"2024-09-10T06:25:03.877644+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:25:03.877644+0000","last_undegraded":"2024-09-10T06:25:03.877644+0000","last_fullsized":"2024-09-10T06:25:03.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:08.529180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:02.853853+0000","last_change":"2024-09-10T06:22:31.827656+0000","last_active":"2024-09-10T06:25:02.853853+0000","last_peered":"2024-09-10T06:25:02.853853+0000","last_clean":"2024-09-10T06:25:02.853853+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:25:02.853853+0000","last_undegraded":"2024-09-10T06:25:02.853853+0000","last_fullsized":"2024-09-10T06:25:02.853853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.248336+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:24:43.248336+0000","last_peered":"2024-09-10T06:24:43.248336+0000","last_clean":"2024-09-10T06:24:43.248336+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:24:43.248336+0000","last_undegraded":"2024-09-10T06:24:43.248336+0000","last_fullsized":"2024-09-10T06:24:43.248336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380753+0000","last_change":"2024-09-10T06:22:33.836076+0000","last_active":"2024-09-10T06:25:46.380753+0000","last_peered":"2024-09-10T06:25:46.380753+0000","last_clean":"2024-09-10T06:25:46.380753+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:25:46.380753+0000","last_undegraded":"2024-09-10T06:25:46.380753+0000","last_fullsized":"2024-09-10T06:25:46.380753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:36.039957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.862928+0000","last_change":"2024-09-10T06:22:31.836769+0000","last_active":"2024-09-10T06:25:03.862928+0000","last_peered":"2024-09-10T06:25:03.862928+0000","last_clean":"2024-09-10T06:25:03.862928+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:25:03.862928+0000","last_undegraded":"2024-09-10T06:25:03.862928+0000","last_fullsized":"2024-09-10T06:25:03.862928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:26.478355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850533+0000","last_change":"2024-09-10T06:22:35.826620+0000","last_active":"2024-09-10T06:23:12.850533+0000","last_peered":"2024-09-10T06:23:12.850533+0000","last_clean":"2024-09-10T06:23:12.850533+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:23:12.850533+0000","last_undegraded":"2024-09-10T06:23:12.850533+0000","last_fullsized":"2024-09-10T06:23:12.850533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:41.740450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.249824+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:24:43.249824+0000","last_peered":"2024-09-10T06:24:43.249824+0000","last_clean":"2024-09-10T06:24:43.249824+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:24:43.249824+0000","last_undegraded":"2024-09-10T06:24:43.249824+0000","last_fullsized":"2024-09-10T06:24:43.249824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.153703+0000","last_change":"2024-09-10T06:22:31.812723+0000","last_active":"2024-09-10T06:23:17.153703+0000","last_peered":"2024-09-10T06:23:17.153703+0000","last_clean":"2024-09-10T06:23:17.153703+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:23:17.153703+0000","last_undegraded":"2024-09-10T06:23:17.153703+0000","last_fullsized":"2024-09-10T06:23:17.153703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:06.179051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:08.864204+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:25:08.864204+0000","last_peered":"2024-09-10T06:25:08.864204+0000","last_clean":"2024-09-10T06:25:08.864204+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:25:08.864204+0000","last_undegraded":"2024-09-10T06:25:08.864204+0000","last_fullsized":"2024-09-10T06:25:08.864204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226520+0000","last_change":"2024-09-10T06:22:33.841332+0000","last_active":"2024-09-10T06:25:46.226520+0000","last_peered":"2024-09-10T06:25:46.226520+0000","last_clean":"2024-09-10T06:25:46.226520+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:25:46.226520+0000","last_undegraded":"2024-09-10T06:25:46.226520+0000","last_fullsized":"2024-09-10T06:25:46.226520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:29.424851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.183187+0000","last_change":"2024-09-10T06:22:31.803970+0000","last_active":"2024-09-10T06:25:46.183187+0000","last_peered":"2024-09-10T06:25:46.183187+0000","last_clean":"2024-09-10T06:25:46.183187+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:25:46.183187+0000","last_undegraded":"2024-09-10T06:25:46.183187+0000","last_fullsized":"2024-09-10T06:25:46.183187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.330768+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:25:45.330768+0000","last_peered":"2024-09-10T06:25:45.330768+0000","last_clean":"2024-09-10T06:25:45.330768+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:25:45.330768+0000","last_undegraded":"2024-09-10T06:25:45.330768+0000","last_fullsized":"2024-09-10T06:25:45.330768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.867864+0000","last_change":"2024-09-10T06:22:33.832724+0000","last_active":"2024-09-10T06:23:12.867864+0000","last_peered":"2024-09-10T06:23:12.867864+0000","last_clean":"2024-09-10T06:23:12.867864+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:23:12.867864+0000","last_undegraded":"2024-09-10T06:23:12.867864+0000","last_fullsized":"2024-09-10T06:23:12.867864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:20.127030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.872156+0000","last_change":"2024-09-10T06:22:31.809134+0000","last_active":"2024-09-10T06:24:38.872156+0000","last_peered":"2024-09-10T06:24:38.872156+0000","last_clean":"2024-09-10T06:24:38.872156+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:24:38.872156+0000","last_undegraded":"2024-09-10T06:24:38.872156+0000","last_fullsized":"2024-09-10T06:24:38.872156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:03.278295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.225482+0000","last_change":"2024-09-10T06:22:33.842763+0000","last_active":"2024-09-10T06:25:46.225482+0000","last_peered":"2024-09-10T06:25:46.225482+0000","last_clean":"2024-09-10T06:25:46.225482+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:25:46.225482+0000","last_undegraded":"2024-09-10T06:25:46.225482+0000","last_fullsized":"2024-09-10T06:25:46.225482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838799+0000","last_change":"2024-09-10T06:22:31.809874+0000","last_active":"2024-09-10T06:23:12.838799+0000","last_peered":"2024-09-10T06:23:12.838799+0000","last_clean":"2024-09-10T06:23:12.838799+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:23:12.838799+0000","last_undegraded":"2024-09-10T06:23:12.838799+0000","last_fullsized":"2024-09-10T06:23:12.838799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380807+0000","last_change":"2024-09-10T06:23:12.866962+0000","last_active":"2024-09-10T06:25:46.380807+0000","last_peered":"2024-09-10T06:25:46.380807+0000","last_clean":"2024-09-10T06:25:46.380807+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:25:46.380807+0000","last_undegraded":"2024-09-10T06:25:46.380807+0000","last_fullsized":"2024-09-10T06:25:46.380807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.062389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842517+0000","last_change":"2024-09-10T06:22:31.831565+0000","last_active":"2024-09-10T06:23:12.842517+0000","last_peered":"2024-09-10T06:23:12.842517+0000","last_clean":"2024-09-10T06:23:12.842517+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:23:12.842517+0000","last_undegraded":"2024-09-10T06:23:12.842517+0000","last_fullsized":"2024-09-10T06:23:12.842517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.130643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427522+0000","last_change":"2024-09-10T06:22:33.843784+0000","last_active":"2024-09-10T06:24:00.427522+0000","last_peered":"2024-09-10T06:24:00.427522+0000","last_clean":"2024-09-10T06:24:00.427522+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:24:00.427522+0000","last_undegraded":"2024-09-10T06:24:00.427522+0000","last_fullsized":"2024-09-10T06:24:00.427522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:08.793382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.413251+0000","last_change":"2024-09-10T06:22:31.813752+0000","last_active":"2024-09-10T06:24:00.413251+0000","last_peered":"2024-09-10T06:24:00.413251+0000","last_clean":"2024-09-10T06:24:00.413251+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:24:00.413251+0000","last_undegraded":"2024-09-10T06:24:00.413251+0000","last_fullsized":"2024-09-10T06:24:00.413251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:46.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380014+0000","last_change":"2024-09-10T06:22:33.818286+0000","last_active":"2024-09-10T06:25:46.380014+0000","last_peered":"2024-09-10T06:25:46.380014+0000","last_clean":"2024-09-10T06:25:46.380014+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:25:46.380014+0000","last_undegraded":"2024-09-10T06:25:46.380014+0000","last_fullsized":"2024-09-10T06:25:46.380014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841898+0000","last_change":"2024-09-10T06:22:31.809970+0000","last_active":"2024-09-10T06:23:12.841898+0000","last_peered":"2024-09-10T06:23:12.841898+0000","last_clean":"2024-09-10T06:23:12.841898+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:23:12.841898+0000","last_undegraded":"2024-09-10T06:23:12.841898+0000","last_fullsized":"2024-09-10T06:23:12.841898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:42.775634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.316095+0000","last_change":"2024-09-10T06:22:33.832194+0000","last_active":"2024-09-10T06:25:46.316095+0000","last_peered":"2024-09-10T06:25:46.316095+0000","last_clean":"2024-09-10T06:25:46.316095+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:25:46.316095+0000","last_undegraded":"2024-09-10T06:25:46.316095+0000","last_fullsized":"2024-09-10T06:25:46.316095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858710+0000","last_change":"2024-09-10T06:22:31.833838+0000","last_active":"2024-09-10T06:23:12.858710+0000","last_peered":"2024-09-10T06:23:12.858710+0000","last_clean":"2024-09-10T06:23:12.858710+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:23:12.858710+0000","last_undegraded":"2024-09-10T06:23:12.858710+0000","last_fullsized":"2024-09-10T06:23:12.858710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314627+0000","last_change":"2024-09-10T06:22:33.820714+0000","last_active":"2024-09-10T06:25:46.314627+0000","last_peered":"2024-09-10T06:25:46.314627+0000","last_clean":"2024-09-10T06:25:46.314627+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:25:46.314627+0000","last_undegraded":"2024-09-10T06:25:46.314627+0000","last_fullsized":"2024-09-10T06:25:46.314627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:18.899048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848587+0000","last_change":"2024-09-10T06:22:31.833522+0000","last_active":"2024-09-10T06:23:12.848587+0000","last_peered":"2024-09-10T06:23:12.848587+0000","last_clean":"2024-09-10T06:23:12.848587+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:23:12.848587+0000","last_undegraded":"2024-09-10T06:23:12.848587+0000","last_fullsized":"2024-09-10T06:23:12.848587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:11.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028535+0000","last_change":"2024-09-10T06:22:33.822155+0000","last_active":"2024-09-10T06:25:46.028535+0000","last_peered":"2024-09-10T06:25:46.028535+0000","last_clean":"2024-09-10T06:25:46.028535+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:25:46.028535+0000","last_undegraded":"2024-09-10T06:25:46.028535+0000","last_fullsized":"2024-09-10T06:25:46.028535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842016+0000","last_change":"2024-09-10T06:22:31.809583+0000","last_active":"2024-09-10T06:23:12.842016+0000","last_peered":"2024-09-10T06:23:12.842016+0000","last_clean":"2024-09-10T06:23:12.842016+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:23:12.842016+0000","last_undegraded":"2024-09-10T06:23:12.842016+0000","last_fullsized":"2024-09-10T06:23:12.842016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:53.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'15","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851583+0000","last_change":"2024-09-10T06:22:33.844903+0000","last_active":"2024-09-10T06:24:52.851583+0000","last_peered":"2024-09-10T06:24:52.851583+0000","last_clean":"2024-09-10T06:24:52.851583+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:24:52.851583+0000","last_undegraded":"2024-09-10T06:24:52.851583+0000","last_fullsized":"2024-09-10T06:24:52.851583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:16.098280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.564147+0000","last_change":"2024-09-10T06:22:31.828487+0000","last_active":"2024-09-10T06:23:15.564147+0000","last_peered":"2024-09-10T06:23:15.564147+0000","last_clean":"2024-09-10T06:23:15.564147+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:23:15.564147+0000","last_undegraded":"2024-09-10T06:23:15.564147+0000","last_fullsized":"2024-09-10T06:23:15.564147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:47.707056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563325+0000","last_change":"2024-09-10T06:22:31.813099+0000","last_active":"2024-09-10T06:23:15.563325+0000","last_peered":"2024-09-10T06:23:15.563325+0000","last_clean":"2024-09-10T06:23:15.563325+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:23:15.563325+0000","last_undegraded":"2024-09-10T06:23:15.563325+0000","last_fullsized":"2024-09-10T06:23:15.563325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.402083+0000","last_change":"2024-09-10T06:22:33.818285+0000","last_active":"2024-09-10T06:23:16.402083+0000","last_peered":"2024-09-10T06:23:16.402083+0000","last_clean":"2024-09-10T06:23:16.402083+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:23:16.402083+0000","last_undegraded":"2024-09-10T06:23:16.402083+0000","last_fullsized":"2024-09-10T06:23:16.402083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.081113+0000","last_change":"2024-09-10T06:22:31.812762+0000","last_active":"2024-09-10T06:24:41.081113+0000","last_peered":"2024-09-10T06:24:41.081113+0000","last_clean":"2024-09-10T06:24:41.081113+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:24:41.081113+0000","last_undegraded":"2024-09-10T06:24:41.081113+0000","last_fullsized":"2024-09-10T06:24:41.081113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:32.725312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.910497+0000","last_change":"2024-09-10T06:22:33.811540+0000","last_active":"2024-09-10T06:25:45.910497+0000","last_peered":"2024-09-10T06:25:45.910497+0000","last_clean":"2024-09-10T06:25:45.910497+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:25:45.910497+0000","last_undegraded":"2024-09-10T06:25:45.910497+0000","last_fullsized":"2024-09-10T06:25:45.910497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:40.528357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845567+0000","last_change":"2024-09-10T06:22:31.811935+0000","last_active":"2024-09-10T06:23:12.845567+0000","last_peered":"2024-09-10T06:23:12.845567+0000","last_clean":"2024-09-10T06:23:12.845567+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:23:12.845567+0000","last_undegraded":"2024-09-10T06:23:12.845567+0000","last_fullsized":"2024-09-10T06:23:12.845567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315934+0000","last_change":"2024-09-10T06:22:33.828847+0000","last_active":"2024-09-10T06:25:46.315934+0000","last_peered":"2024-09-10T06:25:46.315934+0000","last_clean":"2024-09-10T06:25:46.315934+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:25:46.315934+0000","last_undegraded":"2024-09-10T06:25:46.315934+0000","last_fullsized":"2024-09-10T06:25:46.315934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839176+0000","last_change":"2024-09-10T06:22:31.832535+0000","last_active":"2024-09-10T06:23:12.839176+0000","last_peered":"2024-09-10T06:23:12.839176+0000","last_clean":"2024-09-10T06:23:12.839176+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:23:12.839176+0000","last_undegraded":"2024-09-10T06:23:12.839176+0000","last_fullsized":"2024-09-10T06:23:12.839176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:34.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315089+0000","last_change":"2024-09-10T06:22:33.845847+0000","last_active":"2024-09-10T06:25:46.315089+0000","last_peered":"2024-09-10T06:25:46.315089+0000","last_clean":"2024-09-10T06:25:46.315089+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:25:46.315089+0000","last_undegraded":"2024-09-10T06:25:46.315089+0000","last_fullsized":"2024-09-10T06:25:46.315089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848612+0000","last_change":"2024-09-10T06:22:31.838658+0000","last_active":"2024-09-10T06:23:12.848612+0000","last_peered":"2024-09-10T06:23:12.848612+0000","last_clean":"2024-09-10T06:23:12.848612+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:23:12.848612+0000","last_undegraded":"2024-09-10T06:23:12.848612+0000","last_fullsized":"2024-09-10T06:23:12.848612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:56.723910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848557+0000","last_change":"2024-09-10T06:23:12.871593+0000","last_active":"2024-09-10T06:23:16.848557+0000","last_peered":"2024-09-10T06:23:16.848557+0000","last_clean":"2024-09-10T06:23:16.848557+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:23:16.848557+0000","last_undegraded":"2024-09-10T06:23:16.848557+0000","last_fullsized":"2024-09-10T06:23:16.848557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.458403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848766+0000","last_change":"2024-09-10T06:22:31.832744+0000","last_active":"2024-09-10T06:23:12.848766+0000","last_peered":"2024-09-10T06:23:12.848766+0000","last_clean":"2024-09-10T06:23:12.848766+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:23:12.848766+0000","last_undegraded":"2024-09-10T06:23:12.848766+0000","last_fullsized":"2024-09-10T06:23:12.848766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:59.824161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849028+0000","last_change":"2024-09-10T06:22:33.824001+0000","last_active":"2024-09-10T06:24:42.849028+0000","last_peered":"2024-09-10T06:24:42.849028+0000","last_clean":"2024-09-10T06:24:42.849028+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:24:42.849028+0000","last_undegraded":"2024-09-10T06:24:42.849028+0000","last_fullsized":"2024-09-10T06:24:42.849028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:04.705910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.190954+0000","last_change":"2024-09-10T06:22:31.828589+0000","last_active":"2024-09-10T06:25:46.190954+0000","last_peered":"2024-09-10T06:25:46.190954+0000","last_clean":"2024-09-10T06:25:46.190954+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:25:46.190954+0000","last_undegraded":"2024-09-10T06:25:46.190954+0000","last_fullsized":"2024-09-10T06:25:46.190954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:13.166658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836407+0000","last_change":"2024-09-10T06:22:31.822739+0000","last_active":"2024-09-10T06:23:12.836407+0000","last_peered":"2024-09-10T06:23:12.836407+0000","last_clean":"2024-09-10T06:23:12.836407+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:23:12.836407+0000","last_undegraded":"2024-09-10T06:23:12.836407+0000","last_fullsized":"2024-09-10T06:23:12.836407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:18.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427151+0000","last_change":"2024-09-10T06:22:33.834781+0000","last_active":"2024-09-10T06:24:00.427151+0000","last_peered":"2024-09-10T06:24:00.427151+0000","last_clean":"2024-09-10T06:24:00.427151+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:24:00.427151+0000","last_undegraded":"2024-09-10T06:24:00.427151+0000","last_fullsized":"2024-09-10T06:24:00.427151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.042356+0000","last_change":"2024-09-10T06:22:31.814239+0000","last_active":"2024-09-10T06:24:45.042356+0000","last_peered":"2024-09-10T06:24:45.042356+0000","last_clean":"2024-09-10T06:24:45.042356+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:24:45.042356+0000","last_undegraded":"2024-09-10T06:24:45.042356+0000","last_fullsized":"2024-09-10T06:24:45.042356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226303+0000","last_change":"2024-09-10T06:22:33.828192+0000","last_active":"2024-09-10T06:25:46.226303+0000","last_peered":"2024-09-10T06:25:46.226303+0000","last_clean":"2024-09-10T06:25:46.226303+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:25:46.226303+0000","last_undegraded":"2024-09-10T06:25:46.226303+0000","last_fullsized":"2024-09-10T06:25:46.226303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:17.430784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56276,"kb_used_data":20932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315564,"statfs":{"total":96636764160,"available":96579137536,"internally_reserved":0,"allocated":21434368,"data_stored":21108121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53324,"kb_used_data":17980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318516,"statfs":{"total":96636764160,"available":96582160384,"internally_reserved":0,"allocated":18411520,"data_stored":18144049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4918891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":9240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":9461760,"data_stored":9165923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":17417088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:18.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:19.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.127+0000 7f447978b640 1 Processor -- start 2024-09-10T06:26:19.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.127+0000 7f447978b640 1 -- start start 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4474111890 0x7f4474134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4474112730 con 0x7f4474110da0 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4474073a90 con 0x7f4474111890 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f44727fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4474111890 0x7f4474134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f4472ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4474110da0 0x7f4474111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53516/0 (socket says 172.21.15.84:53516) 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f4472ffd640 1 -- 172.21.15.84:0/757327926 learned_addr learned my addr 172.21.15.84:0/757327926 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f44727fc640 1 -- 172.21.15.84:0/757327926 >> v1:172.21.15.84:6789/0 conn(0x7f4474110da0 legacy=0x7f4474111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:19.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f44727fc640 1 -- 172.21.15.84:0/757327926 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4474112b70 con 0x7f4474111890 2024-09-10T06:26:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f44727fc640 1 --2- 172.21.15.84:0/757327926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474111890 0x7f4474134750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f446c009740 tx=0x7f446c01c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f830390e6b26ba68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f4471ffb640 1 -- 172.21.15.84:0/757327926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f446c0b0070 con 0x7f4474111890 2024-09-10T06:26:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f4471ffb640 1 -- 172.21.15.84:0/757327926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446c0ab530 con 0x7f4474111890 2024-09-10T06:26:19.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f4471ffb640 1 -- 172.21.15.84:0/757327926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f446c0ab830 con 0x7f4474111890 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- 172.21.15.84:0/757327926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474111890 msgr2=0x7f4474134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 --2- 172.21.15.84:0/757327926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474111890 0x7f4474134750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f446c009740 tx=0x7f446c01c200 comp rx=0 tx=0).stop 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- 172.21.15.84:0/757327926 shutdown_connections 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 --2- 172.21.15.84:0/757327926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474111890 0x7f4474134750 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- 172.21.15.84:0/757327926 >> 172.21.15.84:0/757327926 conn(0x7f4474070900 msgr2=0x7f4474072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- 172.21.15.84:0/757327926 shutdown_connections 2024-09-10T06:26:19.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.131+0000 7f447978b640 1 -- 172.21.15.84:0/757327926 wait complete. 2024-09-10T06:26:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 Processor -- start 2024-09-10T06:26:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 -- start start 2024-09-10T06:26:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4474137840 con 0x7f4474110da0 2024-09-10T06:26:19.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f4472ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:19.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f4472ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45830/0 (socket says 172.21.15.84:45830) 2024-09-10T06:26:19.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f4472ffd640 1 -- 172.21.15.84:0/1668425069 learned_addr learned my addr 172.21.15.84:0/1668425069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:19.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f4472ffd640 1 -- 172.21.15.84:0/1668425069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447411d970 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f4472ffd640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f446800cb60 tx=0x7f446800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4468018070 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4468004cc0 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f446800ab60 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447412bae0 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447412bfa0 con 0x7f4474110da0 2024-09-10T06:26:19.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4474111180 con 0x7f4474110da0 2024-09-10T06:26:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f446801b070 con 0x7f4474110da0 2024-09-10T06:26:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 0x7f446003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.135+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f446804f110 con 0x7f4474110da0 2024-09-10T06:26:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.139+0000 7f44727fc640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 0x7f446003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:19.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.139+0000 7f44727fc640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 0x7f446003d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f446c0ad000 tx=0x7f446c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:19.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.143+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4474112730 con 0x7f4474110da0 2024-09-10T06:26:19.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.311+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f447411e600 con 0x7f4474110da0 2024-09-10T06:26:19.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.315+0000 7f445b7fe640 1 -- 172.21.15.84:0/1668425069 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+21300 (secure 0 0 0) 0x7f4468007970 con 0x7f4474110da0 2024-09-10T06:26:19.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:19.321 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"fsid":"2ef3ea51-0aa2-410c-a700-42b75c2c5647","created":"2024-09-10T06:22:06.827700+0000","modified":"2024-09-10T06:23:12.829955+0000","last_up_change":"2024-09-10T06:22:17.828893+0000","last_in_change":"2024-09-10T06:22:07.987315+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:22:17.788831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:22:22.651461+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T06:22:30.410131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.440000057220459,"score_stable":1.440000057220459,"optimal_score":1,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T06:22:32.147812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T06:22:34.052863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T06:22:35.962097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T06:22:37.872885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T06:22:40.012220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7a0b7f6-f5a2-4cfe-8754-1f9d6147c8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6801","nonce":3404052370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6803","nonce":3404052370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6807","nonce":3404052370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3404052370},{"type":"v1","addr":"172.21.15.84:6805","nonce":3404052370}]},"public_addr":"172.21.15.84:6801/3404052370","cluster_addr":"172.21.15.84:6803/3404052370","heartbeat_back_addr":"172.21.15.84:6807/3404052370","heartbeat_front_addr":"172.21.15.84:6805/3404052370","state":["exists","up"]},{"osd":1,"uuid":"5d55d896-afbf-4432-bd18-58d467a7d1f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6801","nonce":2871996333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6803","nonce":2871996333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6807","nonce":2871996333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2871996333},{"type":"v1","addr":"172.21.15.117:6805","nonce":2871996333}]},"public_addr":"172.21.15.117:6801/2871996333","cluster_addr":"172.21.15.117:6803/2871996333","heartbeat_back_addr":"172.21.15.117:6807/2871996333","heartbeat_front_addr":"172.21.15.117:6805/2871996333","state":["exists","up"]},{"osd":2,"uuid":"8acf9814-f38c-4435-a9b9-9e76a12de1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6817","nonce":4244172515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6819","nonce":4244172515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6823","nonce":4244172515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4244172515},{"type":"v1","addr":"172.21.15.117:6821","nonce":4244172515}]},"public_addr":"172.21.15.117:6817/4244172515","cluster_addr":"172.21.15.117:6819/4244172515","heartbeat_back_addr":"172.21.15.117:6823/4244172515","heartbeat_front_addr":"172.21.15.117:6821/4244172515","state":["exists","up"]},{"osd":3,"uuid":"2ff55d34-0779-423c-9fe7-52cc85bf4cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6809","nonce":266380039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6811","nonce":266380039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6815","nonce":266380039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":266380039},{"type":"v1","addr":"172.21.15.117:6813","nonce":266380039}]},"public_addr":"172.21.15.117:6809/266380039","cluster_addr":"172.21.15.117:6811/266380039","heartbeat_back_addr":"172.21.15.117:6815/266380039","heartbeat_front_addr":"172.21.15.117:6813/266380039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:13.858277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.218064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:15.181465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:22:14.860325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":3,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 msgr2=0x7f446003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 0x7f446003d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f446c0ad000 tx=0x7f446c0a6000 comp rx=0 tx=0).stop 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 msgr2=0x7f447412b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f446800cb60 tx=0x7f446800a430 comp rx=0 tx=0).stop 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 shutdown_connections 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f446003b200 0x7f446003d6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 --2- 172.21.15.84:0/1668425069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4474110da0 0x7f447412b5a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 >> 172.21.15.84:0/1668425069 conn(0x7f4474070900 msgr2=0x7f447412e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 shutdown_connections 2024-09-10T06:26:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:19.319+0000 7f447978b640 1 -- 172.21.15.84:0/1668425069 wait complete. 2024-09-10T06:26:20.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-10T06:26:20.340 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T06:26:20.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:26:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01e6368640 1 Processor -- start 2024-09-10T06:26:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01e6368640 1 -- start start 2024-09-10T06:26:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01e6368640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01e0129a20 0x7f01e0129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01e6368640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e012a930 con 0x7f01e012a4f0 2024-09-10T06:26:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01e6368640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f01e0069170 con 0x7f01e0129a20 2024-09-10T06:26:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01dffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01e0129a20 0x7f01e0129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01df7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01e012a4f0 0x7f01e012cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53532/0 (socket says 172.21.15.84:53532) 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01dffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01e0129a20 0x7f01e0129fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45840/0 (socket says 172.21.15.84:45840) 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01df7fe640 1 -- 172.21.15.84:0/1216355233 learned_addr learned my addr 172.21.15.84:0/1216355233 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01dffff640 1 -- 172.21.15.84:0/1216355233 >> v1:172.21.15.84:6789/0 conn(0x7f01e012a4f0 legacy=0x7f01e012cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01dffff640 1 -- 172.21.15.84:0/1216355233 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0114950 con 0x7f01e0129a20 2024-09-10T06:26:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.475+0000 7f01deffd640 1 -- 172.21.15.84:0/1216355233 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928638165 0 0) 0x7f01d0001120 con 0x7f01e012a4f0 2024-09-10T06:26:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 --2- 172.21.15.84:0/1216355233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0129fb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009740 tx=0x7f01d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec79d984b5a61df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01deffd640 1 -- 172.21.15.84:0/1216355233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d40b0070 con 0x7f01e0129a20 2024-09-10T06:26:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01deffd640 1 -- 172.21.15.84:0/1216355233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d40ab530 con 0x7f01e0129a20 2024-09-10T06:26:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01deffd640 1 -- 172.21.15.84:0/1216355233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d40ab830 con 0x7f01e0129a20 2024-09-10T06:26:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/1216355233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 msgr2=0x7f01e0129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 --2- 172.21.15.84:0/1216355233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0129fb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009740 tx=0x7f01d401c370 comp rx=0 tx=0).stop 2024-09-10T06:26:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/1216355233 shutdown_connections 2024-09-10T06:26:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 --2- 172.21.15.84:0/1216355233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0129fb0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/1216355233 >> 172.21.15.84:0/1216355233 conn(0x7f01e0070d70 msgr2=0x7f01e0073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/1216355233 shutdown_connections 2024-09-10T06:26:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/1216355233 wait complete. 2024-09-10T06:26:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 Processor -- start 2024-09-10T06:26:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- start start 2024-09-10T06:26:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0135ce0 con 0x7f01e0129a20 2024-09-10T06:26:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45842/0 (socket says 172.21.15.84:45842) 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 -- 172.21.15.84:0/2627165070 learned_addr learned my addr 172.21.15.84:0/2627165070 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e01329f0 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dffff640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ae040 tx=0x7f01d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d40b0050 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d40b1040 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e0112d80 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d40b58b0 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e0123880 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.479+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01e0113e60 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f01d40be030 con 0x7f01e0129a20 2024-09-10T06:26:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 0x7f01cc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f01d40bc070 con 0x7f01e0129a20 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 0x7f01cc049520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01d40044a0 con 0x7f01cc047080 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f01d40f0050 con 0x7f01e0129a20 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01e4905640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 0x7f01cc049520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01df7fe640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 0x7f01cc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01e4905640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 0x7f01cc049520 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01df7fe640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 0x7f01cc03d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f01d0000c10 tx=0x7f01d0001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.483+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== osd.0 v2:172.21.15.84:6800/3404052370 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01d40044a0 con 0x7f01cc047080 2024-09-10T06:26:20.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 --> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01e0129fb0 con 0x7f01cc047080 2024-09-10T06:26:20.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01dcff9640 1 -- 172.21.15.84:0/2627165070 <== osd.0 v2:172.21.15.84:6800/3404052370 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01e0129fb0 con 0x7f01cc047080 2024-09-10T06:26:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T06:26:20.501 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:26:20.502 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 msgr2=0x7f01cc049520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 0x7f01cc049520 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 msgr2=0x7f01cc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 0x7f01cc03d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f01d0000c10 tx=0x7f01d0001260 comp rx=0 tx=0).stop 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 msgr2=0x7f01e0131050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ae040 tx=0x7f01d401abb0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 shutdown_connections 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:6800/3404052370,v1:172.21.15.84:6801/3404052370] conn(0x7f01cc047080 0x7f01cc049520 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f01cc03b1d0 0x7f01cc03d690 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 --2- 172.21.15.84:0/2627165070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e0129a20 0x7f01e0131050 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 >> 172.21.15.84:0/2627165070 conn(0x7f01e0070d70 msgr2=0x7f01e0127f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 shutdown_connections 2024-09-10T06:26:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.495+0000 7f01e6368640 1 -- 172.21.15.84:0/2627165070 wait complete. 2024-09-10T06:26:20.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f44281b1640 1 Processor -- start 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f44281b1640 1 -- start start 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f44281b1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f442012c700 0x7f44201346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f44281b1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4420073830 con 0x7f442012bc10 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f44281b1640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4420071eb0 con 0x7f442012c700 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f4425f4d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f442012bc10 0x7f442012bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53534/0 (socket says 172.21.15.84:53534) 2024-09-10T06:26:20.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f4425f4d640 1 -- 172.21.15.84:0/4083258919 learned_addr learned my addr 172.21.15.84:0/4083258919 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:20.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f442574c640 1 --2- 172.21.15.84:0/4083258919 >> v2:172.21.15.84:3300/0 conn(0x7f442012c700 0x7f44201346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f4424f4b640 1 -- 172.21.15.84:0/4083258919 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188175543 0 0) 0x7f4420073830 con 0x7f442012bc10 2024-09-10T06:26:20.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f4424f4b640 1 -- 172.21.15.84:0/4083258919 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f440c003530 con 0x7f442012bc10 2024-09-10T06:26:20.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f442574c640 1 -- 172.21.15.84:0/4083258919 >> v1:172.21.15.84:6789/0 conn(0x7f442012bc10 legacy=0x7f442012bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.627+0000 7f442574c640 1 -- 172.21.15.84:0/4083258919 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44200a30b0 con 0x7f442012c700 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f442574c640 1 --2- 172.21.15.84:0/4083258919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012c700 0x7f44201346a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4410009740 tx=0x7f441001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4b79ec7937098d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4424f4b640 1 -- 172.21.15.84:0/4083258919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44100b0070 con 0x7f442012c700 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4424f4b640 1 -- 172.21.15.84:0/4083258919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44100ab530 con 0x7f442012c700 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4424f4b640 1 -- 172.21.15.84:0/4083258919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44100ab830 con 0x7f442012c700 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/4083258919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012c700 msgr2=0x7f44201346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 --2- 172.21.15.84:0/4083258919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012c700 0x7f44201346a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4410009740 tx=0x7f441001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/4083258919 shutdown_connections 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 --2- 172.21.15.84:0/4083258919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012c700 0x7f44201346a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/4083258919 >> 172.21.15.84:0/4083258919 conn(0x7f44200a0a60 msgr2=0x7f442006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/4083258919 shutdown_connections 2024-09-10T06:26:20.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/4083258919 wait complete. 2024-09-10T06:26:20.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 Processor -- start 2024-09-10T06:26:20.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- start start 2024-09-10T06:26:20.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4420137790 con 0x7f442012bc10 2024-09-10T06:26:20.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4425f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4425f4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45870/0 (socket says 172.21.15.84:45870) 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4425f4d640 1 -- 172.21.15.84:0/3688575950 learned_addr learned my addr 172.21.15.84:0/3688575950 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4425f4d640 1 -- 172.21.15.84:0/3688575950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4420073a50 con 0x7f442012bc10 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f4425f4d640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c450 tx=0x7f441c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f441c017070 con 0x7f442012bc10 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c005ce0 con 0x7f442012bc10 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f441c007200 con 0x7f442012bc10 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442011c1b0 con 0x7f442012bc10 2024-09-10T06:26:20.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.631+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442012ab90 con 0x7f442012bc10 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442012bff0 con 0x7f442012bc10 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f441c01a070 con 0x7f442012bc10 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f44167fc640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 0x7f440403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f441c04e960 con 0x7f442012bc10 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f442574c640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 0x7f440403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.635+0000 7f442574c640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 0x7f440403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44100ad000 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.639+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f441c012400 con 0x7f442012bc10 2024-09-10T06:26:20.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.795+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f442011d370 con 0x7f440403b1d0 2024-09-10T06:26:20.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.795+0000 7f44167fc640 1 -- 172.21.15.84:0/3688575950 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f442011d370 con 0x7f440403b1d0 2024-09-10T06:26:20.799 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T06:26:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 msgr2=0x7f440403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 0x7f440403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f44100ad000 tx=0x7f4410008040 comp rx=0 tx=0).stop 2024-09-10T06:26:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 msgr2=0x7f442012a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c450 tx=0x7f441c00c910 comp rx=0 tx=0).stop 2024-09-10T06:26:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 shutdown_connections 2024-09-10T06:26:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f440403b1d0 0x7f440403d690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 --2- 172.21.15.84:0/3688575950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442012bc10 0x7f442012a650 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 >> 172.21.15.84:0/3688575950 conn(0x7f44200a0a60 msgr2=0x7f4420070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 shutdown_connections 2024-09-10T06:26:20.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.799+0000 7f44281b1640 1 -- 172.21.15.84:0/3688575950 wait complete. 2024-09-10T06:26:20.818 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T06:26:20.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:26:20.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6db63a5640 1 Processor -- start 2024-09-10T06:26:20.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6db63a5640 1 -- start start 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6db63a5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6db0129a20 0x7f6db0129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6db63a5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db012a930 con 0x7f6db012a4f0 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6db63a5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6db0069170 con 0x7f6db0129a20 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6db0129a20 0x7f6db0129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daf7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6db012a4f0 0x7f6db012cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53542/0 (socket says 172.21.15.84:53542) 2024-09-10T06:26:20.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daf7fe640 1 -- 172.21.15.84:0/3042782498 learned_addr learned my addr 172.21.15.84:0/3042782498 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daffff640 1 -- 172.21.15.84:0/3042782498 >> v1:172.21.15.84:6789/0 conn(0x7f6db012a4f0 legacy=0x7f6db012cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daffff640 1 -- 172.21.15.84:0/3042782498 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0114950 con 0x7f6db0129a20 2024-09-10T06:26:20.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daffff640 1 --2- 172.21.15.84:0/3042782498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db0129a20 0x7f6db0129fb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009740 tx=0x7f6da001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78077f1a0836cee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daeffd640 1 -- 172.21.15.84:0/3042782498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da00b0070 con 0x7f6db0129a20 2024-09-10T06:26:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daeffd640 1 -- 172.21.15.84:0/3042782498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00ab530 con 0x7f6db0129a20 2024-09-10T06:26:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.923+0000 7f6daeffd640 1 -- 172.21.15.84:0/3042782498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da00ab830 con 0x7f6db0129a20 2024-09-10T06:26:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3042782498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db0129a20 msgr2=0x7f6db0129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3042782498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db0129a20 0x7f6db0129fb0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009740 tx=0x7f6da001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3042782498 shutdown_connections 2024-09-10T06:26:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3042782498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db0129a20 0x7f6db0129fb0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3042782498 >> 172.21.15.84:0/3042782498 conn(0x7f6db0070d70 msgr2=0x7f6db0073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3042782498 shutdown_connections 2024-09-10T06:26:20.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3042782498 wait complete. 2024-09-10T06:26:20.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 Processor -- start 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- start start 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6db0135ce0 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6daffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6daffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45898/0 (socket says 172.21.15.84:45898) 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6daffff640 1 -- 172.21.15.84:0/3133263481 learned_addr learned my addr 172.21.15.84:0/3133263481 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6daffff640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0112d80 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6daffff640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6da0019fa0 tx=0x7f6da001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da00b0050 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00bc070 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db0123bf0 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da00aa780 con 0x7f6db012a4f0 2024-09-10T06:26:20.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db0113410 con 0x7f6db012a4f0 2024-09-10T06:26:20.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6db01329f0 con 0x7f6db012a4f0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6da00aa920 con 0x7f6db012a4f0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 0x7f6d9c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f6da00ea1a0 con 0x7f6db012a4f0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 0x7f6d9c049470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6da00b1e50 con 0x7f6d9c046fd0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.927+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6da00f1050 con 0x7f6db012a4f0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.931+0000 7f6daf7fe640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 0x7f6d9c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.931+0000 7f6db4942640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 0x7f6d9c049470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.931+0000 7f6db4942640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 0x7f6d9c049470 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.931+0000 7f6daf7fe640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 0x7f6d9c03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000f70 tx=0x7f6da4007af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:20.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.931+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== osd.1 v2:172.21.15.117:6800/2871996333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6da00b1e50 con 0x7f6d9c046fd0 2024-09-10T06:26:20.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.943+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 --> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6db0114060 con 0x7f6d9c046fd0 2024-09-10T06:26:20.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.943+0000 7f6dacff9640 1 -- 172.21.15.84:0/3133263481 <== osd.1 v2:172.21.15.117:6800/2871996333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6da800ad90 con 0x7f6d9c046fd0 2024-09-10T06:26:20.949 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T06:26:20.950 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:26:20.950 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 msgr2=0x7f6d9c049470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 0x7f6d9c049470 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 msgr2=0x7f6d9c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 0x7f6d9c03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000f70 tx=0x7f6da4007af0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 msgr2=0x7f6db01236b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6da0019fa0 tx=0x7f6da001abb0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 shutdown_connections 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6800/2871996333,v1:172.21.15.117:6801/2871996333] conn(0x7f6d9c046fd0 0x7f6d9c049470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f6d9c03b1d0 0x7f6d9c03d690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 --2- 172.21.15.84:0/3133263481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6db012a4f0 0x7f6db01236b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:20.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 >> 172.21.15.84:0/3133263481 conn(0x7f6db0070d70 msgr2=0x7f6db0127ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:20.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 shutdown_connections 2024-09-10T06:26:20.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:20.947+0000 7f6db63a5640 1 -- 172.21.15.84:0/3133263481 wait complete. 2024-09-10T06:26:20.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T06:26:21.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc96ea640 1 Processor -- start 2024-09-10T06:26:21.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc96ea640 1 -- start start 2024-09-10T06:26:21.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc96ea640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fc412e8e0 0x7f8fc4130cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc96ea640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc4073ad0 con 0x7f8fc412b980 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc96ea640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc406dcb0 con 0x7f8fc412e8e0 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fba7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fc412e8e0 0x7f8fc4130cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc2ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8fc412b980 0x7f8fc412bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53544/0 (socket says 172.21.15.84:53544) 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.067+0000 7f8fc2ffd640 1 -- 172.21.15.84:0/3542371246 learned_addr learned my addr 172.21.15.84:0/3542371246 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc27fc640 1 -- 172.21.15.84:0/3542371246 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800312688 0 0) 0x7f8fc4073ad0 con 0x7f8fc412b980 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc27fc640 1 -- 172.21.15.84:0/3542371246 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fb0003530 con 0x7f8fc412b980 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fba7fc640 1 -- 172.21.15.84:0/3542371246 >> v1:172.21.15.84:6789/0 conn(0x7f8fc412b980 legacy=0x7f8fc412bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fba7fc640 1 -- 172.21.15.84:0/3542371246 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc41127f0 con 0x7f8fc412e8e0 2024-09-10T06:26:21.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fba7fc640 1 --2- 172.21.15.84:0/3542371246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412e8e0 0x7f8fc4130cd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00a8e0 tx=0x7f8fac01d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ad48cb1c58aa94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc27fc640 1 -- 172.21.15.84:0/3542371246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fac00b040 con 0x7f8fc412e8e0 2024-09-10T06:26:21.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc27fc640 1 -- 172.21.15.84:0/3542371246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac0b1530 con 0x7f8fc412e8e0 2024-09-10T06:26:21.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc27fc640 1 -- 172.21.15.84:0/3542371246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fac0b1830 con 0x7f8fc412e8e0 2024-09-10T06:26:21.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- 172.21.15.84:0/3542371246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412e8e0 msgr2=0x7f8fc4130cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/3542371246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412e8e0 0x7f8fc4130cd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00a8e0 tx=0x7f8fac01d740 comp rx=0 tx=0).stop 2024-09-10T06:26:21.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- 172.21.15.84:0/3542371246 shutdown_connections 2024-09-10T06:26:21.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/3542371246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412e8e0 0x7f8fc4130cd0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- 172.21.15.84:0/3542371246 >> 172.21.15.84:0/3542371246 conn(0x7f8fc4070940 msgr2=0x7f8fc4072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- 172.21.15.84:0/3542371246 shutdown_connections 2024-09-10T06:26:21.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- 172.21.15.84:0/3542371246 wait complete. 2024-09-10T06:26:21.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 Processor -- start 2024-09-10T06:26:21.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.071+0000 7f8fc96ea640 1 -- start start 2024-09-10T06:26:21.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc96ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc96ea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4133c40 con 0x7f8fc412b980 2024-09-10T06:26:21.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45912/0 (socket says 172.21.15.84:45912) 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc2ffd640 1 -- 172.21.15.84:0/486441234 learned_addr learned my addr 172.21.15.84:0/486441234 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc2ffd640 1 -- 172.21.15.84:0/486441234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc412dd90 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc2ffd640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c450 tx=0x7f8fb400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb4017070 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb4005ce0 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc4125cc0 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb4007200 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc4118140 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc412bd60 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fb401a070 con 0x7f8fc412b980 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 0x7f8fa403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8fb404e970 con 0x7f8fc412b980 2024-09-10T06:26:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fba7fc640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 0x7f8fa403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.075+0000 7f8fba7fc640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 0x7f8fa403d6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0b0000 tx=0x7f8fac0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.079+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8fb4012400 con 0x7f8fc412b980 2024-09-10T06:26:21.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8fc4069c50 con 0x7f8fa403b200 2024-09-10T06:26:21.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fbbfff640 1 -- 172.21.15.84:0/486441234 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8fac0bc440 con 0x7f8fa403b200 2024-09-10T06:26:21.243 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 msgr2=0x7f8fa403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 0x7f8fa403d6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0b0000 tx=0x7f8fac0b3040 comp rx=0 tx=0).stop 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 msgr2=0x7f8fc412c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c450 tx=0x7f8fb400c910 comp rx=0 tx=0).stop 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 shutdown_connections 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f8fa403b200 0x7f8fa403d6c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 --2- 172.21.15.84:0/486441234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc412b980 0x7f8fc412c850 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 >> 172.21.15.84:0/486441234 conn(0x7f8fc4070940 msgr2=0x7f8fc41298a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 shutdown_connections 2024-09-10T06:26:21.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.239+0000 7f8fc96ea640 1 -- 172.21.15.84:0/486441234 wait complete. 2024-09-10T06:26:21.260 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T06:26:21.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:26:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe869f9f640 1 Processor -- start 2024-09-10T06:26:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe869f9f640 1 -- start start 2024-09-10T06:26:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe869f9f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe86412be40 0x7fe86412c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe869f9f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864115f00 con 0x7fe864116350 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe869f9f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe864116ac0 con 0x7fe86412be40 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe8637fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe86412be40 0x7fe86412c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe85bfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe864116350 0x7fe86412f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53554/0 (socket says 172.21.15.84:53554) 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe85bfff640 1 -- 172.21.15.84:0/1437613782 learned_addr learned my addr 172.21.15.84:0/1437613782 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:21.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe8637fe640 1 -- 172.21.15.84:0/1437613782 >> v1:172.21.15.84:6789/0 conn(0x7fe864116350 legacy=0x7fe86412f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe862ffd640 1 -- 172.21.15.84:0/1437613782 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153874455 0 0) 0x7fe864115f00 con 0x7fe864116350 2024-09-10T06:26:21.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe8637fe640 1 -- 172.21.15.84:0/1437613782 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86412c760 con 0x7fe86412be40 2024-09-10T06:26:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe8637fe640 1 --2- 172.21.15.84:0/1437613782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe86412be40 0x7fe86412c220 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe854009740 tx=0x7fe85401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee7a7c0f9d0af54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe862ffd640 1 -- 172.21.15.84:0/1437613782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8540b0070 con 0x7fe86412be40 2024-09-10T06:26:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe862ffd640 1 -- 172.21.15.84:0/1437613782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540ab530 con 0x7fe86412be40 2024-09-10T06:26:21.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.383+0000 7fe862ffd640 1 -- 172.21.15.84:0/1437613782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8540ab830 con 0x7fe86412be40 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1437613782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe86412be40 msgr2=0x7fe86412c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1437613782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe86412be40 0x7fe86412c220 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe854009740 tx=0x7fe85401c370 comp rx=0 tx=0).stop 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1437613782 shutdown_connections 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1437613782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe86412be40 0x7fe86412c220 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1437613782 >> 172.21.15.84:0/1437613782 conn(0x7fe86406fb10 msgr2=0x7fe864071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1437613782 shutdown_connections 2024-09-10T06:26:21.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1437613782 wait complete. 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 Processor -- start 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- start start 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe864137f20 con 0x7fe864116350 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe8637fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe8637fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45940/0 (socket says 172.21.15.84:45940) 2024-09-10T06:26:21.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe8637fe640 1 -- 172.21.15.84:0/1349632742 learned_addr learned my addr 172.21.15.84:0/1349632742 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe8637fe640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe864118480 con 0x7fe864116350 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe8637fe640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ae040 tx=0x7fe85401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8540b0050 con 0x7fe864116350 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540b1040 con 0x7fe864116350 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8540aab80 con 0x7fe864116350 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe864117a60 con 0x7fe864116350 2024-09-10T06:26:21.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641251c0 con 0x7fe864116350 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe864118040 con 0x7fe864116350 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe8540be030 con 0x7fe864116350 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.387+0000 7fe860ff9640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 0x7fe84403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe8540bc070 con 0x7fe864116350 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe860ff9640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 0x7fe8440494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8540a9ec0 con 0x7fe844047030 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe8540ee2a0 con 0x7fe864116350 2024-09-10T06:26:21.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe85bfff640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 0x7fe84403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe863fff640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 0x7fe8440494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe85bfff640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 0x7fe84403d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe84c007fd0 tx=0x7fe84c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe863fff640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 0x7fe8440494d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.391+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== osd.2 v2:172.21.15.117:6816/4244172515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8540a9ec0 con 0x7fe844047030 2024-09-10T06:26:21.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.403+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 --> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe864117830 con 0x7fe844047030 2024-09-10T06:26:21.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe860ff9640 1 -- 172.21.15.84:0/1349632742 <== osd.2 v2:172.21.15.117:6816/4244172515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe85c00ad10 con 0x7fe844047030 2024-09-10T06:26:21.410 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T06:26:21.410 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:26:21.410 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 msgr2=0x7fe8440494d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 0x7fe8440494d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 msgr2=0x7fe84403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 0x7fe84403d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe84c007fd0 tx=0x7fe84c007900 comp rx=0 tx=0).stop 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 msgr2=0x7fe864124ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe8540ae040 tx=0x7fe85401abb0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 shutdown_connections 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6816/4244172515,v1:172.21.15.117:6817/4244172515] conn(0x7fe844047030 0x7fe8440494d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe84403b1d0 0x7fe84403d690 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 --2- 172.21.15.84:0/1349632742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe864116350 0x7fe864124ab0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 >> 172.21.15.84:0/1349632742 conn(0x7fe86406fb10 msgr2=0x7fe864128740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 shutdown_connections 2024-09-10T06:26:21.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.407+0000 7fe869f9f640 1 -- 172.21.15.84:0/1349632742 wait complete. 2024-09-10T06:26:21.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T06:26:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12f23ed640 1 Processor -- start 2024-09-10T06:26:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12f23ed640 1 -- start start 2024-09-10T06:26:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12f23ed640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f12ec06f8e0 0x7f12ec134990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12f23ed640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12ec116e30 con 0x7f12ec06edf0 2024-09-10T06:26:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12f23ed640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f12ec0700f0 con 0x7f12ec06f8e0 2024-09-10T06:26:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12eb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f12ec06f8e0 0x7f12ec134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12ebfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f12ec06edf0 0x7f12ec06f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53556/0 (socket says 172.21.15.84:53556) 2024-09-10T06:26:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12ebfff640 1 -- 172.21.15.84:0/2758854438 learned_addr learned my addr 172.21.15.84:0/2758854438 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12eb7fe640 1 -- 172.21.15.84:0/2758854438 >> v1:172.21.15.84:6789/0 conn(0x7f12ec06edf0 legacy=0x7f12ec06f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12eaffd640 1 -- 172.21.15.84:0/2758854438 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046339142 0 0) 0x7f12ec116e30 con 0x7f12ec06edf0 2024-09-10T06:26:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.523+0000 7f12eb7fe640 1 -- 172.21.15.84:0/2758854438 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec116710 con 0x7f12ec06f8e0 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12eb7fe640 1 --2- 172.21.15.84:0/2758854438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06f8e0 0x7f12ec134990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009740 tx=0x7f12e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b5ec18406a93ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12eaffd640 1 -- 172.21.15.84:0/2758854438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12e00b0070 con 0x7f12ec06f8e0 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12eaffd640 1 -- 172.21.15.84:0/2758854438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e00ab530 con 0x7f12ec06f8e0 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12eaffd640 1 -- 172.21.15.84:0/2758854438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12e00ab830 con 0x7f12ec06f8e0 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/2758854438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06f8e0 msgr2=0x7f12ec134990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 --2- 172.21.15.84:0/2758854438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06f8e0 0x7f12ec134990 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009740 tx=0x7f12e001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:21.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/2758854438 shutdown_connections 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 --2- 172.21.15.84:0/2758854438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06f8e0 0x7f12ec134990 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/2758854438 >> 172.21.15.84:0/2758854438 conn(0x7f12ec071e50 msgr2=0x7f12ec09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/2758854438 shutdown_connections 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/2758854438 wait complete. 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 Processor -- start 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- start start 2024-09-10T06:26:21.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12ec137870 con 0x7f12ec06edf0 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45958/0 (socket says 172.21.15.84:45958) 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12ebfff640 1 -- 172.21.15.84:0/3107244459 learned_addr learned my addr 172.21.15.84:0/3107244459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12ebfff640 1 -- 172.21.15.84:0/3107244459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ec1341d0 con 0x7f12ec06edf0 2024-09-10T06:26:21.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12ebfff640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c3d0 tx=0x7f12dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc007410 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc0075d0 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ec134480 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc004960 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ec1246f0 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ec133f70 con 0x7f12ec06edf0 2024-09-10T06:26:21.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f12dc011070 con 0x7f12ec06edf0 2024-09-10T06:26:21.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 0x7f12d803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.527+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f12dc04f220 con 0x7f12ec06edf0 2024-09-10T06:26:21.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.531+0000 7f12eb7fe640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 0x7f12d803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.531+0000 7f12eb7fe640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 0x7f12d803d690 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12e00ad000 tx=0x7f12e00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.535+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f12dc010d50 con 0x7f12ec06edf0 2024-09-10T06:26:21.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.687+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f12ec117500 con 0x7f12d803b1d0 2024-09-10T06:26:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12e8ff9640 1 -- 172.21.15.84:0/3107244459 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12ec117500 con 0x7f12d803b1d0 2024-09-10T06:26:21.694 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T06:26:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 msgr2=0x7f12d803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 0x7f12d803d690 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12e00ad000 tx=0x7f12e00a6000 comp rx=0 tx=0).stop 2024-09-10T06:26:21.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 msgr2=0x7f12ec1241b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c3d0 tx=0x7f12dc00c890 comp rx=0 tx=0).stop 2024-09-10T06:26:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 shutdown_connections 2024-09-10T06:26:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f12d803b1d0 0x7f12d803d690 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 --2- 172.21.15.84:0/3107244459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12ec06edf0 0x7f12ec1241b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 >> 172.21.15.84:0/3107244459 conn(0x7f12ec071e50 msgr2=0x7f12ec12bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 shutdown_connections 2024-09-10T06:26:21.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.691+0000 7f12f23ed640 1 -- 172.21.15.84:0/3107244459 wait complete. 2024-09-10T06:26:21.711 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T06:26:21.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb85320640 1 Processor -- start 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb85320640 1 -- start start 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb85320640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb80114aa0 0x7ffb80132470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb85320640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8006e6f0 con 0x7ffb80113fb0 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb85320640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8006eb30 con 0x7ffb80114aa0 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb7e7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb80114aa0 0x7ffb80132470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb7effd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffb80113fb0 0x7ffb80114390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53570/0 (socket says 172.21.15.84:53570) 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb7effd640 1 -- 172.21.15.84:0/15154031 learned_addr learned my addr 172.21.15.84:0/15154031 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb7e7fc640 1 -- 172.21.15.84:0/15154031 >> v1:172.21.15.84:6789/0 conn(0x7ffb80113fb0 legacy=0x7ffb80114390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.819+0000 7ffb7e7fc640 1 -- 172.21.15.84:0/15154031 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8006de30 con 0x7ffb80114aa0 2024-09-10T06:26:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7e7fc640 1 --2- 172.21.15.84:0/15154031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80114aa0 0x7ffb80132470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009770 tx=0x7ffb7001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe97752898f2769 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7dffb640 1 -- 172.21.15.84:0/15154031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb700b0070 con 0x7ffb80114aa0 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7dffb640 1 -- 172.21.15.84:0/15154031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb700ab530 con 0x7ffb80114aa0 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7dffb640 1 -- 172.21.15.84:0/15154031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb700ab830 con 0x7ffb80114aa0 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/15154031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80114aa0 msgr2=0x7ffb80132470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 --2- 172.21.15.84:0/15154031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80114aa0 0x7ffb80132470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009770 tx=0x7ffb7001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/15154031 shutdown_connections 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 --2- 172.21.15.84:0/15154031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80114aa0 0x7ffb80132470 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/15154031 >> 172.21.15.84:0/15154031 conn(0x7ffb80071a90 msgr2=0x7ffb80071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/15154031 shutdown_connections 2024-09-10T06:26:21.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/15154031 wait complete. 2024-09-10T06:26:21.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 Processor -- start 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- start start 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb80135560 con 0x7ffb80113fb0 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45984/0 (socket says 172.21.15.84:45984) 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7effd640 1 -- 172.21.15.84:0/1499548998 learned_addr learned my addr 172.21.15.84:0/1499548998 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7effd640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb801152b0 con 0x7ffb80113fb0 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb7effd640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cb40 tx=0x7ffb7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78017070 con 0x7ffb80113fb0 2024-09-10T06:26:21.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb80131ad0 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7800aba0 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78012400 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.823+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb80132450 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb80114390 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb7801a070 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 0x7ffb6c03d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ffb7804f380 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 0x7ffb6c0493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb7801ae50 con 0x7ffb6c046f30 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ffb78056050 con 0x7ffb80113fb0 2024-09-10T06:26:21.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb7e7fc640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 0x7ffb6c03d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb7f7fe640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 0x7ffb6c0493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb7e7fc640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 0x7ffb6c03d670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb700ad000 tx=0x7ffb70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb7f7fe640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 0x7ffb6c0493d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.827+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== osd.3 v2:172.21.15.117:6808/266380039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb7801ae50 con 0x7ffb6c046f30 2024-09-10T06:26:21.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 --> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb80114aa0 con 0x7ffb6c046f30 2024-09-10T06:26:21.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb677fe640 1 -- 172.21.15.84:0/1499548998 <== osd.3 v2:172.21.15.117:6808/266380039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb80114aa0 con 0x7ffb6c046f30 2024-09-10T06:26:21.847 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T06:26:21.847 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:26:21.847 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T06:26:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 msgr2=0x7ffb6c0493d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 0x7ffb6c0493d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 msgr2=0x7ffb6c03d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 0x7ffb6c03d670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb700ad000 tx=0x7ffb70008040 comp rx=0 tx=0).stop 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 msgr2=0x7ffb80121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cb40 tx=0x7ffb7800a060 comp rx=0 tx=0).stop 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 shutdown_connections 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6808/266380039,v1:172.21.15.117:6809/266380039] conn(0x7ffb6c046f30 0x7ffb6c0493d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7ffb6c03b1b0 0x7ffb6c03d670 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 --2- 172.21.15.84:0/1499548998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb80113fb0 0x7ffb80121e00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 >> 172.21.15.84:0/1499548998 conn(0x7ffb80071a90 msgr2=0x7ffb8012ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 shutdown_connections 2024-09-10T06:26:21.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.843+0000 7ffb85320640 1 -- 172.21.15.84:0/1499548998 wait complete. 2024-09-10T06:26:21.861 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb741622640 1 Processor -- start 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb741622640 1 -- start start 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb741622640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb73c12bc10 0x7fb73c12bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb741622640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73c073830 con 0x7fb73c12c530 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb741622640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb73c071eb0 con 0x7fb73c12bc10 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb73affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb73c12bc10 0x7fb73c12bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb73a7fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb73c12c530 0x7fb73c12ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53580/0 (socket says 172.21.15.84:53580) 2024-09-10T06:26:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb73a7fc640 1 -- 172.21.15.84:0/289128986 learned_addr learned my addr 172.21.15.84:0/289128986 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb73affd640 1 -- 172.21.15.84:0/289128986 >> v1:172.21.15.84:6789/0 conn(0x7fb73c12c530 legacy=0x7fb73c12ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.959+0000 7fb73affd640 1 -- 172.21.15.84:0/289128986 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c0a30b0 con 0x7fb73c12bc10 2024-09-10T06:26:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 --2- 172.21.15.84:0/289128986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c12bff0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb730009740 tx=0x7fb73001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c475d7411739d5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb739ffb640 1 -- 172.21.15.84:0/289128986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300b0070 con 0x7fb73c12bc10 2024-09-10T06:26:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb739ffb640 1 -- 172.21.15.84:0/289128986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7300ab530 con 0x7fb73c12bc10 2024-09-10T06:26:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb739ffb640 1 -- 172.21.15.84:0/289128986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300ab830 con 0x7fb73c12bc10 2024-09-10T06:26:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/289128986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 msgr2=0x7fb73c12bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 --2- 172.21.15.84:0/289128986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c12bff0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb730009740 tx=0x7fb73001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/289128986 shutdown_connections 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 --2- 172.21.15.84:0/289128986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c12bff0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/289128986 >> 172.21.15.84:0/289128986 conn(0x7fb73c0a0a60 msgr2=0x7fb73c06e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/289128986 shutdown_connections 2024-09-10T06:26:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/289128986 wait complete. 2024-09-10T06:26:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 Processor -- start 2024-09-10T06:26:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- start start 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c137a50 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46010/0 (socket says 172.21.15.84:46010) 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 -- 172.21.15.84:0/3960876060 learned_addr learned my addr 172.21.15.84:0/3960876060 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 -- 172.21.15.84:0/3960876060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c073a50 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb73affd640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb730019fa0 tx=0x7fb73001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300b0050 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7300b1040 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7300b5740 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c11b730 con 0x7fb73c12bc10 2024-09-10T06:26:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.963+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c11c350 con 0x7fb73c12bc10 2024-09-10T06:26:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb7300be030 con 0x7fb73c12bc10 2024-09-10T06:26:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c12bff0 con 0x7fb73c12bc10 2024-09-10T06:26:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb7237fe640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 0x7fb72803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fb7300bc070 con 0x7fb73c12bc10 2024-09-10T06:26:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb73a7fc640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 0x7fb72803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.967+0000 7fb73a7fc640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 0x7fb72803d6c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005890 tx=0x7fb72c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:21.971+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb7300c5020 con 0x7fb73c12bc10 2024-09-10T06:26:22.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.135+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb73c11bce0 con 0x7fb72803b200 2024-09-10T06:26:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.135+0000 7fb7237fe640 1 -- 172.21.15.84:0/3960876060 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb73c11bce0 con 0x7fb72803b200 2024-09-10T06:26:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 msgr2=0x7fb72803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 0x7fb72803d6c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005890 tx=0x7fb72c007ab0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 msgr2=0x7fb73c129560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb730019fa0 tx=0x7fb73001abb0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 shutdown_connections 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fb72803b200 0x7fb72803d6c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 --2- 172.21.15.84:0/3960876060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb73c12bc10 0x7fb73c129560 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 >> 172.21.15.84:0/3960876060 conn(0x7fb73c0a0a60 msgr2=0x7fb73c0a0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 shutdown_connections 2024-09-10T06:26:22.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.139+0000 7fb741622640 1 -- 172.21.15.84:0/3960876060 wait complete. 2024-09-10T06:26:22.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:22.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.263+0000 7f5f7d3ea640 1 Processor -- start 2024-09-10T06:26:22.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.263+0000 7f5f7d3ea640 1 -- start start 2024-09-10T06:26:22.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.263+0000 7f5f7d3ea640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f78110da0 0x7f5f78111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:22.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.263+0000 7f5f7d3ea640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f78073a90 con 0x7f5f781116c0 2024-09-10T06:26:22.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.263+0000 7f5f7d3ea640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5f780696e0 con 0x7f5f78110da0 2024-09-10T06:26:22.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f76ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f78110da0 0x7f5f78111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:22.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f767fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f781116c0 0x7f5f781231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53592/0 (socket says 172.21.15.84:53592) 2024-09-10T06:26:22.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f767fc640 1 -- 172.21.15.84:0/3215070008 learned_addr learned my addr 172.21.15.84:0/3215070008 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:22.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f76ffd640 1 -- 172.21.15.84:0/3215070008 >> v1:172.21.15.84:6789/0 conn(0x7f5f781116c0 legacy=0x7f5f781231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f76ffd640 1 -- 172.21.15.84:0/3215070008 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7806dd50 con 0x7f5f78110da0 2024-09-10T06:26:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f76ffd640 1 --2- 172.21.15.84:0/3215070008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f78111180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009740 tx=0x7f5f6801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282b39e93b21a4da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f75ffb640 1 -- 172.21.15.84:0/3215070008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f680b0070 con 0x7f5f78110da0 2024-09-10T06:26:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f75ffb640 1 -- 172.21.15.84:0/3215070008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f680ab530 con 0x7f5f78110da0 2024-09-10T06:26:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f75ffb640 1 -- 172.21.15.84:0/3215070008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f680ab830 con 0x7f5f78110da0 2024-09-10T06:26:22.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/3215070008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 msgr2=0x7f5f78111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/3215070008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f78111180 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009740 tx=0x7f5f6801c370 comp rx=0 tx=0).stop 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/3215070008 shutdown_connections 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/3215070008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f78111180 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/3215070008 >> 172.21.15.84:0/3215070008 conn(0x7f5f78070900 msgr2=0x7f5f78072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/3215070008 shutdown_connections 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/3215070008 wait complete. 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.267+0000 7f5f7d3ea640 1 Processor -- start 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 -- start start 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78135470 con 0x7f5f78110da0 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f76ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f76ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46030/0 (socket says 172.21.15.84:46030) 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f76ffd640 1 -- 172.21.15.84:0/4166866084 learned_addr learned my addr 172.21.15.84:0/4166866084 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f76ffd640 1 -- 172.21.15.84:0/4166866084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f78130cb0 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f76ffd640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ae040 tx=0x7f5f68019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f680b8020 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f680b4600 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f781307f0 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f680b0040 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f78122dc0 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f78111180 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f680bb020 con 0x7f5f78110da0 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 0x7f5f5803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5f680e9570 con 0x7f5f78110da0 2024-09-10T06:26:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f767fc640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 0x7f5f5803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.271+0000 7f5f767fc640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 0x7f5f5803d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f60005890 tx=0x7f5f60007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:22.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.275+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5f680c2030 con 0x7f5f78110da0 2024-09-10T06:26:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.435+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f78130f90 con 0x7f5f5803b200 2024-09-10T06:26:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.463+0000 7f5f6f7fe640 1 -- 172.21.15.84:0/4166866084 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665450 (secure 0 0 0) 0x7f5f600058c0 con 0x7f5f5803b200 2024-09-10T06:26:22.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 msgr2=0x7f5f5803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 0x7f5f5803d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f60005890 tx=0x7f5f60007ab0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 msgr2=0x7f5f781226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ae040 tx=0x7f5f68019110 comp rx=0 tx=0).stop 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 shutdown_connections 2024-09-10T06:26:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f5f5803b200 0x7f5f5803d6c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 --2- 172.21.15.84:0/4166866084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f78110da0 0x7f5f781226b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 >> 172.21.15.84:0/4166866084 conn(0x7f5f78070900 msgr2=0x7f5f78071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 shutdown_connections 2024-09-10T06:26:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:22.471+0000 7f5f7d3ea640 1 -- 172.21.15.84:0/4166866084 wait complete. 2024-09-10T06:26:22.492 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-10T06:26:21.866031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4565,"ondisk_log_size":4565,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165436,"kb_used_data":15736,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377321924,"statfs":{"total":386547056640,"available":386377650176,"internally_reserved":0,"allocated":16113664,"data_stored":14946666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25807406,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852214+0000","last_change":"2024-09-10T06:22:31.830584+0000","last_active":"2024-09-10T06:23:12.852214+0000","last_peered":"2024-09-10T06:23:12.852214+0000","last_clean":"2024-09-10T06:23:12.852214+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:23:12.852214+0000","last_undegraded":"2024-09-10T06:23:12.852214+0000","last_fullsized":"2024-09-10T06:23:12.852214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:16.702734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380991+0000","last_change":"2024-09-10T06:22:33.833535+0000","last_active":"2024-09-10T06:25:46.380991+0000","last_peered":"2024-09-10T06:25:46.380991+0000","last_clean":"2024-09-10T06:25:46.380991+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:25:46.380991+0000","last_undegraded":"2024-09-10T06:25:46.380991+0000","last_fullsized":"2024-09-10T06:25:46.380991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841367+0000","last_change":"2024-09-10T06:22:31.815930+0000","last_active":"2024-09-10T06:23:12.841367+0000","last_peered":"2024-09-10T06:23:12.841367+0000","last_clean":"2024-09-10T06:23:12.841367+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:23:12.841367+0000","last_undegraded":"2024-09-10T06:23:12.841367+0000","last_fullsized":"2024-09-10T06:23:12.841367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:10.113632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.656272+0000","last_change":"2024-09-10T06:22:31.836564+0000","last_active":"2024-09-10T06:25:45.656272+0000","last_peered":"2024-09-10T06:25:45.656272+0000","last_clean":"2024-09-10T06:25:45.656272+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:25:45.656272+0000","last_undegraded":"2024-09-10T06:25:45.656272+0000","last_fullsized":"2024-09-10T06:25:45.656272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:18.259418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847960+0000","last_change":"2024-09-10T06:22:31.806993+0000","last_active":"2024-09-10T06:23:12.847960+0000","last_peered":"2024-09-10T06:23:12.847960+0000","last_clean":"2024-09-10T06:23:12.847960+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:23:12.847960+0000","last_undegraded":"2024-09-10T06:23:12.847960+0000","last_fullsized":"2024-09-10T06:23:12.847960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:10.091315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.401883+0000","last_change":"2024-09-10T06:23:12.860422+0000","last_active":"2024-09-10T06:25:46.401883+0000","last_peered":"2024-09-10T06:25:46.401883+0000","last_clean":"2024-09-10T06:25:46.401883+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:25:46.401883+0000","last_undegraded":"2024-09-10T06:25:46.401883+0000","last_fullsized":"2024-09-10T06:25:46.401883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:40.359356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838331+0000","last_change":"2024-09-10T06:22:31.826279+0000","last_active":"2024-09-10T06:23:12.838331+0000","last_peered":"2024-09-10T06:23:12.838331+0000","last_clean":"2024-09-10T06:23:12.838331+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:23:12.838331+0000","last_undegraded":"2024-09-10T06:23:12.838331+0000","last_fullsized":"2024-09-10T06:23:12.838331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:26.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.313495+0000","last_change":"2024-09-10T06:22:33.812237+0000","last_active":"2024-09-10T06:25:46.313495+0000","last_peered":"2024-09-10T06:25:46.313495+0000","last_clean":"2024-09-10T06:25:46.313495+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:25:46.313495+0000","last_undegraded":"2024-09-10T06:25:46.313495+0000","last_fullsized":"2024-09-10T06:25:46.313495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.206290+0000","last_change":"2024-09-10T06:22:31.809080+0000","last_active":"2024-09-10T06:25:46.206290+0000","last_peered":"2024-09-10T06:25:46.206290+0000","last_clean":"2024-09-10T06:25:46.206290+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:25:46.206290+0000","last_undegraded":"2024-09-10T06:25:46.206290+0000","last_fullsized":"2024-09-10T06:25:46.206290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:43.483133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843973+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:23:12.843973+0000","last_peered":"2024-09-10T06:23:12.843973+0000","last_clean":"2024-09-10T06:23:12.843973+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:23:12.843973+0000","last_undegraded":"2024-09-10T06:23:12.843973+0000","last_fullsized":"2024-09-10T06:23:12.843973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:50.427247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838841+0000","last_change":"2024-09-10T06:22:31.828678+0000","last_active":"2024-09-10T06:23:12.838841+0000","last_peered":"2024-09-10T06:23:12.838841+0000","last_clean":"2024-09-10T06:23:12.838841+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:23:12.838841+0000","last_undegraded":"2024-09-10T06:23:12.838841+0000","last_fullsized":"2024-09-10T06:23:12.838841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:33.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.426746+0000","last_change":"2024-09-10T06:22:33.841656+0000","last_active":"2024-09-10T06:24:00.426746+0000","last_peered":"2024-09-10T06:24:00.426746+0000","last_clean":"2024-09-10T06:24:00.426746+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:24:00.426746+0000","last_undegraded":"2024-09-10T06:24:00.426746+0000","last_fullsized":"2024-09-10T06:24:00.426746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.423672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.870547+0000","last_change":"2024-09-10T06:23:12.869310+0000","last_active":"2024-09-10T06:23:12.870547+0000","last_peered":"2024-09-10T06:23:12.870547+0000","last_clean":"2024-09-10T06:23:12.870547+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:23:12.870547+0000","last_undegraded":"2024-09-10T06:23:12.870547+0000","last_fullsized":"2024-09-10T06:23:12.870547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:34.532552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.027326+0000","last_change":"2024-09-10T06:23:12.857760+0000","last_active":"2024-09-10T06:25:46.027326+0000","last_peered":"2024-09-10T06:25:46.027326+0000","last_clean":"2024-09-10T06:25:46.027326+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:25:46.027326+0000","last_undegraded":"2024-09-10T06:25:46.027326+0000","last_fullsized":"2024-09-10T06:25:46.027326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.942980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.864475+0000","last_change":"2024-09-10T06:22:31.832009+0000","last_active":"2024-09-10T06:23:12.864475+0000","last_peered":"2024-09-10T06:23:12.864475+0000","last_clean":"2024-09-10T06:23:12.864475+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:23:12.864475+0000","last_undegraded":"2024-09-10T06:23:12.864475+0000","last_fullsized":"2024-09-10T06:23:12.864475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028692+0000","last_change":"2024-09-10T06:22:33.844939+0000","last_active":"2024-09-10T06:25:46.028692+0000","last_peered":"2024-09-10T06:25:46.028692+0000","last_clean":"2024-09-10T06:25:46.028692+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:25:46.028692+0000","last_undegraded":"2024-09-10T06:25:46.028692+0000","last_fullsized":"2024-09-10T06:25:46.028692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:54.074106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849914+0000","last_change":"2024-09-10T06:22:31.833253+0000","last_active":"2024-09-10T06:23:12.849914+0000","last_peered":"2024-09-10T06:23:12.849914+0000","last_clean":"2024-09-10T06:23:12.849914+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:23:12.849914+0000","last_undegraded":"2024-09-10T06:23:12.849914+0000","last_fullsized":"2024-09-10T06:23:12.849914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:12.255366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226464+0000","last_change":"2024-09-10T06:22:33.841628+0000","last_active":"2024-09-10T06:25:46.226464+0000","last_peered":"2024-09-10T06:25:46.226464+0000","last_clean":"2024-09-10T06:25:46.226464+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:25:46.226464+0000","last_undegraded":"2024-09-10T06:25:46.226464+0000","last_fullsized":"2024-09-10T06:25:46.226464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.857466+0000","last_change":"2024-09-10T06:22:31.828028+0000","last_active":"2024-09-10T06:23:12.857466+0000","last_peered":"2024-09-10T06:23:12.857466+0000","last_clean":"2024-09-10T06:23:12.857466+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:23:12.857466+0000","last_undegraded":"2024-09-10T06:23:12.857466+0000","last_fullsized":"2024-09-10T06:23:12.857466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.372084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026158+0000","last_change":"2024-09-10T06:22:33.822953+0000","last_active":"2024-09-10T06:25:46.026158+0000","last_peered":"2024-09-10T06:25:46.026158+0000","last_clean":"2024-09-10T06:25:46.026158+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:25:46.026158+0000","last_undegraded":"2024-09-10T06:25:46.026158+0000","last_fullsized":"2024-09-10T06:25:46.026158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.856102+0000","last_change":"2024-09-10T06:22:31.803614+0000","last_active":"2024-09-10T06:23:12.856102+0000","last_peered":"2024-09-10T06:23:12.856102+0000","last_clean":"2024-09-10T06:23:12.856102+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:23:12.856102+0000","last_undegraded":"2024-09-10T06:23:12.856102+0000","last_fullsized":"2024-09-10T06:23:12.856102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.894566+0000","last_change":"2024-09-10T06:22:33.841481+0000","last_active":"2024-09-10T06:25:45.894566+0000","last_peered":"2024-09-10T06:25:45.894566+0000","last_clean":"2024-09-10T06:25:45.894566+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:25:45.894566+0000","last_undegraded":"2024-09-10T06:25:45.894566+0000","last_fullsized":"2024-09-10T06:25:45.894566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:07.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844594+0000","last_change":"2024-09-10T06:22:31.814700+0000","last_active":"2024-09-10T06:23:12.844594+0000","last_peered":"2024-09-10T06:23:12.844594+0000","last_clean":"2024-09-10T06:23:12.844594+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:23:12.844594+0000","last_undegraded":"2024-09-10T06:23:12.844594+0000","last_fullsized":"2024-09-10T06:23:12.844594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.299397+0000","last_change":"2024-09-10T06:22:33.818692+0000","last_active":"2024-09-10T06:24:45.299397+0000","last_peered":"2024-09-10T06:24:45.299397+0000","last_clean":"2024-09-10T06:24:45.299397+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:24:45.299397+0000","last_undegraded":"2024-09-10T06:24:45.299397+0000","last_fullsized":"2024-09-10T06:24:45.299397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.049587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.562583+0000","last_change":"2024-09-10T06:22:31.830265+0000","last_active":"2024-09-10T06:23:15.562583+0000","last_peered":"2024-09-10T06:23:15.562583+0000","last_clean":"2024-09-10T06:23:15.562583+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:23:15.562583+0000","last_undegraded":"2024-09-10T06:23:15.562583+0000","last_fullsized":"2024-09-10T06:23:15.562583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:05.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314012+0000","last_change":"2024-09-10T06:22:33.812296+0000","last_active":"2024-09-10T06:25:46.314012+0000","last_peered":"2024-09-10T06:25:46.314012+0000","last_clean":"2024-09-10T06:25:46.314012+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:25:46.314012+0000","last_undegraded":"2024-09-10T06:25:46.314012+0000","last_fullsized":"2024-09-10T06:25:46.314012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:01.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836937+0000","last_change":"2024-09-10T06:22:31.831741+0000","last_active":"2024-09-10T06:23:12.836937+0000","last_peered":"2024-09-10T06:23:12.836937+0000","last_clean":"2024-09-10T06:23:12.836937+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:23:12.836937+0000","last_undegraded":"2024-09-10T06:23:12.836937+0000","last_fullsized":"2024-09-10T06:23:12.836937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:47.297207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.668585+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:26:17.668585+0000","last_peered":"2024-09-10T06:26:17.668585+0000","last_clean":"2024-09-10T06:26:17.668585+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:26:17.668585+0000","last_undegraded":"2024-09-10T06:26:17.668585+0000","last_fullsized":"2024-09-10T06:26:17.668585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380630+0000","last_change":"2024-09-10T06:22:33.816970+0000","last_active":"2024-09-10T06:25:46.380630+0000","last_peered":"2024-09-10T06:25:46.380630+0000","last_clean":"2024-09-10T06:25:46.380630+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:25:46.380630+0000","last_undegraded":"2024-09-10T06:25:46.380630+0000","last_fullsized":"2024-09-10T06:25:46.380630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:13.014250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.234103+0000","last_change":"2024-09-10T06:23:12.901608+0000","last_active":"2024-09-10T06:24:45.234103+0000","last_peered":"2024-09-10T06:24:45.234103+0000","last_clean":"2024-09-10T06:24:45.234103+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:24:45.234103+0000","last_undegraded":"2024-09-10T06:24:45.234103+0000","last_fullsized":"2024-09-10T06:24:45.234103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:00.953898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838061+0000","last_change":"2024-09-10T06:22:31.821919+0000","last_active":"2024-09-10T06:23:12.838061+0000","last_peered":"2024-09-10T06:23:12.838061+0000","last_clean":"2024-09-10T06:23:12.838061+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:23:12.838061+0000","last_undegraded":"2024-09-10T06:23:12.838061+0000","last_fullsized":"2024-09-10T06:23:12.838061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:55.502929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844115+0000","last_change":"2024-09-10T06:22:35.836699+0000","last_active":"2024-09-10T06:23:12.844115+0000","last_peered":"2024-09-10T06:23:12.844115+0000","last_clean":"2024-09-10T06:23:12.844115+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:23:12.844115+0000","last_undegraded":"2024-09-10T06:23:12.844115+0000","last_fullsized":"2024-09-10T06:23:12.844115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:10.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.379703+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:26:17.379703+0000","last_peered":"2024-09-10T06:26:17.379703+0000","last_clean":"2024-09-10T06:26:17.379703+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:26:17.379703+0000","last_undegraded":"2024-09-10T06:26:17.379703+0000","last_fullsized":"2024-09-10T06:26:17.379703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.330277+0000","last_change":"2024-09-10T06:22:33.836449+0000","last_active":"2024-09-10T06:25:46.330277+0000","last_peered":"2024-09-10T06:25:46.330277+0000","last_clean":"2024-09-10T06:25:46.330277+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:25:46.330277+0000","last_undegraded":"2024-09-10T06:25:46.330277+0000","last_fullsized":"2024-09-10T06:25:46.330277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:54.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841665+0000","last_change":"2024-09-10T06:22:31.828040+0000","last_active":"2024-09-10T06:23:12.841665+0000","last_peered":"2024-09-10T06:23:12.841665+0000","last_clean":"2024-09-10T06:23:12.841665+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:23:12.841665+0000","last_undegraded":"2024-09-10T06:23:12.841665+0000","last_fullsized":"2024-09-10T06:23:12.841665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:07.832769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.620235+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:26:17.620235+0000","last_peered":"2024-09-10T06:26:17.620235+0000","last_clean":"2024-09-10T06:26:17.620235+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:26:17.620235+0000","last_undegraded":"2024-09-10T06:26:17.620235+0000","last_fullsized":"2024-09-10T06:26:17.620235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.388110+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:26:17.388110+0000","last_peered":"2024-09-10T06:26:17.388110+0000","last_clean":"2024-09-10T06:26:17.388110+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:26:17.388110+0000","last_undegraded":"2024-09-10T06:26:17.388110+0000","last_fullsized":"2024-09-10T06:26:17.388110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836656+0000","last_change":"2024-09-10T06:22:33.836542+0000","last_active":"2024-09-10T06:23:12.836656+0000","last_peered":"2024-09-10T06:23:12.836656+0000","last_clean":"2024-09-10T06:23:12.836656+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:23:12.836656+0000","last_undegraded":"2024-09-10T06:23:12.836656+0000","last_fullsized":"2024-09-10T06:23:12.836656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:35.885623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852424+0000","last_change":"2024-09-10T06:22:31.804588+0000","last_active":"2024-09-10T06:23:12.852424+0000","last_peered":"2024-09-10T06:23:12.852424+0000","last_clean":"2024-09-10T06:23:12.852424+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:23:12.852424+0000","last_undegraded":"2024-09-10T06:23:12.852424+0000","last_fullsized":"2024-09-10T06:23:12.852424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:34.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846399+0000","last_change":"2024-09-10T06:22:35.836358+0000","last_active":"2024-09-10T06:23:12.846399+0000","last_peered":"2024-09-10T06:23:12.846399+0000","last_clean":"2024-09-10T06:23:12.846399+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:23:12.846399+0000","last_undegraded":"2024-09-10T06:23:12.846399+0000","last_fullsized":"2024-09-10T06:23:12.846399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:19.610121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.702650+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:26:17.702650+0000","last_peered":"2024-09-10T06:26:17.702650+0000","last_clean":"2024-09-10T06:26:17.702650+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:17.702650+0000","last_undegraded":"2024-09-10T06:26:17.702650+0000","last_fullsized":"2024-09-10T06:26:17.702650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:10.147486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.165283+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:00.165283+0000","last_peered":"2024-09-10T06:24:00.165283+0000","last_clean":"2024-09-10T06:24:00.165283+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:00.165283+0000","last_undegraded":"2024-09-10T06:24:00.165283+0000","last_fullsized":"2024-09-10T06:24:00.165283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:04.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227310+0000","last_change":"2024-09-10T06:22:33.817819+0000","last_active":"2024-09-10T06:25:46.227310+0000","last_peered":"2024-09-10T06:25:46.227310+0000","last_clean":"2024-09-10T06:25:46.227310+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:25:46.227310+0000","last_undegraded":"2024-09-10T06:25:46.227310+0000","last_fullsized":"2024-09-10T06:25:46.227310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.471797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850929+0000","last_change":"2024-09-10T06:22:31.807466+0000","last_active":"2024-09-10T06:23:12.850929+0000","last_peered":"2024-09-10T06:23:12.850929+0000","last_clean":"2024-09-10T06:23:12.850929+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:23:12.850929+0000","last_undegraded":"2024-09-10T06:23:12.850929+0000","last_fullsized":"2024-09-10T06:23:12.850929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:02.579986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840472+0000","last_change":"2024-09-10T06:22:35.836298+0000","last_active":"2024-09-10T06:23:12.840472+0000","last_peered":"2024-09-10T06:23:12.840472+0000","last_clean":"2024-09-10T06:23:12.840472+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:23:12.840472+0000","last_undegraded":"2024-09-10T06:23:12.840472+0000","last_fullsized":"2024-09-10T06:23:12.840472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.536926+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:26:17.536926+0000","last_peered":"2024-09-10T06:26:17.536926+0000","last_clean":"2024-09-10T06:26:17.536926+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:26:17.536926+0000","last_undegraded":"2024-09-10T06:26:17.536926+0000","last_fullsized":"2024-09-10T06:26:17.536926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:54.521264+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:23:54.521264+0000","last_peered":"2024-09-10T06:23:54.521264+0000","last_clean":"2024-09-10T06:23:54.521264+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:23:54.521264+0000","last_undegraded":"2024-09-10T06:23:54.521264+0000","last_fullsized":"2024-09-10T06:23:54.521264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:15.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.277593+0000","last_change":"2024-09-10T06:22:33.841687+0000","last_active":"2024-09-10T06:24:45.277593+0000","last_peered":"2024-09-10T06:24:45.277593+0000","last_clean":"2024-09-10T06:24:45.277593+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:24:45.277593+0000","last_undegraded":"2024-09-10T06:24:45.277593+0000","last_fullsized":"2024-09-10T06:24:45.277593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:42.392550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563926+0000","last_change":"2024-09-10T06:22:31.836503+0000","last_active":"2024-09-10T06:23:15.563926+0000","last_peered":"2024-09-10T06:23:15.563926+0000","last_clean":"2024-09-10T06:23:15.563926+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:23:15.563926+0000","last_undegraded":"2024-09-10T06:23:15.563926+0000","last_fullsized":"2024-09-10T06:23:15.563926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:55.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846203+0000","last_change":"2024-09-10T06:22:35.835893+0000","last_active":"2024-09-10T06:23:12.846203+0000","last_peered":"2024-09-10T06:23:12.846203+0000","last_clean":"2024-09-10T06:23:12.846203+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:23:12.846203+0000","last_undegraded":"2024-09-10T06:23:12.846203+0000","last_fullsized":"2024-09-10T06:23:12.846203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:12.526918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.718531+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:26:17.718531+0000","last_peered":"2024-09-10T06:26:17.718531+0000","last_clean":"2024-09-10T06:26:17.718531+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:26:17.718531+0000","last_undegraded":"2024-09-10T06:26:17.718531+0000","last_fullsized":"2024-09-10T06:26:17.718531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:52.569579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":353,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.390485+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:26:17.390485+0000","last_peered":"2024-09-10T06:26:17.390485+0000","last_clean":"2024-09-10T06:26:17.390485+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:26:17.390485+0000","last_undegraded":"2024-09-10T06:26:17.390485+0000","last_fullsized":"2024-09-10T06:26:17.390485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156054+0000","last_change":"2024-09-10T06:22:33.822287+0000","last_active":"2024-09-10T06:24:00.156054+0000","last_peered":"2024-09-10T06:24:00.156054+0000","last_clean":"2024-09-10T06:24:00.156054+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:24:00.156054+0000","last_undegraded":"2024-09-10T06:24:00.156054+0000","last_fullsized":"2024-09-10T06:24:00.156054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:30.825794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.367831+0000","last_change":"2024-09-10T06:22:31.832982+0000","last_active":"2024-09-10T06:25:46.367831+0000","last_peered":"2024-09-10T06:25:46.367831+0000","last_clean":"2024-09-10T06:25:46.367831+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:25:46.367831+0000","last_undegraded":"2024-09-10T06:25:46.367831+0000","last_fullsized":"2024-09-10T06:25:46.367831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:28.916480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841000+0000","last_change":"2024-09-10T06:22:35.836376+0000","last_active":"2024-09-10T06:23:12.841000+0000","last_peered":"2024-09-10T06:23:12.841000+0000","last_clean":"2024-09-10T06:23:12.841000+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:23:12.841000+0000","last_undegraded":"2024-09-10T06:23:12.841000+0000","last_fullsized":"2024-09-10T06:23:12.841000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:11.310423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.558480+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:26:17.558480+0000","last_peered":"2024-09-10T06:26:17.558480+0000","last_clean":"2024-09-10T06:26:17.558480+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:26:17.558480+0000","last_undegraded":"2024-09-10T06:26:17.558480+0000","last_fullsized":"2024-09-10T06:26:17.558480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:32.138442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850212+0000","last_change":"2024-09-10T06:22:33.827668+0000","last_active":"2024-09-10T06:24:47.850212+0000","last_peered":"2024-09-10T06:24:47.850212+0000","last_clean":"2024-09-10T06:24:47.850212+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:24:47.850212+0000","last_undegraded":"2024-09-10T06:24:47.850212+0000","last_fullsized":"2024-09-10T06:24:47.850212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:10.516267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843566+0000","last_change":"2024-09-10T06:22:31.827415+0000","last_active":"2024-09-10T06:23:12.843566+0000","last_peered":"2024-09-10T06:23:12.843566+0000","last_clean":"2024-09-10T06:23:12.843566+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:23:12.843566+0000","last_undegraded":"2024-09-10T06:23:12.843566+0000","last_fullsized":"2024-09-10T06:23:12.843566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:10.483166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848722+0000","last_change":"2024-09-10T06:22:35.830686+0000","last_active":"2024-09-10T06:23:12.848722+0000","last_peered":"2024-09-10T06:23:12.848722+0000","last_clean":"2024-09-10T06:23:12.848722+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:23:12.848722+0000","last_undegraded":"2024-09-10T06:23:12.848722+0000","last_fullsized":"2024-09-10T06:23:12.848722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.566639+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:26:17.566639+0000","last_peered":"2024-09-10T06:26:17.566639+0000","last_clean":"2024-09-10T06:26:17.566639+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:26:17.566639+0000","last_undegraded":"2024-09-10T06:26:17.566639+0000","last_fullsized":"2024-09-10T06:26:17.566639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856817+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:24:43.856817+0000","last_peered":"2024-09-10T06:24:43.856817+0000","last_clean":"2024-09-10T06:24:43.856817+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:24:43.856817+0000","last_undegraded":"2024-09-10T06:24:43.856817+0000","last_fullsized":"2024-09-10T06:24:43.856817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:00.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.485815+0000","last_change":"2024-09-10T06:22:33.836732+0000","last_active":"2024-09-10T06:25:46.485815+0000","last_peered":"2024-09-10T06:25:46.485815+0000","last_clean":"2024-09-10T06:25:46.485815+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:25:46.485815+0000","last_undegraded":"2024-09-10T06:25:46.485815+0000","last_fullsized":"2024-09-10T06:25:46.485815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:58.953149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843151+0000","last_change":"2024-09-10T06:22:31.831869+0000","last_active":"2024-09-10T06:23:12.843151+0000","last_peered":"2024-09-10T06:23:12.843151+0000","last_clean":"2024-09-10T06:23:12.843151+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:23:12.843151+0000","last_undegraded":"2024-09-10T06:23:12.843151+0000","last_fullsized":"2024-09-10T06:23:12.843151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:08.695722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844174+0000","last_change":"2024-09-10T06:22:35.836278+0000","last_active":"2024-09-10T06:23:12.844174+0000","last_peered":"2024-09-10T06:23:12.844174+0000","last_clean":"2024-09-10T06:23:12.844174+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:23:12.844174+0000","last_undegraded":"2024-09-10T06:23:12.844174+0000","last_fullsized":"2024-09-10T06:23:12.844174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:25.749044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.513879+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:26:17.513879+0000","last_peered":"2024-09-10T06:26:17.513879+0000","last_clean":"2024-09-10T06:26:17.513879+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:26:17.513879+0000","last_undegraded":"2024-09-10T06:26:17.513879+0000","last_fullsized":"2024-09-10T06:26:17.513879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.380679+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:26:17.380679+0000","last_peered":"2024-09-10T06:26:17.380679+0000","last_clean":"2024-09-10T06:26:17.380679+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:26:17.380679+0000","last_undegraded":"2024-09-10T06:26:17.380679+0000","last_fullsized":"2024-09-10T06:26:17.380679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.844984+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:24:47.844984+0000","last_peered":"2024-09-10T06:24:47.844984+0000","last_clean":"2024-09-10T06:24:47.844984+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:24:47.844984+0000","last_undegraded":"2024-09-10T06:24:47.844984+0000","last_fullsized":"2024-09-10T06:24:47.844984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:41.565616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.030221+0000","last_change":"2024-09-10T06:22:33.844698+0000","last_active":"2024-09-10T06:25:46.030221+0000","last_peered":"2024-09-10T06:25:46.030221+0000","last_clean":"2024-09-10T06:25:46.030221+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:25:46.030221+0000","last_undegraded":"2024-09-10T06:25:46.030221+0000","last_fullsized":"2024-09-10T06:25:46.030221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:46.069087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844850+0000","last_change":"2024-09-10T06:22:31.826875+0000","last_active":"2024-09-10T06:23:12.844850+0000","last_peered":"2024-09-10T06:23:12.844850+0000","last_clean":"2024-09-10T06:23:12.844850+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:23:12.844850+0000","last_undegraded":"2024-09-10T06:23:12.844850+0000","last_fullsized":"2024-09-10T06:23:12.844850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.394900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.353328+0000","last_change":"2024-09-10T06:22:35.832300+0000","last_active":"2024-09-10T06:26:17.353328+0000","last_peered":"2024-09-10T06:26:17.353328+0000","last_clean":"2024-09-10T06:26:17.353328+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:17.353328+0000","last_undegraded":"2024-09-10T06:26:17.353328+0000","last_fullsized":"2024-09-10T06:26:17.353328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:47.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.383675+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:26:17.383675+0000","last_peered":"2024-09-10T06:26:17.383675+0000","last_clean":"2024-09-10T06:26:17.383675+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:26:17.383675+0000","last_undegraded":"2024-09-10T06:26:17.383675+0000","last_fullsized":"2024-09-10T06:26:17.383675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.871524+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:44.871524+0000","last_peered":"2024-09-10T06:24:44.871524+0000","last_clean":"2024-09-10T06:24:44.871524+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:44.871524+0000","last_undegraded":"2024-09-10T06:24:44.871524+0000","last_fullsized":"2024-09-10T06:24:44.871524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:02.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850321+0000","last_change":"2024-09-10T06:22:33.827862+0000","last_active":"2024-09-10T06:24:47.850321+0000","last_peered":"2024-09-10T06:24:47.850321+0000","last_clean":"2024-09-10T06:24:47.850321+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:24:47.850321+0000","last_undegraded":"2024-09-10T06:24:47.850321+0000","last_fullsized":"2024-09-10T06:24:47.850321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:49.916726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835639+0000","last_change":"2024-09-10T06:22:31.830812+0000","last_active":"2024-09-10T06:23:12.835639+0000","last_peered":"2024-09-10T06:23:12.835639+0000","last_clean":"2024-09-10T06:23:12.835639+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:23:12.835639+0000","last_undegraded":"2024-09-10T06:23:12.835639+0000","last_fullsized":"2024-09-10T06:23:12.835639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:07.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.677114+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:26:17.677114+0000","last_peered":"2024-09-10T06:26:17.677114+0000","last_clean":"2024-09-10T06:26:17.677114+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:26:17.677114+0000","last_undegraded":"2024-09-10T06:26:17.677114+0000","last_fullsized":"2024-09-10T06:26:17.677114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.454158+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.454158+0000","last_peered":"2024-09-10T06:25:46.454158+0000","last_clean":"2024-09-10T06:25:46.454158+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.454158+0000","last_undegraded":"2024-09-10T06:25:46.454158+0000","last_fullsized":"2024-09-10T06:25:46.454158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:28.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.085306+0000","last_change":"2024-09-10T06:22:33.830097+0000","last_active":"2024-09-10T06:24:41.085306+0000","last_peered":"2024-09-10T06:24:41.085306+0000","last_clean":"2024-09-10T06:24:41.085306+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:24:41.085306+0000","last_undegraded":"2024-09-10T06:24:41.085306+0000","last_fullsized":"2024-09-10T06:24:41.085306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:04.520654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841380+0000","last_change":"2024-09-10T06:22:19.009908+0000","last_active":"2024-09-10T06:23:12.841380+0000","last_peered":"2024-09-10T06:23:12.841380+0000","last_clean":"2024-09-10T06:23:12.841380+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:23:12.841380+0000","last_undegraded":"2024-09-10T06:23:12.841380+0000","last_fullsized":"2024-09-10T06:23:12.841380+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:17.828893+0000","last_clean_scrub_stamp":"2024-09-10T06:22:17.828893+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:03.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838764+0000","last_change":"2024-09-10T06:22:25.871965+0000","last_active":"2024-09-10T06:23:12.838764+0000","last_peered":"2024-09-10T06:23:12.838764+0000","last_clean":"2024-09-10T06:23:12.838764+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:23:12.838764+0000","last_undegraded":"2024-09-10T06:23:12.838764+0000","last_fullsized":"2024-09-10T06:23:12.838764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:13.484905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837151+0000","last_change":"2024-09-10T06:22:31.832148+0000","last_active":"2024-09-10T06:23:12.837151+0000","last_peered":"2024-09-10T06:23:12.837151+0000","last_clean":"2024-09-10T06:23:12.837151+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:23:12.837151+0000","last_undegraded":"2024-09-10T06:23:12.837151+0000","last_fullsized":"2024-09-10T06:23:12.837151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:07.514358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.855163+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:23:12.855163+0000","last_peered":"2024-09-10T06:23:12.855163+0000","last_clean":"2024-09-10T06:23:12.855163+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:23:12.855163+0000","last_undegraded":"2024-09-10T06:23:12.855163+0000","last_fullsized":"2024-09-10T06:23:12.855163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.965730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.694409+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:26:17.694409+0000","last_peered":"2024-09-10T06:26:17.694409+0000","last_clean":"2024-09-10T06:26:17.694409+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:26:17.694409+0000","last_undegraded":"2024-09-10T06:26:17.694409+0000","last_fullsized":"2024-09-10T06:26:17.694409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:21.725012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315520+0000","last_change":"2024-09-10T06:22:33.814130+0000","last_active":"2024-09-10T06:25:46.315520+0000","last_peered":"2024-09-10T06:25:46.315520+0000","last_clean":"2024-09-10T06:25:46.315520+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:25:46.315520+0000","last_undegraded":"2024-09-10T06:25:46.315520+0000","last_fullsized":"2024-09-10T06:25:46.315520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:11.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835614+0000","last_change":"2024-09-10T06:22:25.871440+0000","last_active":"2024-09-10T06:23:12.835614+0000","last_peered":"2024-09-10T06:23:12.835614+0000","last_clean":"2024-09-10T06:23:12.835614+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:23:12.835614+0000","last_undegraded":"2024-09-10T06:23:12.835614+0000","last_fullsized":"2024-09-10T06:23:12.835614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:25.412825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839903+0000","last_change":"2024-09-10T06:22:31.813968+0000","last_active":"2024-09-10T06:23:12.839903+0000","last_peered":"2024-09-10T06:23:12.839903+0000","last_clean":"2024-09-10T06:23:12.839903+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:23:12.839903+0000","last_undegraded":"2024-09-10T06:23:12.839903+0000","last_fullsized":"2024-09-10T06:23:12.839903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854443+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:23:12.854443+0000","last_peered":"2024-09-10T06:23:12.854443+0000","last_clean":"2024-09-10T06:23:12.854443+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:23:12.854443+0000","last_undegraded":"2024-09-10T06:23:12.854443+0000","last_fullsized":"2024-09-10T06:23:12.854443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:04.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":503,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.688710+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:26:17.688710+0000","last_peered":"2024-09-10T06:26:17.688710+0000","last_clean":"2024-09-10T06:26:17.688710+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:26:17.688710+0000","last_undegraded":"2024-09-10T06:26:17.688710+0000","last_fullsized":"2024-09-10T06:26:17.688710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:21.390056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838597+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:23:12.838597+0000","last_peered":"2024-09-10T06:23:12.838597+0000","last_clean":"2024-09-10T06:23:12.838597+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:23:12.838597+0000","last_undegraded":"2024-09-10T06:23:12.838597+0000","last_fullsized":"2024-09-10T06:23:12.838597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:35.775780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.379659+0000","last_change":"2024-09-10T06:22:33.830304+0000","last_active":"2024-09-10T06:25:46.379659+0000","last_peered":"2024-09-10T06:25:46.379659+0000","last_clean":"2024-09-10T06:25:46.379659+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:25:46.379659+0000","last_undegraded":"2024-09-10T06:25:46.379659+0000","last_fullsized":"2024-09-10T06:25:46.379659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842861+0000","last_change":"2024-09-10T06:22:26.162816+0000","last_active":"2024-09-10T06:23:12.842861+0000","last_peered":"2024-09-10T06:23:12.842861+0000","last_clean":"2024-09-10T06:23:12.842861+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:23:12.842861+0000","last_undegraded":"2024-09-10T06:23:12.842861+0000","last_fullsized":"2024-09-10T06:23:12.842861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:23.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.213105+0000","last_change":"2024-09-10T06:22:31.813555+0000","last_active":"2024-09-10T06:25:46.213105+0000","last_peered":"2024-09-10T06:25:46.213105+0000","last_clean":"2024-09-10T06:25:46.213105+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:25:46.213105+0000","last_undegraded":"2024-09-10T06:25:46.213105+0000","last_fullsized":"2024-09-10T06:25:46.213105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851204+0000","last_change":"2024-09-10T06:22:35.819965+0000","last_active":"2024-09-10T06:23:12.851204+0000","last_peered":"2024-09-10T06:23:12.851204+0000","last_clean":"2024-09-10T06:23:12.851204+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:23:12.851204+0000","last_undegraded":"2024-09-10T06:23:12.851204+0000","last_fullsized":"2024-09-10T06:23:12.851204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:59.563244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.073073+0000","last_change":"2024-09-10T06:22:37.837514+0000","last_active":"2024-09-10T06:25:46.073073+0000","last_peered":"2024-09-10T06:25:46.073073+0000","last_clean":"2024-09-10T06:25:46.073073+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:25:46.073073+0000","last_undegraded":"2024-09-10T06:25:46.073073+0000","last_fullsized":"2024-09-10T06:25:46.073073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:10.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841192+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:23:12.841192+0000","last_peered":"2024-09-10T06:23:12.841192+0000","last_clean":"2024-09-10T06:23:12.841192+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:23:12.841192+0000","last_undegraded":"2024-09-10T06:23:12.841192+0000","last_fullsized":"2024-09-10T06:23:12.841192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:59.799041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380078+0000","last_change":"2024-09-10T06:22:33.843908+0000","last_active":"2024-09-10T06:25:46.380078+0000","last_peered":"2024-09-10T06:25:46.380078+0000","last_clean":"2024-09-10T06:25:46.380078+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:25:46.380078+0000","last_undegraded":"2024-09-10T06:25:46.380078+0000","last_fullsized":"2024-09-10T06:25:46.380078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836895+0000","last_change":"2024-09-10T06:22:25.872304+0000","last_active":"2024-09-10T06:23:12.836895+0000","last_peered":"2024-09-10T06:23:12.836895+0000","last_clean":"2024-09-10T06:23:12.836895+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:23:12.836895+0000","last_undegraded":"2024-09-10T06:23:12.836895+0000","last_fullsized":"2024-09-10T06:23:12.836895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:34.788542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.847540+0000","last_change":"2024-09-10T06:22:31.810277+0000","last_active":"2024-09-10T06:25:45.847540+0000","last_peered":"2024-09-10T06:25:45.847540+0000","last_clean":"2024-09-10T06:25:45.847540+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:25:45.847540+0000","last_undegraded":"2024-09-10T06:25:45.847540+0000","last_fullsized":"2024-09-10T06:25:45.847540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:49.861302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844120+0000","last_change":"2024-09-10T06:22:35.817207+0000","last_active":"2024-09-10T06:23:12.844120+0000","last_peered":"2024-09-10T06:23:12.844120+0000","last_clean":"2024-09-10T06:23:12.844120+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:23:12.844120+0000","last_undegraded":"2024-09-10T06:23:12.844120+0000","last_fullsized":"2024-09-10T06:23:12.844120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:40.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.319710+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.319710+0000","last_peered":"2024-09-10T06:25:45.319710+0000","last_clean":"2024-09-10T06:25:45.319710+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.319710+0000","last_undegraded":"2024-09-10T06:25:45.319710+0000","last_fullsized":"2024-09-10T06:25:45.319710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:52.179158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029340+0000","last_change":"2024-09-10T06:22:33.829247+0000","last_active":"2024-09-10T06:25:46.029340+0000","last_peered":"2024-09-10T06:25:46.029340+0000","last_clean":"2024-09-10T06:25:46.029340+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:25:46.029340+0000","last_undegraded":"2024-09-10T06:25:46.029340+0000","last_fullsized":"2024-09-10T06:25:46.029340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852772+0000","last_change":"2024-09-10T06:22:31.810031+0000","last_active":"2024-09-10T06:23:12.852772+0000","last_peered":"2024-09-10T06:23:12.852772+0000","last_clean":"2024-09-10T06:23:12.852772+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:23:12.852772+0000","last_undegraded":"2024-09-10T06:23:12.852772+0000","last_fullsized":"2024-09-10T06:23:12.852772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:03:36.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840933+0000","last_change":"2024-09-10T06:22:25.866472+0000","last_active":"2024-09-10T06:23:12.840933+0000","last_peered":"2024-09-10T06:23:12.840933+0000","last_clean":"2024-09-10T06:23:12.840933+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:23:12.840933+0000","last_undegraded":"2024-09-10T06:23:12.840933+0000","last_fullsized":"2024-09-10T06:23:12.840933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:17.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.582239+0000","last_change":"2024-09-10T06:22:35.823185+0000","last_active":"2024-09-10T06:25:46.582239+0000","last_peered":"2024-09-10T06:25:46.582239+0000","last_clean":"2024-09-10T06:25:46.582239+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:25:46.582239+0000","last_undegraded":"2024-09-10T06:25:46.582239+0000","last_fullsized":"2024-09-10T06:25:46.582239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:31.666424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'69","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.630186+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:26:17.630186+0000","last_peered":"2024-09-10T06:26:17.630186+0000","last_clean":"2024-09-10T06:26:17.630186+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:17.630186+0000","last_undegraded":"2024-09-10T06:26:17.630186+0000","last_fullsized":"2024-09-10T06:26:17.630186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:52.778947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843741+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:23:12.843741+0000","last_peered":"2024-09-10T06:23:12.843741+0000","last_clean":"2024-09-10T06:23:12.843741+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:23:12.843741+0000","last_undegraded":"2024-09-10T06:23:12.843741+0000","last_fullsized":"2024-09-10T06:23:12.843741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:07.724283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.029418+0000","last_change":"2024-09-10T06:22:33.828093+0000","last_active":"2024-09-10T06:25:46.029418+0000","last_peered":"2024-09-10T06:25:46.029418+0000","last_clean":"2024-09-10T06:25:46.029418+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:25:46.029418+0000","last_undegraded":"2024-09-10T06:25:46.029418+0000","last_fullsized":"2024-09-10T06:25:46.029418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841646+0000","last_change":"2024-09-10T06:22:31.811783+0000","last_active":"2024-09-10T06:23:12.841646+0000","last_peered":"2024-09-10T06:23:12.841646+0000","last_clean":"2024-09-10T06:23:12.841646+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:23:12.841646+0000","last_undegraded":"2024-09-10T06:23:12.841646+0000","last_fullsized":"2024-09-10T06:23:12.841646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:00.235226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:25.872514+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:02.498974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.341015+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:26:17.341015+0000","last_peered":"2024-09-10T06:26:17.341015+0000","last_clean":"2024-09-10T06:26:17.341015+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:26:17.341015+0000","last_undegraded":"2024-09-10T06:26:17.341015+0000","last_fullsized":"2024-09-10T06:26:17.341015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:58.162966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.404578+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:23:16.404578+0000","last_peered":"2024-09-10T06:23:16.404578+0000","last_clean":"2024-09-10T06:23:16.404578+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:23:16.404578+0000","last_undegraded":"2024-09-10T06:23:16.404578+0000","last_fullsized":"2024-09-10T06:23:16.404578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.073693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.377858+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:26:17.377858+0000","last_peered":"2024-09-10T06:26:17.377858+0000","last_clean":"2024-09-10T06:26:17.377858+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:26:17.377858+0000","last_undegraded":"2024-09-10T06:26:17.377858+0000","last_fullsized":"2024-09-10T06:26:17.377858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:43.131319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226435+0000","last_change":"2024-09-10T06:22:33.835195+0000","last_active":"2024-09-10T06:25:46.226435+0000","last_peered":"2024-09-10T06:25:46.226435+0000","last_clean":"2024-09-10T06:25:46.226435+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:25:46.226435+0000","last_undegraded":"2024-09-10T06:25:46.226435+0000","last_fullsized":"2024-09-10T06:25:46.226435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:25.772911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.681116+0000","last_change":"2024-09-10T06:22:31.819349+0000","last_active":"2024-09-10T06:25:45.681116+0000","last_peered":"2024-09-10T06:25:45.681116+0000","last_clean":"2024-09-10T06:25:45.681116+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:25:45.681116+0000","last_undegraded":"2024-09-10T06:25:45.681116+0000","last_fullsized":"2024-09-10T06:25:45.681116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:40.037975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843900+0000","last_change":"2024-09-10T06:22:25.866236+0000","last_active":"2024-09-10T06:23:12.843900+0000","last_peered":"2024-09-10T06:23:12.843900+0000","last_clean":"2024-09-10T06:23:12.843900+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:23:12.843900+0000","last_undegraded":"2024-09-10T06:23:12.843900+0000","last_fullsized":"2024-09-10T06:23:12.843900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:26.512539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844884+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:23:12.844884+0000","last_peered":"2024-09-10T06:23:12.844884+0000","last_clean":"2024-09-10T06:23:12.844884+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:23:12.844884+0000","last_undegraded":"2024-09-10T06:23:12.844884+0000","last_fullsized":"2024-09-10T06:23:12.844884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.465248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856935+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:24:43.856935+0000","last_peered":"2024-09-10T06:24:43.856935+0000","last_clean":"2024-09-10T06:24:43.856935+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:24:43.856935+0000","last_undegraded":"2024-09-10T06:24:43.856935+0000","last_fullsized":"2024-09-10T06:24:43.856935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:00.801970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":434,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.385841+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:26:17.385841+0000","last_peered":"2024-09-10T06:26:17.385841+0000","last_clean":"2024-09-10T06:26:17.385841+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:26:17.385841+0000","last_undegraded":"2024-09-10T06:26:17.385841+0000","last_fullsized":"2024-09-10T06:26:17.385841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:05.123690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314608+0000","last_change":"2024-09-10T06:22:33.836044+0000","last_active":"2024-09-10T06:25:46.314608+0000","last_peered":"2024-09-10T06:25:46.314608+0000","last_clean":"2024-09-10T06:25:46.314608+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:25:46.314608+0000","last_undegraded":"2024-09-10T06:25:46.314608+0000","last_fullsized":"2024-09-10T06:25:46.314608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:49.616370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863191+0000","last_change":"2024-09-10T06:22:31.817407+0000","last_active":"2024-09-10T06:23:12.863191+0000","last_peered":"2024-09-10T06:23:12.863191+0000","last_clean":"2024-09-10T06:23:12.863191+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:23:12.863191+0000","last_undegraded":"2024-09-10T06:23:12.863191+0000","last_fullsized":"2024-09-10T06:23:12.863191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:59.858776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852491+0000","last_change":"2024-09-10T06:22:25.872808+0000","last_active":"2024-09-10T06:23:12.852491+0000","last_peered":"2024-09-10T06:23:12.852491+0000","last_clean":"2024-09-10T06:23:12.852491+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:23:12.852491+0000","last_undegraded":"2024-09-10T06:23:12.852491+0000","last_fullsized":"2024-09-10T06:23:12.852491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:22.840310+0000","last_clean_scrub_stamp":"2024-09-10T06:22:22.840310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:36.962850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845740+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:23:12.845740+0000","last_peered":"2024-09-10T06:23:12.845740+0000","last_clean":"2024-09-10T06:23:12.845740+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:23:12.845740+0000","last_undegraded":"2024-09-10T06:23:12.845740+0000","last_fullsized":"2024-09-10T06:23:12.845740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:28.571689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.659703+0000","last_change":"2024-09-10T06:22:37.855099+0000","last_active":"2024-09-10T06:26:17.659703+0000","last_peered":"2024-09-10T06:26:17.659703+0000","last_clean":"2024-09-10T06:26:17.659703+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:17.659703+0000","last_undegraded":"2024-09-10T06:26:17.659703+0000","last_fullsized":"2024-09-10T06:26:17.659703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:05.079013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839680+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:23:12.839680+0000","last_peered":"2024-09-10T06:23:12.839680+0000","last_clean":"2024-09-10T06:23:12.839680+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:23:12.839680+0000","last_undegraded":"2024-09-10T06:23:12.839680+0000","last_fullsized":"2024-09-10T06:23:12.839680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:00.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851696+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:23:12.851696+0000","last_peered":"2024-09-10T06:23:12.851696+0000","last_clean":"2024-09-10T06:23:12.851696+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:23:12.851696+0000","last_undegraded":"2024-09-10T06:23:12.851696+0000","last_fullsized":"2024-09-10T06:23:12.851696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:18.366509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848875+0000","last_change":"2024-09-10T06:22:33.835614+0000","last_active":"2024-09-10T06:23:16.848875+0000","last_peered":"2024-09-10T06:23:16.848875+0000","last_clean":"2024-09-10T06:23:16.848875+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:23:16.848875+0000","last_undegraded":"2024-09-10T06:23:16.848875+0000","last_fullsized":"2024-09-10T06:23:16.848875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:36.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838231+0000","last_change":"2024-09-10T06:22:31.830987+0000","last_active":"2024-09-10T06:23:12.838231+0000","last_peered":"2024-09-10T06:23:12.838231+0000","last_clean":"2024-09-10T06:23:12.838231+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:23:12.838231+0000","last_undegraded":"2024-09-10T06:23:12.838231+0000","last_fullsized":"2024-09-10T06:23:12.838231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:06.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842492+0000","last_change":"2024-09-10T06:22:35.832868+0000","last_active":"2024-09-10T06:23:12.842492+0000","last_peered":"2024-09-10T06:23:12.842492+0000","last_clean":"2024-09-10T06:23:12.842492+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:23:12.842492+0000","last_undegraded":"2024-09-10T06:23:12.842492+0000","last_fullsized":"2024-09-10T06:23:12.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:22:51.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.710326+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:26:17.710326+0000","last_peered":"2024-09-10T06:26:17.710326+0000","last_clean":"2024-09-10T06:26:17.710326+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:26:17.710326+0000","last_undegraded":"2024-09-10T06:26:17.710326+0000","last_fullsized":"2024-09-10T06:26:17.710326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.872559+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.872559+0000","last_peered":"2024-09-10T06:24:42.872559+0000","last_clean":"2024-09-10T06:24:42.872559+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.872559+0000","last_undegraded":"2024-09-10T06:24:42.872559+0000","last_fullsized":"2024-09-10T06:24:42.872559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:14.600789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851337+0000","last_change":"2024-09-10T06:22:33.828670+0000","last_active":"2024-09-10T06:24:52.851337+0000","last_peered":"2024-09-10T06:24:52.851337+0000","last_clean":"2024-09-10T06:24:52.851337+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:24:52.851337+0000","last_undegraded":"2024-09-10T06:24:52.851337+0000","last_fullsized":"2024-09-10T06:24:52.851337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.752598+0000","last_change":"2024-09-10T06:22:31.834212+0000","last_active":"2024-09-10T06:25:45.752598+0000","last_peered":"2024-09-10T06:25:45.752598+0000","last_clean":"2024-09-10T06:25:45.752598+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:25:45.752598+0000","last_undegraded":"2024-09-10T06:25:45.752598+0000","last_fullsized":"2024-09-10T06:25:45.752598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:50.883361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427517+0000","last_change":"2024-09-10T06:22:33.817684+0000","last_active":"2024-09-10T06:24:00.427517+0000","last_peered":"2024-09-10T06:24:00.427517+0000","last_clean":"2024-09-10T06:24:00.427517+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:24:00.427517+0000","last_undegraded":"2024-09-10T06:24:00.427517+0000","last_fullsized":"2024-09-10T06:24:00.427517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.801071+0000","last_change":"2024-09-10T06:22:31.823765+0000","last_active":"2024-09-10T06:25:45.801071+0000","last_peered":"2024-09-10T06:25:45.801071+0000","last_clean":"2024-09-10T06:25:45.801071+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:25:45.801071+0000","last_undegraded":"2024-09-10T06:25:45.801071+0000","last_fullsized":"2024-09-10T06:25:45.801071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:55.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839169+0000","last_change":"2024-09-10T06:22:35.831394+0000","last_active":"2024-09-10T06:23:12.839169+0000","last_peered":"2024-09-10T06:23:12.839169+0000","last_clean":"2024-09-10T06:23:12.839169+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:23:12.839169+0000","last_undegraded":"2024-09-10T06:23:12.839169+0000","last_fullsized":"2024-09-10T06:23:12.839169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:22.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.610259+0000","last_change":"2024-09-10T06:22:37.836553+0000","last_active":"2024-09-10T06:26:17.610259+0000","last_peered":"2024-09-10T06:26:17.610259+0000","last_clean":"2024-09-10T06:26:17.610259+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:17.610259+0000","last_undegraded":"2024-09-10T06:26:17.610259+0000","last_fullsized":"2024-09-10T06:26:17.610259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:24.462240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226226+0000","last_change":"2024-09-10T06:22:33.837182+0000","last_active":"2024-09-10T06:25:46.226226+0000","last_peered":"2024-09-10T06:25:46.226226+0000","last_clean":"2024-09-10T06:25:46.226226+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:25:46.226226+0000","last_undegraded":"2024-09-10T06:25:46.226226+0000","last_fullsized":"2024-09-10T06:25:46.226226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:14.784269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.144585+0000","last_change":"2024-09-10T06:22:31.824675+0000","last_active":"2024-09-10T06:24:00.144585+0000","last_peered":"2024-09-10T06:24:00.144585+0000","last_clean":"2024-09-10T06:24:00.144585+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:24:00.144585+0000","last_undegraded":"2024-09-10T06:24:00.144585+0000","last_fullsized":"2024-09-10T06:24:00.144585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:27.214452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.584254+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:26:17.584254+0000","last_peered":"2024-09-10T06:26:17.584254+0000","last_clean":"2024-09-10T06:26:17.584254+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:26:17.584254+0000","last_undegraded":"2024-09-10T06:26:17.584254+0000","last_fullsized":"2024-09-10T06:26:17.584254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156644+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:00.156644+0000","last_peered":"2024-09-10T06:24:00.156644+0000","last_clean":"2024-09-10T06:24:00.156644+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:00.156644+0000","last_undegraded":"2024-09-10T06:24:00.156644+0000","last_fullsized":"2024-09-10T06:24:00.156644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:18.678529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.835895+0000","last_change":"2024-09-10T06:22:31.835963+0000","last_active":"2024-09-10T06:23:12.835895+0000","last_peered":"2024-09-10T06:23:12.835895+0000","last_clean":"2024-09-10T06:23:12.835895+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:23:12.835895+0000","last_undegraded":"2024-09-10T06:23:12.835895+0000","last_fullsized":"2024-09-10T06:23:12.835895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:44.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844184+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:23:12.844184+0000","last_peered":"2024-09-10T06:23:12.844184+0000","last_clean":"2024-09-10T06:23:12.844184+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:23:12.844184+0000","last_undegraded":"2024-09-10T06:23:12.844184+0000","last_fullsized":"2024-09-10T06:23:12.844184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:21.069402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'60","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.574533+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:26:17.574533+0000","last_peered":"2024-09-10T06:26:17.574533+0000","last_clean":"2024-09-10T06:26:17.574533+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:17.574533+0000","last_undegraded":"2024-09-10T06:26:17.574533+0000","last_fullsized":"2024-09-10T06:26:17.574533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.193472+0000","last_change":"2024-09-10T06:22:33.820528+0000","last_active":"2024-09-10T06:23:17.193472+0000","last_peered":"2024-09-10T06:23:17.193472+0000","last_clean":"2024-09-10T06:23:17.193472+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:23:17.193472+0000","last_undegraded":"2024-09-10T06:23:17.193472+0000","last_fullsized":"2024-09-10T06:23:17.193472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.199119+0000","last_change":"2024-09-10T06:22:31.824951+0000","last_active":"2024-09-10T06:25:46.199119+0000","last_peered":"2024-09-10T06:25:46.199119+0000","last_clean":"2024-09-10T06:25:46.199119+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:25:46.199119+0000","last_undegraded":"2024-09-10T06:25:46.199119+0000","last_fullsized":"2024-09-10T06:25:46.199119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:35.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.339747+0000","last_change":"2024-09-10T06:22:35.819614+0000","last_active":"2024-09-10T06:26:17.339747+0000","last_peered":"2024-09-10T06:26:17.339747+0000","last_clean":"2024-09-10T06:26:17.339747+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:17.339747+0000","last_undegraded":"2024-09-10T06:26:17.339747+0000","last_fullsized":"2024-09-10T06:26:17.339747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.909257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.592680+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:26:17.592680+0000","last_peered":"2024-09-10T06:26:17.592680+0000","last_clean":"2024-09-10T06:26:17.592680+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:26:17.592680+0000","last_undegraded":"2024-09-10T06:26:17.592680+0000","last_fullsized":"2024-09-10T06:26:17.592680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841976+0000","last_change":"2024-09-10T06:22:31.798967+0000","last_active":"2024-09-10T06:23:12.841976+0000","last_peered":"2024-09-10T06:23:12.841976+0000","last_clean":"2024-09-10T06:23:12.841976+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:23:12.841976+0000","last_undegraded":"2024-09-10T06:23:12.841976+0000","last_fullsized":"2024-09-10T06:23:12.841976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:44.941111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849600+0000","last_change":"2024-09-10T06:22:35.823165+0000","last_active":"2024-09-10T06:23:12.849600+0000","last_peered":"2024-09-10T06:23:12.849600+0000","last_clean":"2024-09-10T06:23:12.849600+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:23:12.849600+0000","last_undegraded":"2024-09-10T06:23:12.849600+0000","last_fullsized":"2024-09-10T06:23:12.849600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:33.329366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.469751+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:26:17.469751+0000","last_peered":"2024-09-10T06:26:17.469751+0000","last_clean":"2024-09-10T06:26:17.469751+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:17.469751+0000","last_undegraded":"2024-09-10T06:26:17.469751+0000","last_fullsized":"2024-09-10T06:26:17.469751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:01.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840875+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:23:12.840875+0000","last_peered":"2024-09-10T06:23:12.840875+0000","last_clean":"2024-09-10T06:23:12.840875+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:23:12.840875+0000","last_undegraded":"2024-09-10T06:23:12.840875+0000","last_fullsized":"2024-09-10T06:23:12.840875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:38.216965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.103075+0000","last_change":"2024-09-10T06:22:33.843181+0000","last_active":"2024-09-10T06:24:41.103075+0000","last_peered":"2024-09-10T06:24:41.103075+0000","last_clean":"2024-09-10T06:24:41.103075+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:24:41.103075+0000","last_undegraded":"2024-09-10T06:24:41.103075+0000","last_fullsized":"2024-09-10T06:24:41.103075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.994437+0000","last_change":"2024-09-10T06:22:31.819223+0000","last_active":"2024-09-10T06:24:44.994437+0000","last_peered":"2024-09-10T06:24:44.994437+0000","last_clean":"2024-09-10T06:24:44.994437+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:24:44.994437+0000","last_undegraded":"2024-09-10T06:24:44.994437+0000","last_fullsized":"2024-09-10T06:24:44.994437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:27.515537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843413+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:23:12.843413+0000","last_peered":"2024-09-10T06:23:12.843413+0000","last_clean":"2024-09-10T06:23:12.843413+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:23:12.843413+0000","last_undegraded":"2024-09-10T06:23:12.843413+0000","last_fullsized":"2024-09-10T06:23:12.843413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:11.280056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.374401+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:26:17.374401+0000","last_peered":"2024-09-10T06:26:17.374401+0000","last_clean":"2024-09-10T06:26:17.374401+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:26:17.374401+0000","last_undegraded":"2024-09-10T06:26:17.374401+0000","last_fullsized":"2024-09-10T06:26:17.374401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:40.193573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.877644+0000","last_change":"2024-09-10T06:22:33.840970+0000","last_active":"2024-09-10T06:25:03.877644+0000","last_peered":"2024-09-10T06:25:03.877644+0000","last_clean":"2024-09-10T06:25:03.877644+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:25:03.877644+0000","last_undegraded":"2024-09-10T06:25:03.877644+0000","last_fullsized":"2024-09-10T06:25:03.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:08.529180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.733659+0000","last_change":"2024-09-10T06:22:31.827656+0000","last_active":"2024-09-10T06:25:45.733659+0000","last_peered":"2024-09-10T06:25:45.733659+0000","last_clean":"2024-09-10T06:25:45.733659+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:25:45.733659+0000","last_undegraded":"2024-09-10T06:25:45.733659+0000","last_fullsized":"2024-09-10T06:25:45.733659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:11.134307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'40","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.520329+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:26:17.520329+0000","last_peered":"2024-09-10T06:26:17.520329+0000","last_clean":"2024-09-10T06:26:17.520329+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:26:17.520329+0000","last_undegraded":"2024-09-10T06:26:17.520329+0000","last_fullsized":"2024-09-10T06:26:17.520329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380753+0000","last_change":"2024-09-10T06:22:33.836076+0000","last_active":"2024-09-10T06:25:46.380753+0000","last_peered":"2024-09-10T06:25:46.380753+0000","last_clean":"2024-09-10T06:25:46.380753+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:25:46.380753+0000","last_undegraded":"2024-09-10T06:25:46.380753+0000","last_fullsized":"2024-09-10T06:25:46.380753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:36.039957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.775457+0000","last_change":"2024-09-10T06:22:31.836769+0000","last_active":"2024-09-10T06:25:45.775457+0000","last_peered":"2024-09-10T06:25:45.775457+0000","last_clean":"2024-09-10T06:25:45.775457+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:25:45.775457+0000","last_undegraded":"2024-09-10T06:25:45.775457+0000","last_fullsized":"2024-09-10T06:25:45.775457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:26.478355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850533+0000","last_change":"2024-09-10T06:22:35.826620+0000","last_active":"2024-09-10T06:23:12.850533+0000","last_peered":"2024-09-10T06:23:12.850533+0000","last_clean":"2024-09-10T06:23:12.850533+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:23:12.850533+0000","last_undegraded":"2024-09-10T06:23:12.850533+0000","last_fullsized":"2024-09-10T06:23:12.850533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:41.740450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.529209+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:26:17.529209+0000","last_peered":"2024-09-10T06:26:17.529209+0000","last_clean":"2024-09-10T06:26:17.529209+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:26:17.529209+0000","last_undegraded":"2024-09-10T06:26:17.529209+0000","last_fullsized":"2024-09-10T06:26:17.529209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:17.153703+0000","last_change":"2024-09-10T06:22:31.812723+0000","last_active":"2024-09-10T06:23:17.153703+0000","last_peered":"2024-09-10T06:23:17.153703+0000","last_clean":"2024-09-10T06:23:17.153703+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:23:17.153703+0000","last_undegraded":"2024-09-10T06:23:17.153703+0000","last_fullsized":"2024-09-10T06:23:17.153703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:06.179051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.457971+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:26:17.457971+0000","last_peered":"2024-09-10T06:26:17.457971+0000","last_clean":"2024-09-10T06:26:17.457971+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:26:17.457971+0000","last_undegraded":"2024-09-10T06:26:17.457971+0000","last_fullsized":"2024-09-10T06:26:17.457971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226520+0000","last_change":"2024-09-10T06:22:33.841332+0000","last_active":"2024-09-10T06:25:46.226520+0000","last_peered":"2024-09-10T06:25:46.226520+0000","last_clean":"2024-09-10T06:25:46.226520+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:25:46.226520+0000","last_undegraded":"2024-09-10T06:25:46.226520+0000","last_fullsized":"2024-09-10T06:25:46.226520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:29.424851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.183187+0000","last_change":"2024-09-10T06:22:31.803970+0000","last_active":"2024-09-10T06:25:46.183187+0000","last_peered":"2024-09-10T06:25:46.183187+0000","last_clean":"2024-09-10T06:25:46.183187+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:25:46.183187+0000","last_undegraded":"2024-09-10T06:25:46.183187+0000","last_fullsized":"2024-09-10T06:25:46.183187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:46.192470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.476533+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:26:17.476533+0000","last_peered":"2024-09-10T06:26:17.476533+0000","last_clean":"2024-09-10T06:26:17.476533+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:26:17.476533+0000","last_undegraded":"2024-09-10T06:26:17.476533+0000","last_fullsized":"2024-09-10T06:26:17.476533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.867864+0000","last_change":"2024-09-10T06:22:33.832724+0000","last_active":"2024-09-10T06:23:12.867864+0000","last_peered":"2024-09-10T06:23:12.867864+0000","last_clean":"2024-09-10T06:23:12.867864+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:23:12.867864+0000","last_undegraded":"2024-09-10T06:23:12.867864+0000","last_fullsized":"2024-09-10T06:23:12.867864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:20.127030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.767234+0000","last_change":"2024-09-10T06:22:31.809134+0000","last_active":"2024-09-10T06:25:45.767234+0000","last_peered":"2024-09-10T06:25:45.767234+0000","last_clean":"2024-09-10T06:25:45.767234+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:25:45.767234+0000","last_undegraded":"2024-09-10T06:25:45.767234+0000","last_fullsized":"2024-09-10T06:25:45.767234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:03.278295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.225482+0000","last_change":"2024-09-10T06:22:33.842763+0000","last_active":"2024-09-10T06:25:46.225482+0000","last_peered":"2024-09-10T06:25:46.225482+0000","last_clean":"2024-09-10T06:25:46.225482+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:25:46.225482+0000","last_undegraded":"2024-09-10T06:25:46.225482+0000","last_fullsized":"2024-09-10T06:25:46.225482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838799+0000","last_change":"2024-09-10T06:22:31.809874+0000","last_active":"2024-09-10T06:23:12.838799+0000","last_peered":"2024-09-10T06:23:12.838799+0000","last_clean":"2024-09-10T06:23:12.838799+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:23:12.838799+0000","last_undegraded":"2024-09-10T06:23:12.838799+0000","last_fullsized":"2024-09-10T06:23:12.838799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:49.834546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380807+0000","last_change":"2024-09-10T06:23:12.866962+0000","last_active":"2024-09-10T06:25:46.380807+0000","last_peered":"2024-09-10T06:25:46.380807+0000","last_clean":"2024-09-10T06:25:46.380807+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:25:46.380807+0000","last_undegraded":"2024-09-10T06:25:46.380807+0000","last_fullsized":"2024-09-10T06:25:46.380807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.062389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842517+0000","last_change":"2024-09-10T06:22:31.831565+0000","last_active":"2024-09-10T06:23:12.842517+0000","last_peered":"2024-09-10T06:23:12.842517+0000","last_clean":"2024-09-10T06:23:12.842517+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:23:12.842517+0000","last_undegraded":"2024-09-10T06:23:12.842517+0000","last_fullsized":"2024-09-10T06:23:12.842517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.130643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427522+0000","last_change":"2024-09-10T06:22:33.843784+0000","last_active":"2024-09-10T06:24:00.427522+0000","last_peered":"2024-09-10T06:24:00.427522+0000","last_clean":"2024-09-10T06:24:00.427522+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:24:00.427522+0000","last_undegraded":"2024-09-10T06:24:00.427522+0000","last_fullsized":"2024-09-10T06:24:00.427522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:08.793382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.413251+0000","last_change":"2024-09-10T06:22:31.813752+0000","last_active":"2024-09-10T06:24:00.413251+0000","last_peered":"2024-09-10T06:24:00.413251+0000","last_clean":"2024-09-10T06:24:00.413251+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:24:00.413251+0000","last_undegraded":"2024-09-10T06:24:00.413251+0000","last_fullsized":"2024-09-10T06:24:00.413251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:46.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380014+0000","last_change":"2024-09-10T06:22:33.818286+0000","last_active":"2024-09-10T06:25:46.380014+0000","last_peered":"2024-09-10T06:25:46.380014+0000","last_clean":"2024-09-10T06:25:46.380014+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:25:46.380014+0000","last_undegraded":"2024-09-10T06:25:46.380014+0000","last_fullsized":"2024-09-10T06:25:46.380014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841898+0000","last_change":"2024-09-10T06:22:31.809970+0000","last_active":"2024-09-10T06:23:12.841898+0000","last_peered":"2024-09-10T06:23:12.841898+0000","last_clean":"2024-09-10T06:23:12.841898+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:23:12.841898+0000","last_undegraded":"2024-09-10T06:23:12.841898+0000","last_fullsized":"2024-09-10T06:23:12.841898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:42.775634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.316095+0000","last_change":"2024-09-10T06:22:33.832194+0000","last_active":"2024-09-10T06:25:46.316095+0000","last_peered":"2024-09-10T06:25:46.316095+0000","last_clean":"2024-09-10T06:25:46.316095+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:25:46.316095+0000","last_undegraded":"2024-09-10T06:25:46.316095+0000","last_fullsized":"2024-09-10T06:25:46.316095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858710+0000","last_change":"2024-09-10T06:22:31.833838+0000","last_active":"2024-09-10T06:23:12.858710+0000","last_peered":"2024-09-10T06:23:12.858710+0000","last_clean":"2024-09-10T06:23:12.858710+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:23:12.858710+0000","last_undegraded":"2024-09-10T06:23:12.858710+0000","last_fullsized":"2024-09-10T06:23:12.858710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:29.512372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314627+0000","last_change":"2024-09-10T06:22:33.820714+0000","last_active":"2024-09-10T06:25:46.314627+0000","last_peered":"2024-09-10T06:25:46.314627+0000","last_clean":"2024-09-10T06:25:46.314627+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:25:46.314627+0000","last_undegraded":"2024-09-10T06:25:46.314627+0000","last_fullsized":"2024-09-10T06:25:46.314627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:18.899048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848587+0000","last_change":"2024-09-10T06:22:31.833522+0000","last_active":"2024-09-10T06:23:12.848587+0000","last_peered":"2024-09-10T06:23:12.848587+0000","last_clean":"2024-09-10T06:23:12.848587+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:23:12.848587+0000","last_undegraded":"2024-09-10T06:23:12.848587+0000","last_fullsized":"2024-09-10T06:23:12.848587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:11.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028535+0000","last_change":"2024-09-10T06:22:33.822155+0000","last_active":"2024-09-10T06:25:46.028535+0000","last_peered":"2024-09-10T06:25:46.028535+0000","last_clean":"2024-09-10T06:25:46.028535+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:25:46.028535+0000","last_undegraded":"2024-09-10T06:25:46.028535+0000","last_fullsized":"2024-09-10T06:25:46.028535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842016+0000","last_change":"2024-09-10T06:22:31.809583+0000","last_active":"2024-09-10T06:23:12.842016+0000","last_peered":"2024-09-10T06:23:12.842016+0000","last_clean":"2024-09-10T06:23:12.842016+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:23:12.842016+0000","last_undegraded":"2024-09-10T06:23:12.842016+0000","last_fullsized":"2024-09-10T06:23:12.842016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:53.413986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'15","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851583+0000","last_change":"2024-09-10T06:22:33.844903+0000","last_active":"2024-09-10T06:24:52.851583+0000","last_peered":"2024-09-10T06:24:52.851583+0000","last_clean":"2024-09-10T06:24:52.851583+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:24:52.851583+0000","last_undegraded":"2024-09-10T06:24:52.851583+0000","last_fullsized":"2024-09-10T06:24:52.851583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:16.098280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.564147+0000","last_change":"2024-09-10T06:22:31.828487+0000","last_active":"2024-09-10T06:23:15.564147+0000","last_peered":"2024-09-10T06:23:15.564147+0000","last_clean":"2024-09-10T06:23:15.564147+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:23:15.564147+0000","last_undegraded":"2024-09-10T06:23:15.564147+0000","last_fullsized":"2024-09-10T06:23:15.564147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:47.707056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563325+0000","last_change":"2024-09-10T06:22:31.813099+0000","last_active":"2024-09-10T06:23:15.563325+0000","last_peered":"2024-09-10T06:23:15.563325+0000","last_clean":"2024-09-10T06:23:15.563325+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:23:15.563325+0000","last_undegraded":"2024-09-10T06:23:15.563325+0000","last_fullsized":"2024-09-10T06:23:15.563325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.402083+0000","last_change":"2024-09-10T06:22:33.818285+0000","last_active":"2024-09-10T06:23:16.402083+0000","last_peered":"2024-09-10T06:23:16.402083+0000","last_clean":"2024-09-10T06:23:16.402083+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:23:16.402083+0000","last_undegraded":"2024-09-10T06:23:16.402083+0000","last_fullsized":"2024-09-10T06:23:16.402083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.081113+0000","last_change":"2024-09-10T06:22:31.812762+0000","last_active":"2024-09-10T06:24:41.081113+0000","last_peered":"2024-09-10T06:24:41.081113+0000","last_clean":"2024-09-10T06:24:41.081113+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:24:41.081113+0000","last_undegraded":"2024-09-10T06:24:41.081113+0000","last_fullsized":"2024-09-10T06:24:41.081113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:32.725312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.910497+0000","last_change":"2024-09-10T06:22:33.811540+0000","last_active":"2024-09-10T06:25:45.910497+0000","last_peered":"2024-09-10T06:25:45.910497+0000","last_clean":"2024-09-10T06:25:45.910497+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:25:45.910497+0000","last_undegraded":"2024-09-10T06:25:45.910497+0000","last_fullsized":"2024-09-10T06:25:45.910497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:40.528357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845567+0000","last_change":"2024-09-10T06:22:31.811935+0000","last_active":"2024-09-10T06:23:12.845567+0000","last_peered":"2024-09-10T06:23:12.845567+0000","last_clean":"2024-09-10T06:23:12.845567+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:23:12.845567+0000","last_undegraded":"2024-09-10T06:23:12.845567+0000","last_fullsized":"2024-09-10T06:23:12.845567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315934+0000","last_change":"2024-09-10T06:22:33.828847+0000","last_active":"2024-09-10T06:25:46.315934+0000","last_peered":"2024-09-10T06:25:46.315934+0000","last_clean":"2024-09-10T06:25:46.315934+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:25:46.315934+0000","last_undegraded":"2024-09-10T06:25:46.315934+0000","last_fullsized":"2024-09-10T06:25:46.315934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839176+0000","last_change":"2024-09-10T06:22:31.832535+0000","last_active":"2024-09-10T06:23:12.839176+0000","last_peered":"2024-09-10T06:23:12.839176+0000","last_clean":"2024-09-10T06:23:12.839176+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:23:12.839176+0000","last_undegraded":"2024-09-10T06:23:12.839176+0000","last_fullsized":"2024-09-10T06:23:12.839176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:34.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315089+0000","last_change":"2024-09-10T06:22:33.845847+0000","last_active":"2024-09-10T06:25:46.315089+0000","last_peered":"2024-09-10T06:25:46.315089+0000","last_clean":"2024-09-10T06:25:46.315089+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:25:46.315089+0000","last_undegraded":"2024-09-10T06:25:46.315089+0000","last_fullsized":"2024-09-10T06:25:46.315089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848612+0000","last_change":"2024-09-10T06:22:31.838658+0000","last_active":"2024-09-10T06:23:12.848612+0000","last_peered":"2024-09-10T06:23:12.848612+0000","last_clean":"2024-09-10T06:23:12.848612+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:23:12.848612+0000","last_undegraded":"2024-09-10T06:23:12.848612+0000","last_fullsized":"2024-09-10T06:23:12.848612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:56.723910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848557+0000","last_change":"2024-09-10T06:23:12.871593+0000","last_active":"2024-09-10T06:23:16.848557+0000","last_peered":"2024-09-10T06:23:16.848557+0000","last_clean":"2024-09-10T06:23:16.848557+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:23:16.848557+0000","last_undegraded":"2024-09-10T06:23:16.848557+0000","last_fullsized":"2024-09-10T06:23:16.848557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.458403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848766+0000","last_change":"2024-09-10T06:22:31.832744+0000","last_active":"2024-09-10T06:23:12.848766+0000","last_peered":"2024-09-10T06:23:12.848766+0000","last_clean":"2024-09-10T06:23:12.848766+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:23:12.848766+0000","last_undegraded":"2024-09-10T06:23:12.848766+0000","last_fullsized":"2024-09-10T06:23:12.848766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:59.824161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849028+0000","last_change":"2024-09-10T06:22:33.824001+0000","last_active":"2024-09-10T06:24:42.849028+0000","last_peered":"2024-09-10T06:24:42.849028+0000","last_clean":"2024-09-10T06:24:42.849028+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:24:42.849028+0000","last_undegraded":"2024-09-10T06:24:42.849028+0000","last_fullsized":"2024-09-10T06:24:42.849028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:04.705910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.190954+0000","last_change":"2024-09-10T06:22:31.828589+0000","last_active":"2024-09-10T06:25:46.190954+0000","last_peered":"2024-09-10T06:25:46.190954+0000","last_clean":"2024-09-10T06:25:46.190954+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:25:46.190954+0000","last_undegraded":"2024-09-10T06:25:46.190954+0000","last_fullsized":"2024-09-10T06:25:46.190954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:13.166658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836407+0000","last_change":"2024-09-10T06:22:31.822739+0000","last_active":"2024-09-10T06:23:12.836407+0000","last_peered":"2024-09-10T06:23:12.836407+0000","last_clean":"2024-09-10T06:23:12.836407+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:23:12.836407+0000","last_undegraded":"2024-09-10T06:23:12.836407+0000","last_fullsized":"2024-09-10T06:23:12.836407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:18.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427151+0000","last_change":"2024-09-10T06:22:33.834781+0000","last_active":"2024-09-10T06:24:00.427151+0000","last_peered":"2024-09-10T06:24:00.427151+0000","last_clean":"2024-09-10T06:24:00.427151+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:24:00.427151+0000","last_undegraded":"2024-09-10T06:24:00.427151+0000","last_fullsized":"2024-09-10T06:24:00.427151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.042356+0000","last_change":"2024-09-10T06:22:31.814239+0000","last_active":"2024-09-10T06:24:45.042356+0000","last_peered":"2024-09-10T06:24:45.042356+0000","last_clean":"2024-09-10T06:24:45.042356+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:24:45.042356+0000","last_undegraded":"2024-09-10T06:24:45.042356+0000","last_fullsized":"2024-09-10T06:24:45.042356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226303+0000","last_change":"2024-09-10T06:22:33.828192+0000","last_active":"2024-09-10T06:25:46.226303+0000","last_peered":"2024-09-10T06:25:46.226303+0000","last_clean":"2024-09-10T06:25:46.226303+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:25:46.226303+0000","last_undegraded":"2024-09-10T06:25:46.226303+0000","last_fullsized":"2024-09-10T06:25:46.226303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:17.430784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40424,"kb_used_data":5080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331416,"statfs":{"total":96636764160,"available":96595369984,"internally_reserved":0,"allocated":5201920,"data_stored":4918891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48744,"kb_used_data":9240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323096,"statfs":{"total":96636764160,"available":96586850304,"internally_reserved":0,"allocated":9461760,"data_stored":9165923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.505 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.506 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.507 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.508 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.509 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.510 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.511 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.512 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.513 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.514 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.515 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T06:22:17.828893+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.516 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.517 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.518 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.519 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.520 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.521 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T06:22:22.840310+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.522 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.523 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.524 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.525 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.526 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.527 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.528 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.529 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.530 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.531 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.532 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.533 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.534 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.535 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.536 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:22.537 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:26:42.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:42.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f8156708640 1 Processor -- start 2024-09-10T06:26:42.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f8156708640 1 -- start start 2024-09-10T06:26:42.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f8156708640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8150110da0 0x7f8150111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:42.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f8156708640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8150073a90 con 0x7f81501116c0 2024-09-10T06:26:42.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f8156708640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f81500696e0 con 0x7f8150110da0 2024-09-10T06:26:42.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8150110da0 0x7f8150111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:42.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f81501116c0 0x7f81501231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39674/0 (socket says 172.21.15.84:39674) 2024-09-10T06:26:42.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814f7fe640 1 -- 172.21.15.84:0/3589053397 learned_addr learned my addr 172.21.15.84:0/3589053397 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:26:42.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814ffff640 1 -- 172.21.15.84:0/3589053397 >> v1:172.21.15.84:6789/0 conn(0x7f81501116c0 legacy=0x7f81501231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:42.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814ffff640 1 -- 172.21.15.84:0/3589053397 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815006dd50 con 0x7f8150110da0 2024-09-10T06:26:42.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.667+0000 7f814ffff640 1 --2- 172.21.15.84:0/3589053397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f8150111180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8140009740 tx=0x7f814001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27938383ed24028 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:42.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814effd640 1 -- 172.21.15.84:0/3589053397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81400b0070 con 0x7f8150110da0 2024-09-10T06:26:42.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814effd640 1 -- 172.21.15.84:0/3589053397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81400ab530 con 0x7f8150110da0 2024-09-10T06:26:42.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814effd640 1 -- 172.21.15.84:0/3589053397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81400ab830 con 0x7f8150110da0 2024-09-10T06:26:42.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/3589053397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 msgr2=0x7f8150111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:42.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 --2- 172.21.15.84:0/3589053397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f8150111180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8140009740 tx=0x7f814001c370 comp rx=0 tx=0).stop 2024-09-10T06:26:42.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/3589053397 shutdown_connections 2024-09-10T06:26:42.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 --2- 172.21.15.84:0/3589053397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f8150111180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:42.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/3589053397 >> 172.21.15.84:0/3589053397 conn(0x7f8150070900 msgr2=0x7f8150072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:42.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/3589053397 shutdown_connections 2024-09-10T06:26:42.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/3589053397 wait complete. 2024-09-10T06:26:42.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 Processor -- start 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- start start 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8150135470 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51380/0 (socket says 172.21.15.84:51380) 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814ffff640 1 -- 172.21.15.84:0/2895021933 learned_addr learned my addr 172.21.15.84:0/2895021933 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814ffff640 1 -- 172.21.15.84:0/2895021933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81501155f0 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814ffff640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f81400ae040 tx=0x7f8140019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81400b8020 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81400b4600 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8150131da0 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81400b0040 con 0x7f8150110da0 2024-09-10T06:26:42.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815012ff30 con 0x7f8150110da0 2024-09-10T06:26:42.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8150111180 con 0x7f8150110da0 2024-09-10T06:26:42.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.671+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f81400bb020 con 0x7f8150110da0 2024-09-10T06:26:42.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.675+0000 7f814cff9640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 0x7f813c03d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:26:42.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.675+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f81400e9690 con 0x7f8150110da0 2024-09-10T06:26:42.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.675+0000 7f814f7fe640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 0x7f813c03d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:26:42.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.675+0000 7f814f7fe640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 0x7f813c03d6e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81440015f0 tx=0x7f8144007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:26:42.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.679+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f81400c2030 con 0x7f8150110da0 2024-09-10T06:26:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.839+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81501120e0 con 0x7f813c03b220 2024-09-10T06:26:42.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.871+0000 7f814cff9640 1 -- 172.21.15.84:0/2895021933 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665234 (secure 0 0 0) 0x7f81440058c0 con 0x7f813c03b220 2024-09-10T06:26:42.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:26:42.886 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:26:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 msgr2=0x7f813c03d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 0x7f813c03d6e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81440015f0 tx=0x7f8144007ab0 comp rx=0 tx=0).stop 2024-09-10T06:26:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 msgr2=0x7f815012f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:26:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f81400ae040 tx=0x7f8140019110 comp rx=0 tx=0).stop 2024-09-10T06:26:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 shutdown_connections 2024-09-10T06:26:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f813c03b220 0x7f813c03d6e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 --2- 172.21.15.84:0/2895021933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8150110da0 0x7f815012f9f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:26:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 >> 172.21.15.84:0/2895021933 conn(0x7f8150070900 msgr2=0x7f8150071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:26:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 shutdown_connections 2024-09-10T06:26:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:26:42.879+0000 7f8156708640 1 -- 172.21.15.84:0/2895021933 wait complete. 2024-09-10T06:26:42.902 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-10T06:26:41.877066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4570,"ondisk_log_size":4570,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1722172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006873"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.465867+0000","last_change":"2024-09-10T06:26:34.465867+0000","last_active":"2024-09-10T06:26:34.465867+0000","last_peered":"2024-09-10T06:26:34.465867+0000","last_clean":"2024-09-10T06:26:34.465867+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:26:34.465867+0000","last_undegraded":"2024-09-10T06:26:34.465867+0000","last_fullsized":"2024-09-10T06:26:34.465867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.465683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:52.407098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380991+0000","last_change":"2024-09-10T06:22:33.833535+0000","last_active":"2024-09-10T06:25:46.380991+0000","last_peered":"2024-09-10T06:25:46.380991+0000","last_clean":"2024-09-10T06:25:46.380991+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:25:46.380991+0000","last_undegraded":"2024-09-10T06:25:46.380991+0000","last_fullsized":"2024-09-10T06:25:46.380991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:25.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.019911+0000","last_change":"2024-09-10T06:26:31.019911+0000","last_active":"2024-09-10T06:26:31.019911+0000","last_peered":"2024-09-10T06:26:31.019911+0000","last_clean":"2024-09-10T06:26:31.019911+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:26:31.019911+0000","last_undegraded":"2024-09-10T06:26:31.019911+0000","last_fullsized":"2024-09-10T06:26:31.019911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.019720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.047991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.656272+0000","last_change":"2024-09-10T06:22:31.836564+0000","last_active":"2024-09-10T06:25:45.656272+0000","last_peered":"2024-09-10T06:25:45.656272+0000","last_clean":"2024-09-10T06:25:45.656272+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:25:45.656272+0000","last_undegraded":"2024-09-10T06:25:45.656272+0000","last_fullsized":"2024-09-10T06:25:45.656272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:18.259418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:33.871181+0000","last_change":"2024-09-10T06:22:31.806993+0000","last_active":"2024-09-10T06:24:33.871181+0000","last_peered":"2024-09-10T06:24:33.871181+0000","last_clean":"2024-09-10T06:24:33.871181+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:24:33.871181+0000","last_undegraded":"2024-09-10T06:24:33.871181+0000","last_fullsized":"2024-09-10T06:24:33.871181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.401883+0000","last_change":"2024-09-10T06:23:12.860422+0000","last_active":"2024-09-10T06:25:46.401883+0000","last_peered":"2024-09-10T06:25:46.401883+0000","last_clean":"2024-09-10T06:25:46.401883+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:25:46.401883+0000","last_undegraded":"2024-09-10T06:25:46.401883+0000","last_fullsized":"2024-09-10T06:25:46.401883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:40.359356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838331+0000","last_change":"2024-09-10T06:22:31.826279+0000","last_active":"2024-09-10T06:23:12.838331+0000","last_peered":"2024-09-10T06:23:12.838331+0000","last_clean":"2024-09-10T06:23:12.838331+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:23:12.838331+0000","last_undegraded":"2024-09-10T06:23:12.838331+0000","last_fullsized":"2024-09-10T06:23:12.838331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:26.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.330651+0000","last_change":"2024-09-10T06:22:33.812237+0000","last_active":"2024-09-10T06:25:46.330651+0000","last_peered":"2024-09-10T06:25:46.330651+0000","last_clean":"2024-09-10T06:25:46.330651+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:25:46.330651+0000","last_undegraded":"2024-09-10T06:25:46.330651+0000","last_fullsized":"2024-09-10T06:25:46.330651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.383694+0000","last_change":"2024-09-10T06:26:32.383694+0000","last_active":"2024-09-10T06:26:32.383694+0000","last_peered":"2024-09-10T06:26:32.383694+0000","last_clean":"2024-09-10T06:26:32.383694+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:26:32.383694+0000","last_undegraded":"2024-09-10T06:26:32.383694+0000","last_fullsized":"2024-09-10T06:26:32.383694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.383510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:41.546507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843973+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:23:12.843973+0000","last_peered":"2024-09-10T06:23:12.843973+0000","last_clean":"2024-09-10T06:23:12.843973+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:23:12.843973+0000","last_undegraded":"2024-09-10T06:23:12.843973+0000","last_fullsized":"2024-09-10T06:23:12.843973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:50.427247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838841+0000","last_change":"2024-09-10T06:22:31.828678+0000","last_active":"2024-09-10T06:23:12.838841+0000","last_peered":"2024-09-10T06:23:12.838841+0000","last_clean":"2024-09-10T06:23:12.838841+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:23:12.838841+0000","last_undegraded":"2024-09-10T06:23:12.838841+0000","last_fullsized":"2024-09-10T06:23:12.838841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:33.653901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.426746+0000","last_change":"2024-09-10T06:22:33.841656+0000","last_active":"2024-09-10T06:24:00.426746+0000","last_peered":"2024-09-10T06:24:00.426746+0000","last_clean":"2024-09-10T06:24:00.426746+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:24:00.426746+0000","last_undegraded":"2024-09-10T06:24:00.426746+0000","last_fullsized":"2024-09-10T06:24:00.426746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.423672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.039477+0000","last_change":"2024-09-10T06:26:30.039477+0000","last_active":"2024-09-10T06:26:30.039477+0000","last_peered":"2024-09-10T06:26:30.039477+0000","last_clean":"2024-09-10T06:26:30.039477+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:26:30.039477+0000","last_undegraded":"2024-09-10T06:26:30.039477+0000","last_fullsized":"2024-09-10T06:26:30.039477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.039298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:00.637143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.027326+0000","last_change":"2024-09-10T06:23:12.857760+0000","last_active":"2024-09-10T06:25:46.027326+0000","last_peered":"2024-09-10T06:25:46.027326+0000","last_clean":"2024-09-10T06:25:46.027326+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:25:46.027326+0000","last_undegraded":"2024-09-10T06:25:46.027326+0000","last_fullsized":"2024-09-10T06:25:46.027326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:01.942980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.658943+0000","last_change":"2024-09-10T06:26:34.658943+0000","last_active":"2024-09-10T06:26:34.658943+0000","last_peered":"2024-09-10T06:26:34.658943+0000","last_clean":"2024-09-10T06:26:34.658943+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:26:34.658943+0000","last_undegraded":"2024-09-10T06:26:34.658943+0000","last_fullsized":"2024-09-10T06:26:34.658943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.658763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:49.709576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028692+0000","last_change":"2024-09-10T06:22:33.844939+0000","last_active":"2024-09-10T06:25:46.028692+0000","last_peered":"2024-09-10T06:25:46.028692+0000","last_clean":"2024-09-10T06:25:46.028692+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:25:46.028692+0000","last_undegraded":"2024-09-10T06:25:46.028692+0000","last_fullsized":"2024-09-10T06:25:46.028692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:28:54.074106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.418172+0000","last_change":"2024-09-10T06:26:33.418172+0000","last_active":"2024-09-10T06:26:33.418172+0000","last_peered":"2024-09-10T06:26:33.418172+0000","last_clean":"2024-09-10T06:26:33.418172+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:26:33.418172+0000","last_undegraded":"2024-09-10T06:26:33.418172+0000","last_fullsized":"2024-09-10T06:26:33.418172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.417943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:42.088360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226464+0000","last_change":"2024-09-10T06:22:33.841628+0000","last_active":"2024-09-10T06:25:46.226464+0000","last_peered":"2024-09-10T06:25:46.226464+0000","last_clean":"2024-09-10T06:25:46.226464+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:25:46.226464+0000","last_undegraded":"2024-09-10T06:25:46.226464+0000","last_fullsized":"2024-09-10T06:25:46.226464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.556091+0000","last_change":"2024-09-10T06:26:31.556091+0000","last_active":"2024-09-10T06:26:31.556091+0000","last_peered":"2024-09-10T06:26:31.556091+0000","last_clean":"2024-09-10T06:26:31.556091+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:26:31.556091+0000","last_undegraded":"2024-09-10T06:26:31.556091+0000","last_fullsized":"2024-09-10T06:26:31.556091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.555912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:11.664445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026158+0000","last_change":"2024-09-10T06:22:33.822953+0000","last_active":"2024-09-10T06:25:46.026158+0000","last_peered":"2024-09-10T06:25:46.026158+0000","last_clean":"2024-09-10T06:25:46.026158+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:25:46.026158+0000","last_undegraded":"2024-09-10T06:25:46.026158+0000","last_fullsized":"2024-09-10T06:25:46.026158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:06.442493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.598629+0000","last_change":"2024-09-10T06:26:32.598629+0000","last_active":"2024-09-10T06:26:32.598629+0000","last_peered":"2024-09-10T06:26:32.598629+0000","last_clean":"2024-09-10T06:26:32.598629+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:26:32.598629+0000","last_undegraded":"2024-09-10T06:26:32.598629+0000","last_fullsized":"2024-09-10T06:26:32.598629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.598449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:24.920243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.894566+0000","last_change":"2024-09-10T06:22:33.841481+0000","last_active":"2024-09-10T06:25:45.894566+0000","last_peered":"2024-09-10T06:25:45.894566+0000","last_clean":"2024-09-10T06:25:45.894566+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:25:45.894566+0000","last_undegraded":"2024-09-10T06:25:45.894566+0000","last_fullsized":"2024-09-10T06:25:45.894566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:07.493563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.086704+0000","last_change":"2024-09-10T06:26:28.086704+0000","last_active":"2024-09-10T06:26:28.086704+0000","last_peered":"2024-09-10T06:26:28.086704+0000","last_clean":"2024-09-10T06:26:28.086704+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:26:28.086704+0000","last_undegraded":"2024-09-10T06:26:28.086704+0000","last_fullsized":"2024-09-10T06:26:28.086704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.086529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:43.137342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.299397+0000","last_change":"2024-09-10T06:22:33.818692+0000","last_active":"2024-09-10T06:24:45.299397+0000","last_peered":"2024-09-10T06:24:45.299397+0000","last_clean":"2024-09-10T06:24:45.299397+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:24:45.299397+0000","last_undegraded":"2024-09-10T06:24:45.299397+0000","last_fullsized":"2024-09-10T06:24:45.299397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:04.049587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.562583+0000","last_change":"2024-09-10T06:22:31.830265+0000","last_active":"2024-09-10T06:23:15.562583+0000","last_peered":"2024-09-10T06:23:15.562583+0000","last_clean":"2024-09-10T06:23:15.562583+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:23:15.562583+0000","last_undegraded":"2024-09-10T06:23:15.562583+0000","last_fullsized":"2024-09-10T06:23:15.562583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:05.584249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314012+0000","last_change":"2024-09-10T06:22:33.812296+0000","last_active":"2024-09-10T06:25:46.314012+0000","last_peered":"2024-09-10T06:25:46.314012+0000","last_clean":"2024-09-10T06:25:46.314012+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:25:46.314012+0000","last_undegraded":"2024-09-10T06:25:46.314012+0000","last_fullsized":"2024-09-10T06:25:46.314012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:01.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.268913+0000","last_change":"2024-09-10T06:26:36.268913+0000","last_active":"2024-09-10T06:26:36.268913+0000","last_peered":"2024-09-10T06:26:36.268913+0000","last_clean":"2024-09-10T06:26:36.268913+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:26:36.268913+0000","last_undegraded":"2024-09-10T06:26:36.268913+0000","last_fullsized":"2024-09-10T06:26:36.268913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.268668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:50.827972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.668585+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:26:17.668585+0000","last_peered":"2024-09-10T06:26:17.668585+0000","last_clean":"2024-09-10T06:26:17.668585+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:26:17.668585+0000","last_undegraded":"2024-09-10T06:26:17.668585+0000","last_fullsized":"2024-09-10T06:26:17.668585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380630+0000","last_change":"2024-09-10T06:22:33.816970+0000","last_active":"2024-09-10T06:25:46.380630+0000","last_peered":"2024-09-10T06:25:46.380630+0000","last_clean":"2024-09-10T06:25:46.380630+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:25:46.380630+0000","last_undegraded":"2024-09-10T06:25:46.380630+0000","last_fullsized":"2024-09-10T06:25:46.380630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:13.014250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.454535+0000","last_change":"2024-09-10T06:26:28.454535+0000","last_active":"2024-09-10T06:26:28.454535+0000","last_peered":"2024-09-10T06:26:28.454535+0000","last_clean":"2024-09-10T06:26:28.454535+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:26:28.454535+0000","last_undegraded":"2024-09-10T06:26:28.454535+0000","last_fullsized":"2024-09-10T06:26:28.454535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.454354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:21.140529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.235143+0000","last_change":"2024-09-10T06:26:35.235143+0000","last_active":"2024-09-10T06:26:35.235143+0000","last_peered":"2024-09-10T06:26:35.235143+0000","last_clean":"2024-09-10T06:26:35.235143+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:26:35.235143+0000","last_undegraded":"2024-09-10T06:26:35.235143+0000","last_fullsized":"2024-09-10T06:26:35.235143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.234952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:53.200997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844115+0000","last_change":"2024-09-10T06:22:35.836699+0000","last_active":"2024-09-10T06:23:12.844115+0000","last_peered":"2024-09-10T06:23:12.844115+0000","last_clean":"2024-09-10T06:23:12.844115+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:23:12.844115+0000","last_undegraded":"2024-09-10T06:23:12.844115+0000","last_fullsized":"2024-09-10T06:23:12.844115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:10.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.379703+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:26:17.379703+0000","last_peered":"2024-09-10T06:26:17.379703+0000","last_clean":"2024-09-10T06:26:17.379703+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:26:17.379703+0000","last_undegraded":"2024-09-10T06:26:17.379703+0000","last_fullsized":"2024-09-10T06:26:17.379703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'22","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.942629+0000","last_change":"2024-09-10T06:26:36.942629+0000","last_active":"2024-09-10T06:26:36.942629+0000","last_peered":"2024-09-10T06:26:36.942629+0000","last_clean":"2024-09-10T06:26:36.942629+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:26:36.942629+0000","last_undegraded":"2024-09-10T06:26:36.942629+0000","last_fullsized":"2024-09-10T06:26:36.942629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.942444+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:24.199520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.456692+0000","last_change":"2024-09-10T06:26:23.456692+0000","last_active":"2024-09-10T06:26:23.456692+0000","last_peered":"2024-09-10T06:26:23.456692+0000","last_clean":"2024-09-10T06:26:23.456692+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:26:23.456692+0000","last_undegraded":"2024-09-10T06:26:23.456692+0000","last_fullsized":"2024-09-10T06:26:23.456692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.456509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:13.569641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.620235+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:26:17.620235+0000","last_peered":"2024-09-10T06:26:17.620235+0000","last_clean":"2024-09-10T06:26:17.620235+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:26:17.620235+0000","last_undegraded":"2024-09-10T06:26:17.620235+0000","last_fullsized":"2024-09-10T06:26:17.620235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.388110+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:26:17.388110+0000","last_peered":"2024-09-10T06:26:17.388110+0000","last_clean":"2024-09-10T06:26:17.388110+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:26:17.388110+0000","last_undegraded":"2024-09-10T06:26:17.388110+0000","last_fullsized":"2024-09-10T06:26:17.388110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836656+0000","last_change":"2024-09-10T06:22:33.836542+0000","last_active":"2024-09-10T06:23:12.836656+0000","last_peered":"2024-09-10T06:23:12.836656+0000","last_clean":"2024-09-10T06:23:12.836656+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:23:12.836656+0000","last_undegraded":"2024-09-10T06:23:12.836656+0000","last_fullsized":"2024-09-10T06:23:12.836656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:35.885623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.491509+0000","last_change":"2024-09-10T06:26:26.491509+0000","last_active":"2024-09-10T06:26:26.491509+0000","last_peered":"2024-09-10T06:26:26.491509+0000","last_clean":"2024-09-10T06:26:26.491509+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:26:26.491509+0000","last_undegraded":"2024-09-10T06:26:26.491509+0000","last_fullsized":"2024-09-10T06:26:26.491509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.491266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:02.267203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846399+0000","last_change":"2024-09-10T06:22:35.836358+0000","last_active":"2024-09-10T06:23:12.846399+0000","last_peered":"2024-09-10T06:23:12.846399+0000","last_clean":"2024-09-10T06:23:12.846399+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:23:12.846399+0000","last_undegraded":"2024-09-10T06:23:12.846399+0000","last_fullsized":"2024-09-10T06:23:12.846399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:19.610121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.702650+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:26:17.702650+0000","last_peered":"2024-09-10T06:26:17.702650+0000","last_clean":"2024-09-10T06:26:17.702650+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:17.702650+0000","last_undegraded":"2024-09-10T06:26:17.702650+0000","last_fullsized":"2024-09-10T06:26:17.702650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:10.147486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.165283+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:00.165283+0000","last_peered":"2024-09-10T06:24:00.165283+0000","last_clean":"2024-09-10T06:24:00.165283+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:00.165283+0000","last_undegraded":"2024-09-10T06:24:00.165283+0000","last_fullsized":"2024-09-10T06:24:00.165283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:04.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.750761+0000","last_change":"2024-09-10T06:26:37.750761+0000","last_active":"2024-09-10T06:26:37.750761+0000","last_peered":"2024-09-10T06:26:37.750761+0000","last_clean":"2024-09-10T06:26:37.750761+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:26:37.750761+0000","last_undegraded":"2024-09-10T06:26:37.750761+0000","last_fullsized":"2024-09-10T06:26:37.750761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.750588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:21.168972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.465949+0000","last_change":"2024-09-10T06:26:25.465949+0000","last_active":"2024-09-10T06:26:25.465949+0000","last_peered":"2024-09-10T06:26:25.465949+0000","last_clean":"2024-09-10T06:26:25.465949+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:26:25.465949+0000","last_undegraded":"2024-09-10T06:26:25.465949+0000","last_fullsized":"2024-09-10T06:26:25.465949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.465745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:11.750138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840472+0000","last_change":"2024-09-10T06:22:35.836298+0000","last_active":"2024-09-10T06:23:12.840472+0000","last_peered":"2024-09-10T06:23:12.840472+0000","last_clean":"2024-09-10T06:23:12.840472+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:23:12.840472+0000","last_undegraded":"2024-09-10T06:23:12.840472+0000","last_fullsized":"2024-09-10T06:23:12.840472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:52.762810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.536926+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:26:17.536926+0000","last_peered":"2024-09-10T06:26:17.536926+0000","last_clean":"2024-09-10T06:26:17.536926+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:26:17.536926+0000","last_undegraded":"2024-09-10T06:26:17.536926+0000","last_fullsized":"2024-09-10T06:26:17.536926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:54.521264+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:23:54.521264+0000","last_peered":"2024-09-10T06:23:54.521264+0000","last_clean":"2024-09-10T06:23:54.521264+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:23:54.521264+0000","last_undegraded":"2024-09-10T06:23:54.521264+0000","last_fullsized":"2024-09-10T06:23:54.521264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:15.658769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.592443+0000","last_change":"2024-09-10T06:26:37.592443+0000","last_active":"2024-09-10T06:26:37.592443+0000","last_peered":"2024-09-10T06:26:37.592443+0000","last_clean":"2024-09-10T06:26:37.592443+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:26:37.592443+0000","last_undegraded":"2024-09-10T06:26:37.592443+0000","last_fullsized":"2024-09-10T06:26:37.592443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.592235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:10.519860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.222379+0000","last_change":"2024-09-10T06:26:34.222379+0000","last_active":"2024-09-10T06:26:34.222379+0000","last_peered":"2024-09-10T06:26:34.222379+0000","last_clean":"2024-09-10T06:26:34.222379+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:26:34.222379+0000","last_undegraded":"2024-09-10T06:26:34.222379+0000","last_fullsized":"2024-09-10T06:26:34.222379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.222107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:52.398385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.846203+0000","last_change":"2024-09-10T06:22:35.835893+0000","last_active":"2024-09-10T06:23:12.846203+0000","last_peered":"2024-09-10T06:23:12.846203+0000","last_clean":"2024-09-10T06:23:12.846203+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:23:12.846203+0000","last_undegraded":"2024-09-10T06:23:12.846203+0000","last_fullsized":"2024-09-10T06:23:12.846203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:12.526918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.718531+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:26:17.718531+0000","last_peered":"2024-09-10T06:26:17.718531+0000","last_clean":"2024-09-10T06:26:17.718531+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:26:17.718531+0000","last_undegraded":"2024-09-10T06:26:17.718531+0000","last_fullsized":"2024-09-10T06:26:17.718531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:52.569579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":353,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.390485+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:26:17.390485+0000","last_peered":"2024-09-10T06:26:17.390485+0000","last_clean":"2024-09-10T06:26:17.390485+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:26:17.390485+0000","last_undegraded":"2024-09-10T06:26:17.390485+0000","last_fullsized":"2024-09-10T06:26:17.390485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.631720+0000","last_change":"2024-09-10T06:26:38.631720+0000","last_active":"2024-09-10T06:26:38.631720+0000","last_peered":"2024-09-10T06:26:38.631720+0000","last_clean":"2024-09-10T06:26:38.631720+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:26:38.631720+0000","last_undegraded":"2024-09-10T06:26:38.631720+0000","last_fullsized":"2024-09-10T06:26:38.631720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.631513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:27.113368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.205009+0000","last_change":"2024-09-10T06:26:33.205009+0000","last_active":"2024-09-10T06:26:33.205009+0000","last_peered":"2024-09-10T06:26:33.205009+0000","last_clean":"2024-09-10T06:26:33.205009+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:26:33.205009+0000","last_undegraded":"2024-09-10T06:26:33.205009+0000","last_fullsized":"2024-09-10T06:26:33.205009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.204830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.417787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841000+0000","last_change":"2024-09-10T06:22:35.836376+0000","last_active":"2024-09-10T06:23:12.841000+0000","last_peered":"2024-09-10T06:23:12.841000+0000","last_clean":"2024-09-10T06:23:12.841000+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:23:12.841000+0000","last_undegraded":"2024-09-10T06:23:12.841000+0000","last_fullsized":"2024-09-10T06:23:12.841000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:11.310423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.558480+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:26:17.558480+0000","last_peered":"2024-09-10T06:26:17.558480+0000","last_clean":"2024-09-10T06:26:17.558480+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:26:17.558480+0000","last_undegraded":"2024-09-10T06:26:17.558480+0000","last_fullsized":"2024-09-10T06:26:17.558480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:32.138442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850212+0000","last_change":"2024-09-10T06:22:33.827668+0000","last_active":"2024-09-10T06:24:47.850212+0000","last_peered":"2024-09-10T06:24:47.850212+0000","last_clean":"2024-09-10T06:24:47.850212+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:24:47.850212+0000","last_undegraded":"2024-09-10T06:24:47.850212+0000","last_fullsized":"2024-09-10T06:24:47.850212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:10.516267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.091180+0000","last_change":"2024-09-10T06:26:23.091180+0000","last_active":"2024-09-10T06:26:23.091180+0000","last_peered":"2024-09-10T06:26:23.091180+0000","last_clean":"2024-09-10T06:26:23.091180+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:26:23.091180+0000","last_undegraded":"2024-09-10T06:26:23.091180+0000","last_fullsized":"2024-09-10T06:26:23.091180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.091001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:02.894224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848722+0000","last_change":"2024-09-10T06:22:35.830686+0000","last_active":"2024-09-10T06:23:12.848722+0000","last_peered":"2024-09-10T06:23:12.848722+0000","last_clean":"2024-09-10T06:23:12.848722+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:23:12.848722+0000","last_undegraded":"2024-09-10T06:23:12.848722+0000","last_fullsized":"2024-09-10T06:23:12.848722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.566639+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:26:17.566639+0000","last_peered":"2024-09-10T06:26:17.566639+0000","last_clean":"2024-09-10T06:26:17.566639+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:26:17.566639+0000","last_undegraded":"2024-09-10T06:26:17.566639+0000","last_fullsized":"2024-09-10T06:26:17.566639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856817+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:24:43.856817+0000","last_peered":"2024-09-10T06:24:43.856817+0000","last_clean":"2024-09-10T06:24:43.856817+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:24:43.856817+0000","last_undegraded":"2024-09-10T06:24:43.856817+0000","last_fullsized":"2024-09-10T06:24:43.856817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:00.243049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.485815+0000","last_change":"2024-09-10T06:22:33.836732+0000","last_active":"2024-09-10T06:25:46.485815+0000","last_peered":"2024-09-10T06:25:46.485815+0000","last_clean":"2024-09-10T06:25:46.485815+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:25:46.485815+0000","last_undegraded":"2024-09-10T06:25:46.485815+0000","last_fullsized":"2024-09-10T06:25:46.485815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:58.953149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.180956+0000","last_change":"2024-09-10T06:26:32.180956+0000","last_active":"2024-09-10T06:26:32.180956+0000","last_peered":"2024-09-10T06:26:32.180956+0000","last_clean":"2024-09-10T06:26:32.180956+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:26:32.180956+0000","last_undegraded":"2024-09-10T06:26:32.180956+0000","last_fullsized":"2024-09-10T06:26:32.180956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.180772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:44.519421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844174+0000","last_change":"2024-09-10T06:22:35.836278+0000","last_active":"2024-09-10T06:23:12.844174+0000","last_peered":"2024-09-10T06:23:12.844174+0000","last_clean":"2024-09-10T06:23:12.844174+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:23:12.844174+0000","last_undegraded":"2024-09-10T06:23:12.844174+0000","last_fullsized":"2024-09-10T06:23:12.844174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:25.749044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.513879+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:26:17.513879+0000","last_peered":"2024-09-10T06:26:17.513879+0000","last_clean":"2024-09-10T06:26:17.513879+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:26:17.513879+0000","last_undegraded":"2024-09-10T06:26:17.513879+0000","last_fullsized":"2024-09-10T06:26:17.513879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.380679+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:26:17.380679+0000","last_peered":"2024-09-10T06:26:17.380679+0000","last_clean":"2024-09-10T06:26:17.380679+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:26:17.380679+0000","last_undegraded":"2024-09-10T06:26:17.380679+0000","last_fullsized":"2024-09-10T06:26:17.380679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.844984+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:24:47.844984+0000","last_peered":"2024-09-10T06:24:47.844984+0000","last_clean":"2024-09-10T06:24:47.844984+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:24:47.844984+0000","last_undegraded":"2024-09-10T06:24:47.844984+0000","last_fullsized":"2024-09-10T06:24:47.844984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:41.565616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.030221+0000","last_change":"2024-09-10T06:22:33.844698+0000","last_active":"2024-09-10T06:25:46.030221+0000","last_peered":"2024-09-10T06:25:46.030221+0000","last_clean":"2024-09-10T06:25:46.030221+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:25:46.030221+0000","last_undegraded":"2024-09-10T06:25:46.030221+0000","last_fullsized":"2024-09-10T06:25:46.030221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:46.069087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.226136+0000","last_change":"2024-09-10T06:26:31.226136+0000","last_active":"2024-09-10T06:26:31.226136+0000","last_peered":"2024-09-10T06:26:31.226136+0000","last_clean":"2024-09-10T06:26:31.226136+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:26:31.226136+0000","last_undegraded":"2024-09-10T06:26:31.226136+0000","last_fullsized":"2024-09-10T06:26:31.226136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.225929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.353328+0000","last_change":"2024-09-10T06:22:35.832300+0000","last_active":"2024-09-10T06:26:17.353328+0000","last_peered":"2024-09-10T06:26:17.353328+0000","last_clean":"2024-09-10T06:26:17.353328+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:17.353328+0000","last_undegraded":"2024-09-10T06:26:17.353328+0000","last_fullsized":"2024-09-10T06:26:17.353328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:47.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.383675+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:26:17.383675+0000","last_peered":"2024-09-10T06:26:17.383675+0000","last_clean":"2024-09-10T06:26:17.383675+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:26:17.383675+0000","last_undegraded":"2024-09-10T06:26:17.383675+0000","last_fullsized":"2024-09-10T06:26:17.383675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.871524+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:44.871524+0000","last_peered":"2024-09-10T06:24:44.871524+0000","last_clean":"2024-09-10T06:24:44.871524+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:44.871524+0000","last_undegraded":"2024-09-10T06:24:44.871524+0000","last_fullsized":"2024-09-10T06:24:44.871524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:02.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850321+0000","last_change":"2024-09-10T06:22:33.827862+0000","last_active":"2024-09-10T06:24:47.850321+0000","last_peered":"2024-09-10T06:24:47.850321+0000","last_clean":"2024-09-10T06:24:47.850321+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:24:47.850321+0000","last_undegraded":"2024-09-10T06:24:47.850321+0000","last_fullsized":"2024-09-10T06:24:47.850321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:49.916726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.162880+0000","last_change":"2024-09-10T06:26:29.162880+0000","last_active":"2024-09-10T06:26:29.162880+0000","last_peered":"2024-09-10T06:26:29.162880+0000","last_clean":"2024-09-10T06:26:29.162880+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:26:29.162880+0000","last_undegraded":"2024-09-10T06:26:29.162880+0000","last_fullsized":"2024-09-10T06:26:29.162880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.162701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:58.415388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.677114+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:26:17.677114+0000","last_peered":"2024-09-10T06:26:17.677114+0000","last_clean":"2024-09-10T06:26:17.677114+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:26:17.677114+0000","last_undegraded":"2024-09-10T06:26:17.677114+0000","last_fullsized":"2024-09-10T06:26:17.677114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.454158+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.454158+0000","last_peered":"2024-09-10T06:25:46.454158+0000","last_clean":"2024-09-10T06:25:46.454158+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.454158+0000","last_undegraded":"2024-09-10T06:25:46.454158+0000","last_fullsized":"2024-09-10T06:25:46.454158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:28.534619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.085306+0000","last_change":"2024-09-10T06:22:33.830097+0000","last_active":"2024-09-10T06:24:41.085306+0000","last_peered":"2024-09-10T06:24:41.085306+0000","last_clean":"2024-09-10T06:24:41.085306+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:24:41.085306+0000","last_undegraded":"2024-09-10T06:24:41.085306+0000","last_fullsized":"2024-09-10T06:24:41.085306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:04.520654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.430887+0000","last_change":"2024-09-10T06:26:21.430739+0000","last_active":"2024-09-10T06:26:21.430887+0000","last_peered":"2024-09-10T06:26:21.430887+0000","last_clean":"2024-09-10T06:26:21.430887+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:26:21.430887+0000","last_undegraded":"2024-09-10T06:26:21.430887+0000","last_fullsized":"2024-09-10T06:26:21.430887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.430530+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.906584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.133425+0000","last_change":"2024-09-10T06:26:25.133287+0000","last_active":"2024-09-10T06:26:25.133425+0000","last_peered":"2024-09-10T06:26:25.133425+0000","last_clean":"2024-09-10T06:26:25.133425+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:26:25.133425+0000","last_undegraded":"2024-09-10T06:26:25.133425+0000","last_fullsized":"2024-09-10T06:26:25.133425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.133112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:31.494004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.114356+0000","last_change":"2024-09-10T06:26:27.114356+0000","last_active":"2024-09-10T06:26:27.114356+0000","last_peered":"2024-09-10T06:26:27.114356+0000","last_clean":"2024-09-10T06:26:27.114356+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:26:27.114356+0000","last_undegraded":"2024-09-10T06:26:27.114356+0000","last_fullsized":"2024-09-10T06:26:27.114356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.114182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:12.450302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.855163+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:23:12.855163+0000","last_peered":"2024-09-10T06:23:12.855163+0000","last_clean":"2024-09-10T06:23:12.855163+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:23:12.855163+0000","last_undegraded":"2024-09-10T06:23:12.855163+0000","last_fullsized":"2024-09-10T06:23:12.855163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:11.965730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.694409+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:26:17.694409+0000","last_peered":"2024-09-10T06:26:17.694409+0000","last_clean":"2024-09-10T06:26:17.694409+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:26:17.694409+0000","last_undegraded":"2024-09-10T06:26:17.694409+0000","last_fullsized":"2024-09-10T06:26:17.694409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:21.725012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315520+0000","last_change":"2024-09-10T06:22:33.814130+0000","last_active":"2024-09-10T06:25:46.315520+0000","last_peered":"2024-09-10T06:25:46.315520+0000","last_clean":"2024-09-10T06:25:46.315520+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:25:46.315520+0000","last_undegraded":"2024-09-10T06:25:46.315520+0000","last_fullsized":"2024-09-10T06:25:46.315520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:11.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.062353+0000","last_change":"2024-09-10T06:26:23.062225+0000","last_active":"2024-09-10T06:26:23.062353+0000","last_peered":"2024-09-10T06:26:23.062353+0000","last_clean":"2024-09-10T06:26:23.062353+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:26:23.062353+0000","last_undegraded":"2024-09-10T06:26:23.062353+0000","last_fullsized":"2024-09-10T06:26:23.062353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.062051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:53.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.133378+0000","last_change":"2024-09-10T06:26:27.133378+0000","last_active":"2024-09-10T06:26:27.133378+0000","last_peered":"2024-09-10T06:26:27.133378+0000","last_clean":"2024-09-10T06:26:27.133378+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:26:27.133378+0000","last_undegraded":"2024-09-10T06:26:27.133378+0000","last_fullsized":"2024-09-10T06:26:27.133378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.133202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.725768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854443+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:23:12.854443+0000","last_peered":"2024-09-10T06:23:12.854443+0000","last_clean":"2024-09-10T06:23:12.854443+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:23:12.854443+0000","last_undegraded":"2024-09-10T06:23:12.854443+0000","last_fullsized":"2024-09-10T06:23:12.854443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:04.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":503,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.688710+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:26:17.688710+0000","last_peered":"2024-09-10T06:26:17.688710+0000","last_clean":"2024-09-10T06:26:17.688710+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:26:17.688710+0000","last_undegraded":"2024-09-10T06:26:17.688710+0000","last_fullsized":"2024-09-10T06:26:17.688710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:21.390056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838597+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:23:12.838597+0000","last_peered":"2024-09-10T06:23:12.838597+0000","last_clean":"2024-09-10T06:23:12.838597+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:23:12.838597+0000","last_undegraded":"2024-09-10T06:23:12.838597+0000","last_fullsized":"2024-09-10T06:23:12.838597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:35.775780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.379659+0000","last_change":"2024-09-10T06:22:33.830304+0000","last_active":"2024-09-10T06:25:46.379659+0000","last_peered":"2024-09-10T06:25:46.379659+0000","last_clean":"2024-09-10T06:25:46.379659+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:25:46.379659+0000","last_undegraded":"2024-09-10T06:25:46.379659+0000","last_fullsized":"2024-09-10T06:25:46.379659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:22.266418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.534176+0000","last_change":"2024-09-10T06:26:22.533999+0000","last_active":"2024-09-10T06:26:22.534176+0000","last_peered":"2024-09-10T06:26:22.534176+0000","last_clean":"2024-09-10T06:26:22.534176+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:26:22.534176+0000","last_undegraded":"2024-09-10T06:26:22.534176+0000","last_fullsized":"2024-09-10T06:26:22.534176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.533815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:40.223076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.986222+0000","last_change":"2024-09-10T06:26:32.986222+0000","last_active":"2024-09-10T06:26:32.986222+0000","last_peered":"2024-09-10T06:26:32.986222+0000","last_clean":"2024-09-10T06:26:32.986222+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:26:32.986222+0000","last_undegraded":"2024-09-10T06:26:32.986222+0000","last_fullsized":"2024-09-10T06:26:32.986222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.986038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:36.552236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851204+0000","last_change":"2024-09-10T06:22:35.819965+0000","last_active":"2024-09-10T06:23:12.851204+0000","last_peered":"2024-09-10T06:23:12.851204+0000","last_clean":"2024-09-10T06:23:12.851204+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:23:12.851204+0000","last_undegraded":"2024-09-10T06:23:12.851204+0000","last_fullsized":"2024-09-10T06:23:12.851204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:59.563244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'17","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.073073+0000","last_change":"2024-09-10T06:22:37.837514+0000","last_active":"2024-09-10T06:25:46.073073+0000","last_peered":"2024-09-10T06:25:46.073073+0000","last_clean":"2024-09-10T06:25:46.073073+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:25:46.073073+0000","last_undegraded":"2024-09-10T06:25:46.073073+0000","last_fullsized":"2024-09-10T06:25:46.073073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:10.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841192+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:23:12.841192+0000","last_peered":"2024-09-10T06:23:12.841192+0000","last_clean":"2024-09-10T06:23:12.841192+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:23:12.841192+0000","last_undegraded":"2024-09-10T06:23:12.841192+0000","last_fullsized":"2024-09-10T06:23:12.841192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:59.799041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.937768+0000","last_change":"2024-09-10T06:26:35.937768+0000","last_active":"2024-09-10T06:26:35.937768+0000","last_peered":"2024-09-10T06:26:35.937768+0000","last_clean":"2024-09-10T06:26:35.937768+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:26:35.937768+0000","last_undegraded":"2024-09-10T06:26:35.937768+0000","last_fullsized":"2024-09-10T06:26:35.937768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.937562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:19.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.110596+0000","last_change":"2024-09-10T06:26:24.110300+0000","last_active":"2024-09-10T06:26:24.110596+0000","last_peered":"2024-09-10T06:26:24.110596+0000","last_clean":"2024-09-10T06:26:24.110596+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:26:24.110596+0000","last_undegraded":"2024-09-10T06:26:24.110596+0000","last_fullsized":"2024-09-10T06:26:24.110596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.110079+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:06.285600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.521588+0000","last_change":"2024-09-10T06:26:23.521588+0000","last_active":"2024-09-10T06:26:23.521588+0000","last_peered":"2024-09-10T06:26:23.521588+0000","last_clean":"2024-09-10T06:26:23.521588+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:26:23.521588+0000","last_undegraded":"2024-09-10T06:26:23.521588+0000","last_fullsized":"2024-09-10T06:26:23.521588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.521400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844120+0000","last_change":"2024-09-10T06:22:35.817207+0000","last_active":"2024-09-10T06:23:12.844120+0000","last_peered":"2024-09-10T06:23:12.844120+0000","last_clean":"2024-09-10T06:23:12.844120+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:23:12.844120+0000","last_undegraded":"2024-09-10T06:23:12.844120+0000","last_fullsized":"2024-09-10T06:23:12.844120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:40.404405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.319710+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.319710+0000","last_peered":"2024-09-10T06:25:45.319710+0000","last_clean":"2024-09-10T06:25:45.319710+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.319710+0000","last_undegraded":"2024-09-10T06:25:45.319710+0000","last_fullsized":"2024-09-10T06:25:45.319710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:52.179158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.689163+0000","last_change":"2024-09-10T06:26:35.689163+0000","last_active":"2024-09-10T06:26:35.689163+0000","last_peered":"2024-09-10T06:26:35.689163+0000","last_clean":"2024-09-10T06:26:35.689163+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:26:35.689163+0000","last_undegraded":"2024-09-10T06:26:35.689163+0000","last_fullsized":"2024-09-10T06:26:35.689163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.688987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:31.604105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.490106+0000","last_change":"2024-09-10T06:26:24.490106+0000","last_active":"2024-09-10T06:26:24.490106+0000","last_peered":"2024-09-10T06:26:24.490106+0000","last_clean":"2024-09-10T06:26:24.490106+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:26:24.490106+0000","last_undegraded":"2024-09-10T06:26:24.490106+0000","last_fullsized":"2024-09-10T06:26:24.490106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.489901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:12.908340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.051982+0000","last_change":"2024-09-10T06:26:22.051863+0000","last_active":"2024-09-10T06:26:22.051982+0000","last_peered":"2024-09-10T06:26:22.051982+0000","last_clean":"2024-09-10T06:26:22.051982+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:26:22.051982+0000","last_undegraded":"2024-09-10T06:26:22.051982+0000","last_fullsized":"2024-09-10T06:26:22.051982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.051670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:16.319555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.582239+0000","last_change":"2024-09-10T06:22:35.823185+0000","last_active":"2024-09-10T06:25:46.582239+0000","last_peered":"2024-09-10T06:25:46.582239+0000","last_clean":"2024-09-10T06:25:46.582239+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:25:46.582239+0000","last_undegraded":"2024-09-10T06:25:46.582239+0000","last_fullsized":"2024-09-10T06:25:46.582239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:31.666424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'69","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.633622+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:26:17.633622+0000","last_peered":"2024-09-10T06:26:17.633622+0000","last_clean":"2024-09-10T06:26:17.633622+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:17.633622+0000","last_undegraded":"2024-09-10T06:26:17.633622+0000","last_fullsized":"2024-09-10T06:26:17.633622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843741+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:23:12.843741+0000","last_peered":"2024-09-10T06:23:12.843741+0000","last_clean":"2024-09-10T06:23:12.843741+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:23:12.843741+0000","last_undegraded":"2024-09-10T06:23:12.843741+0000","last_fullsized":"2024-09-10T06:23:12.843741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:07.724283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.722846+0000","last_change":"2024-09-10T06:26:36.722846+0000","last_active":"2024-09-10T06:26:36.722846+0000","last_peered":"2024-09-10T06:26:36.722846+0000","last_clean":"2024-09-10T06:26:36.722846+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:26:36.722846+0000","last_undegraded":"2024-09-10T06:26:36.722846+0000","last_fullsized":"2024-09-10T06:26:36.722846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.722678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:48.489772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.119665+0000","last_change":"2024-09-10T06:26:26.119665+0000","last_active":"2024-09-10T06:26:26.119665+0000","last_peered":"2024-09-10T06:26:26.119665+0000","last_clean":"2024-09-10T06:26:26.119665+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:26:26.119665+0000","last_undegraded":"2024-09-10T06:26:26.119665+0000","last_fullsized":"2024-09-10T06:26:26.119665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.119470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:37.159096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.160188+0000","last_change":"2024-09-10T06:26:26.160035+0000","last_active":"2024-09-10T06:26:26.160188+0000","last_peered":"2024-09-10T06:26:26.160188+0000","last_clean":"2024-09-10T06:26:26.160188+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:26:26.160188+0000","last_undegraded":"2024-09-10T06:26:26.160188+0000","last_fullsized":"2024-09-10T06:26:26.160188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.159855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:31.433358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.341015+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:26:17.341015+0000","last_peered":"2024-09-10T06:26:17.341015+0000","last_clean":"2024-09-10T06:26:17.341015+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:26:17.341015+0000","last_undegraded":"2024-09-10T06:26:17.341015+0000","last_fullsized":"2024-09-10T06:26:17.341015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:58.162966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.404578+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:23:16.404578+0000","last_peered":"2024-09-10T06:23:16.404578+0000","last_clean":"2024-09-10T06:23:16.404578+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:23:16.404578+0000","last_undegraded":"2024-09-10T06:23:16.404578+0000","last_fullsized":"2024-09-10T06:23:16.404578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.073693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.377858+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:26:17.377858+0000","last_peered":"2024-09-10T06:26:17.377858+0000","last_clean":"2024-09-10T06:26:17.377858+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:26:17.377858+0000","last_undegraded":"2024-09-10T06:26:17.377858+0000","last_fullsized":"2024-09-10T06:26:17.377858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:43.131319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.249439+0000","last_change":"2024-09-10T06:22:33.835195+0000","last_active":"2024-09-10T06:25:46.249439+0000","last_peered":"2024-09-10T06:25:46.249439+0000","last_clean":"2024-09-10T06:25:46.249439+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:25:46.249439+0000","last_undegraded":"2024-09-10T06:25:46.249439+0000","last_fullsized":"2024-09-10T06:25:46.249439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.188003+0000","last_change":"2024-09-10T06:26:30.188003+0000","last_active":"2024-09-10T06:26:30.188003+0000","last_peered":"2024-09-10T06:26:30.188003+0000","last_clean":"2024-09-10T06:26:30.188003+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:26:30.188003+0000","last_undegraded":"2024-09-10T06:26:30.188003+0000","last_fullsized":"2024-09-10T06:26:30.188003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.187831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:12.704769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.007725+0000","last_change":"2024-09-10T06:26:21.007725+0000","last_active":"2024-09-10T06:26:21.007725+0000","last_peered":"2024-09-10T06:26:21.007725+0000","last_clean":"2024-09-10T06:26:21.007725+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:26:21.007725+0000","last_undegraded":"2024-09-10T06:26:21.007725+0000","last_fullsized":"2024-09-10T06:26:21.007725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.007653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:45.011060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844884+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:23:12.844884+0000","last_peered":"2024-09-10T06:23:12.844884+0000","last_clean":"2024-09-10T06:23:12.844884+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:23:12.844884+0000","last_undegraded":"2024-09-10T06:23:12.844884+0000","last_fullsized":"2024-09-10T06:23:12.844884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.465248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856935+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:24:43.856935+0000","last_peered":"2024-09-10T06:24:43.856935+0000","last_clean":"2024-09-10T06:24:43.856935+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:24:43.856935+0000","last_undegraded":"2024-09-10T06:24:43.856935+0000","last_fullsized":"2024-09-10T06:24:43.856935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:00.801970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":434,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.385841+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:26:17.385841+0000","last_peered":"2024-09-10T06:26:17.385841+0000","last_clean":"2024-09-10T06:26:17.385841+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:26:17.385841+0000","last_undegraded":"2024-09-10T06:26:17.385841+0000","last_fullsized":"2024-09-10T06:26:17.385841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:05.123690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.501999+0000","last_change":"2024-09-10T06:26:35.501999+0000","last_active":"2024-09-10T06:26:35.501999+0000","last_peered":"2024-09-10T06:26:35.501999+0000","last_clean":"2024-09-10T06:26:35.501999+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:26:35.501999+0000","last_undegraded":"2024-09-10T06:26:35.501999+0000","last_fullsized":"2024-09-10T06:26:35.501999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.501822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:29.856717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.433192+0000","last_change":"2024-09-10T06:26:22.433192+0000","last_active":"2024-09-10T06:26:22.433192+0000","last_peered":"2024-09-10T06:26:22.433192+0000","last_clean":"2024-09-10T06:26:22.433192+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:26:22.433192+0000","last_undegraded":"2024-09-10T06:26:22.433192+0000","last_fullsized":"2024-09-10T06:26:22.433192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.433009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.297315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.163027+0000","last_change":"2024-09-10T06:26:28.163027+0000","last_active":"2024-09-10T06:26:28.163027+0000","last_peered":"2024-09-10T06:26:28.163027+0000","last_clean":"2024-09-10T06:26:28.163027+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:26:28.163027+0000","last_undegraded":"2024-09-10T06:26:28.163027+0000","last_fullsized":"2024-09-10T06:26:28.163027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.162858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:23.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.855842+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:24:38.855842+0000","last_peered":"2024-09-10T06:24:38.855842+0000","last_clean":"2024-09-10T06:24:38.855842+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:24:38.855842+0000","last_undegraded":"2024-09-10T06:24:38.855842+0000","last_fullsized":"2024-09-10T06:24:38.855842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.659703+0000","last_change":"2024-09-10T06:22:37.855099+0000","last_active":"2024-09-10T06:26:17.659703+0000","last_peered":"2024-09-10T06:26:17.659703+0000","last_clean":"2024-09-10T06:26:17.659703+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:17.659703+0000","last_undegraded":"2024-09-10T06:26:17.659703+0000","last_fullsized":"2024-09-10T06:26:17.659703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:05.079013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839680+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:23:12.839680+0000","last_peered":"2024-09-10T06:23:12.839680+0000","last_clean":"2024-09-10T06:23:12.839680+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:23:12.839680+0000","last_undegraded":"2024-09-10T06:23:12.839680+0000","last_fullsized":"2024-09-10T06:23:12.839680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:00.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851696+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:23:12.851696+0000","last_peered":"2024-09-10T06:23:12.851696+0000","last_clean":"2024-09-10T06:23:12.851696+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:23:12.851696+0000","last_undegraded":"2024-09-10T06:23:12.851696+0000","last_fullsized":"2024-09-10T06:23:12.851696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:18.366509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848875+0000","last_change":"2024-09-10T06:22:33.835614+0000","last_active":"2024-09-10T06:23:16.848875+0000","last_peered":"2024-09-10T06:23:16.848875+0000","last_clean":"2024-09-10T06:23:16.848875+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:23:16.848875+0000","last_undegraded":"2024-09-10T06:23:16.848875+0000","last_fullsized":"2024-09-10T06:23:16.848875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:36.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.306783+0000","last_change":"2024-09-10T06:26:37.306783+0000","last_active":"2024-09-10T06:26:37.306783+0000","last_peered":"2024-09-10T06:26:37.306783+0000","last_clean":"2024-09-10T06:26:37.306783+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:26:37.306783+0000","last_undegraded":"2024-09-10T06:26:37.306783+0000","last_fullsized":"2024-09-10T06:26:37.306783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.306607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:41.035747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842492+0000","last_change":"2024-09-10T06:22:35.832868+0000","last_active":"2024-09-10T06:23:12.842492+0000","last_peered":"2024-09-10T06:23:12.842492+0000","last_clean":"2024-09-10T06:23:12.842492+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:23:12.842492+0000","last_undegraded":"2024-09-10T06:23:12.842492+0000","last_fullsized":"2024-09-10T06:23:12.842492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:22:51.259863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.710326+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:26:17.710326+0000","last_peered":"2024-09-10T06:26:17.710326+0000","last_clean":"2024-09-10T06:26:17.710326+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:26:17.710326+0000","last_undegraded":"2024-09-10T06:26:17.710326+0000","last_fullsized":"2024-09-10T06:26:17.710326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.872559+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.872559+0000","last_peered":"2024-09-10T06:24:42.872559+0000","last_clean":"2024-09-10T06:24:42.872559+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.872559+0000","last_undegraded":"2024-09-10T06:24:42.872559+0000","last_fullsized":"2024-09-10T06:24:42.872559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:14.600789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851337+0000","last_change":"2024-09-10T06:22:33.828670+0000","last_active":"2024-09-10T06:24:52.851337+0000","last_peered":"2024-09-10T06:24:52.851337+0000","last_clean":"2024-09-10T06:24:52.851337+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:24:52.851337+0000","last_undegraded":"2024-09-10T06:24:52.851337+0000","last_fullsized":"2024-09-10T06:24:52.851337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.467698+0000","last_change":"2024-09-10T06:26:27.467698+0000","last_active":"2024-09-10T06:26:27.467698+0000","last_peered":"2024-09-10T06:26:27.467698+0000","last_clean":"2024-09-10T06:26:27.467698+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:26:27.467698+0000","last_undegraded":"2024-09-10T06:26:27.467698+0000","last_fullsized":"2024-09-10T06:26:27.467698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.467505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:10.628970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427517+0000","last_change":"2024-09-10T06:22:33.817684+0000","last_active":"2024-09-10T06:24:00.427517+0000","last_peered":"2024-09-10T06:24:00.427517+0000","last_clean":"2024-09-10T06:24:00.427517+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:24:00.427517+0000","last_undegraded":"2024-09-10T06:24:00.427517+0000","last_fullsized":"2024-09-10T06:24:00.427517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:27.268639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.412608+0000","last_change":"2024-09-10T06:26:30.412608+0000","last_active":"2024-09-10T06:26:30.412608+0000","last_peered":"2024-09-10T06:26:30.412608+0000","last_clean":"2024-09-10T06:26:30.412608+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:26:30.412608+0000","last_undegraded":"2024-09-10T06:26:30.412608+0000","last_fullsized":"2024-09-10T06:26:30.412608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.412443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:27.375871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839169+0000","last_change":"2024-09-10T06:22:35.831394+0000","last_active":"2024-09-10T06:23:12.839169+0000","last_peered":"2024-09-10T06:23:12.839169+0000","last_clean":"2024-09-10T06:23:12.839169+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:23:12.839169+0000","last_undegraded":"2024-09-10T06:23:12.839169+0000","last_fullsized":"2024-09-10T06:23:12.839169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:22.172849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.610259+0000","last_change":"2024-09-10T06:22:37.836553+0000","last_active":"2024-09-10T06:26:17.610259+0000","last_peered":"2024-09-10T06:26:17.610259+0000","last_clean":"2024-09-10T06:26:17.610259+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:17.610259+0000","last_undegraded":"2024-09-10T06:26:17.610259+0000","last_fullsized":"2024-09-10T06:26:17.610259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:24.462240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226226+0000","last_change":"2024-09-10T06:22:33.837182+0000","last_active":"2024-09-10T06:25:46.226226+0000","last_peered":"2024-09-10T06:25:46.226226+0000","last_clean":"2024-09-10T06:25:46.226226+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:25:46.226226+0000","last_undegraded":"2024-09-10T06:25:46.226226+0000","last_fullsized":"2024-09-10T06:25:46.226226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:14.784269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.483285+0000","last_change":"2024-09-10T06:26:24.483285+0000","last_active":"2024-09-10T06:26:24.483285+0000","last_peered":"2024-09-10T06:26:24.483285+0000","last_clean":"2024-09-10T06:26:24.483285+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:26:24.483285+0000","last_undegraded":"2024-09-10T06:26:24.483285+0000","last_fullsized":"2024-09-10T06:26:24.483285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.483039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:30.019052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.584254+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:26:17.584254+0000","last_peered":"2024-09-10T06:26:17.584254+0000","last_clean":"2024-09-10T06:26:17.584254+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:26:17.584254+0000","last_undegraded":"2024-09-10T06:26:17.584254+0000","last_fullsized":"2024-09-10T06:26:17.584254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.156644+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:00.156644+0000","last_peered":"2024-09-10T06:24:00.156644+0000","last_clean":"2024-09-10T06:24:00.156644+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:00.156644+0000","last_undegraded":"2024-09-10T06:24:00.156644+0000","last_fullsized":"2024-09-10T06:24:00.156644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:18.678529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.321035+0000","last_change":"2024-09-10T06:26:38.321035+0000","last_active":"2024-09-10T06:26:38.321035+0000","last_peered":"2024-09-10T06:26:38.321035+0000","last_clean":"2024-09-10T06:26:38.321035+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:26:38.321035+0000","last_undegraded":"2024-09-10T06:26:38.321035+0000","last_fullsized":"2024-09-10T06:26:38.321035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.320842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:44.932697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:37.842857+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:24:37.842857+0000","last_peered":"2024-09-10T06:24:37.842857+0000","last_clean":"2024-09-10T06:24:37.842857+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:24:37.842857+0000","last_undegraded":"2024-09-10T06:24:37.842857+0000","last_fullsized":"2024-09-10T06:24:37.842857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'60","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.574533+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:26:17.574533+0000","last_peered":"2024-09-10T06:26:17.574533+0000","last_clean":"2024-09-10T06:26:17.574533+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:17.574533+0000","last_undegraded":"2024-09-10T06:26:17.574533+0000","last_fullsized":"2024-09-10T06:26:17.574533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.985592+0000","last_change":"2024-09-10T06:26:33.985592+0000","last_active":"2024-09-10T06:26:33.985592+0000","last_peered":"2024-09-10T06:26:33.985592+0000","last_clean":"2024-09-10T06:26:33.985592+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:26:33.985592+0000","last_undegraded":"2024-09-10T06:26:33.985592+0000","last_fullsized":"2024-09-10T06:26:33.985592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.985394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.488251+0000","last_change":"2024-09-10T06:26:25.488251+0000","last_active":"2024-09-10T06:26:25.488251+0000","last_peered":"2024-09-10T06:26:25.488251+0000","last_clean":"2024-09-10T06:26:25.488251+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:26:25.488251+0000","last_undegraded":"2024-09-10T06:26:25.488251+0000","last_fullsized":"2024-09-10T06:26:25.488251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.488065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:13.168721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'4","reported_seq":229,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.339747+0000","last_change":"2024-09-10T06:22:35.819614+0000","last_active":"2024-09-10T06:26:17.339747+0000","last_peered":"2024-09-10T06:26:17.339747+0000","last_clean":"2024-09-10T06:26:17.339747+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:17.339747+0000","last_undegraded":"2024-09-10T06:26:17.339747+0000","last_fullsized":"2024-09-10T06:26:17.339747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.909257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.592680+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:26:17.592680+0000","last_peered":"2024-09-10T06:26:17.592680+0000","last_clean":"2024-09-10T06:26:17.592680+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:26:17.592680+0000","last_undegraded":"2024-09-10T06:26:17.592680+0000","last_fullsized":"2024-09-10T06:26:17.592680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.472997+0000","last_change":"2024-09-10T06:26:26.472997+0000","last_active":"2024-09-10T06:26:26.472997+0000","last_peered":"2024-09-10T06:26:26.472997+0000","last_clean":"2024-09-10T06:26:26.472997+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:26:26.472997+0000","last_undegraded":"2024-09-10T06:26:26.472997+0000","last_fullsized":"2024-09-10T06:26:26.472997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.472822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:54.495647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849600+0000","last_change":"2024-09-10T06:22:35.823165+0000","last_active":"2024-09-10T06:23:12.849600+0000","last_peered":"2024-09-10T06:23:12.849600+0000","last_clean":"2024-09-10T06:23:12.849600+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:23:12.849600+0000","last_undegraded":"2024-09-10T06:23:12.849600+0000","last_fullsized":"2024-09-10T06:23:12.849600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:33.329366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'36","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.469751+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:26:17.469751+0000","last_peered":"2024-09-10T06:26:17.469751+0000","last_clean":"2024-09-10T06:26:17.469751+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:17.469751+0000","last_undegraded":"2024-09-10T06:26:17.469751+0000","last_fullsized":"2024-09-10T06:26:17.469751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:01.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840875+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:23:12.840875+0000","last_peered":"2024-09-10T06:23:12.840875+0000","last_clean":"2024-09-10T06:23:12.840875+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:23:12.840875+0000","last_undegraded":"2024-09-10T06:23:12.840875+0000","last_fullsized":"2024-09-10T06:23:12.840875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:38.216965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.103075+0000","last_change":"2024-09-10T06:22:33.843181+0000","last_active":"2024-09-10T06:24:41.103075+0000","last_peered":"2024-09-10T06:24:41.103075+0000","last_clean":"2024-09-10T06:24:41.103075+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:24:41.103075+0000","last_undegraded":"2024-09-10T06:24:41.103075+0000","last_fullsized":"2024-09-10T06:24:41.103075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:31.012835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.994437+0000","last_change":"2024-09-10T06:22:31.819223+0000","last_active":"2024-09-10T06:24:44.994437+0000","last_peered":"2024-09-10T06:24:44.994437+0000","last_clean":"2024-09-10T06:24:44.994437+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:24:44.994437+0000","last_undegraded":"2024-09-10T06:24:44.994437+0000","last_fullsized":"2024-09-10T06:24:44.994437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:27.515537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856277+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:24:38.856277+0000","last_peered":"2024-09-10T06:24:38.856277+0000","last_clean":"2024-09-10T06:24:38.856277+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:24:38.856277+0000","last_undegraded":"2024-09-10T06:24:38.856277+0000","last_fullsized":"2024-09-10T06:24:38.856277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.374401+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:26:17.374401+0000","last_peered":"2024-09-10T06:26:17.374401+0000","last_clean":"2024-09-10T06:26:17.374401+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:26:17.374401+0000","last_undegraded":"2024-09-10T06:26:17.374401+0000","last_fullsized":"2024-09-10T06:26:17.374401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:40.193573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:03.877644+0000","last_change":"2024-09-10T06:22:33.840970+0000","last_active":"2024-09-10T06:25:03.877644+0000","last_peered":"2024-09-10T06:25:03.877644+0000","last_clean":"2024-09-10T06:25:03.877644+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:25:03.877644+0000","last_undegraded":"2024-09-10T06:25:03.877644+0000","last_fullsized":"2024-09-10T06:25:03.877644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:08.529180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.514686+0000","last_change":"2024-09-10T06:26:27.514686+0000","last_active":"2024-09-10T06:26:27.514686+0000","last_peered":"2024-09-10T06:26:27.514686+0000","last_clean":"2024-09-10T06:26:27.514686+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:26:27.514686+0000","last_undegraded":"2024-09-10T06:26:27.514686+0000","last_fullsized":"2024-09-10T06:26:27.514686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.514477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:51.644214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'40","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.520329+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:26:17.520329+0000","last_peered":"2024-09-10T06:26:17.520329+0000","last_clean":"2024-09-10T06:26:17.520329+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:26:17.520329+0000","last_undegraded":"2024-09-10T06:26:17.520329+0000","last_fullsized":"2024-09-10T06:26:17.520329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380753+0000","last_change":"2024-09-10T06:22:33.836076+0000","last_active":"2024-09-10T06:25:46.380753+0000","last_peered":"2024-09-10T06:25:46.380753+0000","last_clean":"2024-09-10T06:25:46.380753+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:25:46.380753+0000","last_undegraded":"2024-09-10T06:25:46.380753+0000","last_fullsized":"2024-09-10T06:25:46.380753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:36.039957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.775457+0000","last_change":"2024-09-10T06:22:31.836769+0000","last_active":"2024-09-10T06:25:45.775457+0000","last_peered":"2024-09-10T06:25:45.775457+0000","last_clean":"2024-09-10T06:25:45.775457+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:25:45.775457+0000","last_undegraded":"2024-09-10T06:25:45.775457+0000","last_fullsized":"2024-09-10T06:25:45.775457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:26.478355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850533+0000","last_change":"2024-09-10T06:22:35.826620+0000","last_active":"2024-09-10T06:23:12.850533+0000","last_peered":"2024-09-10T06:23:12.850533+0000","last_clean":"2024-09-10T06:23:12.850533+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:23:12.850533+0000","last_undegraded":"2024-09-10T06:23:12.850533+0000","last_fullsized":"2024-09-10T06:23:12.850533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:41.740450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.529209+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:26:17.529209+0000","last_peered":"2024-09-10T06:26:17.529209+0000","last_clean":"2024-09-10T06:26:17.529209+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:26:17.529209+0000","last_undegraded":"2024-09-10T06:26:17.529209+0000","last_fullsized":"2024-09-10T06:26:17.529209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.100568+0000","last_change":"2024-09-10T06:26:24.100296+0000","last_active":"2024-09-10T06:26:24.100568+0000","last_peered":"2024-09-10T06:26:24.100568+0000","last_clean":"2024-09-10T06:26:24.100568+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:26:24.100568+0000","last_undegraded":"2024-09-10T06:26:24.100568+0000","last_fullsized":"2024-09-10T06:26:24.100568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.100028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:50.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.457971+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:26:17.457971+0000","last_peered":"2024-09-10T06:26:17.457971+0000","last_clean":"2024-09-10T06:26:17.457971+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:26:17.457971+0000","last_undegraded":"2024-09-10T06:26:17.457971+0000","last_fullsized":"2024-09-10T06:26:17.457971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226520+0000","last_change":"2024-09-10T06:22:33.841332+0000","last_active":"2024-09-10T06:25:46.226520+0000","last_peered":"2024-09-10T06:25:46.226520+0000","last_clean":"2024-09-10T06:25:46.226520+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:25:46.226520+0000","last_undegraded":"2024-09-10T06:25:46.226520+0000","last_fullsized":"2024-09-10T06:25:46.226520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:29.424851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.482269+0000","last_change":"2024-09-10T06:26:28.482269+0000","last_active":"2024-09-10T06:26:28.482269+0000","last_peered":"2024-09-10T06:26:28.482269+0000","last_clean":"2024-09-10T06:26:28.482269+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:26:28.482269+0000","last_undegraded":"2024-09-10T06:26:28.482269+0000","last_fullsized":"2024-09-10T06:26:28.482269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.482098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:08.791707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.476533+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:26:17.476533+0000","last_peered":"2024-09-10T06:26:17.476533+0000","last_clean":"2024-09-10T06:26:17.476533+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:26:17.476533+0000","last_undegraded":"2024-09-10T06:26:17.476533+0000","last_fullsized":"2024-09-10T06:26:17.476533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.867864+0000","last_change":"2024-09-10T06:22:33.832724+0000","last_active":"2024-09-10T06:23:12.867864+0000","last_peered":"2024-09-10T06:23:12.867864+0000","last_clean":"2024-09-10T06:23:12.867864+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:23:12.867864+0000","last_undegraded":"2024-09-10T06:23:12.867864+0000","last_fullsized":"2024-09-10T06:23:12.867864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:20.127030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.433336+0000","last_change":"2024-09-10T06:26:29.433336+0000","last_active":"2024-09-10T06:26:29.433336+0000","last_peered":"2024-09-10T06:26:29.433336+0000","last_clean":"2024-09-10T06:26:29.433336+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:26:29.433336+0000","last_undegraded":"2024-09-10T06:26:29.433336+0000","last_fullsized":"2024-09-10T06:26:29.433336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.433088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:15.744029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.225482+0000","last_change":"2024-09-10T06:22:33.842763+0000","last_active":"2024-09-10T06:25:46.225482+0000","last_peered":"2024-09-10T06:25:46.225482+0000","last_clean":"2024-09-10T06:25:46.225482+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:25:46.225482+0000","last_undegraded":"2024-09-10T06:25:46.225482+0000","last_fullsized":"2024-09-10T06:25:46.225482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.046913+0000","last_change":"2024-09-10T06:26:29.046913+0000","last_active":"2024-09-10T06:26:29.046913+0000","last_peered":"2024-09-10T06:26:29.046913+0000","last_clean":"2024-09-10T06:26:29.046913+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:26:29.046913+0000","last_undegraded":"2024-09-10T06:26:29.046913+0000","last_fullsized":"2024-09-10T06:26:29.046913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.046701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:29.715468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380807+0000","last_change":"2024-09-10T06:23:12.866962+0000","last_active":"2024-09-10T06:25:46.380807+0000","last_peered":"2024-09-10T06:25:46.380807+0000","last_clean":"2024-09-10T06:25:46.380807+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:25:46.380807+0000","last_undegraded":"2024-09-10T06:25:46.380807+0000","last_fullsized":"2024-09-10T06:25:46.380807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.062389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.842517+0000","last_change":"2024-09-10T06:22:31.831565+0000","last_active":"2024-09-10T06:23:12.842517+0000","last_peered":"2024-09-10T06:23:12.842517+0000","last_clean":"2024-09-10T06:23:12.842517+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:23:12.842517+0000","last_undegraded":"2024-09-10T06:23:12.842517+0000","last_fullsized":"2024-09-10T06:23:12.842517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.130643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427522+0000","last_change":"2024-09-10T06:22:33.843784+0000","last_active":"2024-09-10T06:24:00.427522+0000","last_peered":"2024-09-10T06:24:00.427522+0000","last_clean":"2024-09-10T06:24:00.427522+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:24:00.427522+0000","last_undegraded":"2024-09-10T06:24:00.427522+0000","last_fullsized":"2024-09-10T06:24:00.427522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:08.793382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.079186+0000","last_change":"2024-09-10T06:26:25.079186+0000","last_active":"2024-09-10T06:26:25.079186+0000","last_peered":"2024-09-10T06:26:25.079186+0000","last_clean":"2024-09-10T06:26:25.079186+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:26:25.079186+0000","last_undegraded":"2024-09-10T06:26:25.079186+0000","last_fullsized":"2024-09-10T06:26:25.079186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.079003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:58.821283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.380014+0000","last_change":"2024-09-10T06:22:33.818286+0000","last_active":"2024-09-10T06:25:46.380014+0000","last_peered":"2024-09-10T06:25:46.380014+0000","last_clean":"2024-09-10T06:25:46.380014+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:25:46.380014+0000","last_undegraded":"2024-09-10T06:25:46.380014+0000","last_fullsized":"2024-09-10T06:25:46.380014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.995009+0000","last_change":"2024-09-10T06:26:31.995009+0000","last_active":"2024-09-10T06:26:31.995009+0000","last_peered":"2024-09-10T06:26:31.995009+0000","last_clean":"2024-09-10T06:26:31.995009+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:26:31.995009+0000","last_undegraded":"2024-09-10T06:26:31.995009+0000","last_fullsized":"2024-09-10T06:26:31.995009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.994787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:49.297894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.316095+0000","last_change":"2024-09-10T06:22:33.832194+0000","last_active":"2024-09-10T06:25:46.316095+0000","last_peered":"2024-09-10T06:25:46.316095+0000","last_clean":"2024-09-10T06:25:46.316095+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:25:46.316095+0000","last_undegraded":"2024-09-10T06:25:46.316095+0000","last_fullsized":"2024-09-10T06:25:46.316095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.497669+0000","last_change":"2024-09-10T06:26:29.497669+0000","last_active":"2024-09-10T06:26:29.497669+0000","last_peered":"2024-09-10T06:26:29.497669+0000","last_clean":"2024-09-10T06:26:29.497669+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:26:29.497669+0000","last_undegraded":"2024-09-10T06:26:29.497669+0000","last_fullsized":"2024-09-10T06:26:29.497669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.497454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:45.426363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.314627+0000","last_change":"2024-09-10T06:22:33.820714+0000","last_active":"2024-09-10T06:25:46.314627+0000","last_peered":"2024-09-10T06:25:46.314627+0000","last_clean":"2024-09-10T06:25:46.314627+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:25:46.314627+0000","last_undegraded":"2024-09-10T06:25:46.314627+0000","last_fullsized":"2024-09-10T06:25:46.314627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:18.899048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.393760+0000","last_change":"2024-09-10T06:26:31.393760+0000","last_active":"2024-09-10T06:26:31.393760+0000","last_peered":"2024-09-10T06:26:31.393760+0000","last_clean":"2024-09-10T06:26:31.393760+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:26:31.393760+0000","last_undegraded":"2024-09-10T06:26:31.393760+0000","last_fullsized":"2024-09-10T06:26:31.393760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.393581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:26.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.028535+0000","last_change":"2024-09-10T06:22:33.822155+0000","last_active":"2024-09-10T06:25:46.028535+0000","last_peered":"2024-09-10T06:25:46.028535+0000","last_clean":"2024-09-10T06:25:46.028535+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:25:46.028535+0000","last_undegraded":"2024-09-10T06:25:46.028535+0000","last_fullsized":"2024-09-10T06:25:46.028535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:52.713549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.946711+0000","last_change":"2024-09-10T06:26:34.946711+0000","last_active":"2024-09-10T06:26:34.946711+0000","last_peered":"2024-09-10T06:26:34.946711+0000","last_clean":"2024-09-10T06:26:34.946711+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:26:34.946711+0000","last_undegraded":"2024-09-10T06:26:34.946711+0000","last_fullsized":"2024-09-10T06:26:34.946711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.946534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:24.024731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'15","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851583+0000","last_change":"2024-09-10T06:22:33.844903+0000","last_active":"2024-09-10T06:24:52.851583+0000","last_peered":"2024-09-10T06:24:52.851583+0000","last_clean":"2024-09-10T06:24:52.851583+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:24:52.851583+0000","last_undegraded":"2024-09-10T06:24:52.851583+0000","last_fullsized":"2024-09-10T06:24:52.851583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:16.098280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.564147+0000","last_change":"2024-09-10T06:22:31.828487+0000","last_active":"2024-09-10T06:23:15.564147+0000","last_peered":"2024-09-10T06:23:15.564147+0000","last_clean":"2024-09-10T06:23:15.564147+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:23:15.564147+0000","last_undegraded":"2024-09-10T06:23:15.564147+0000","last_fullsized":"2024-09-10T06:23:15.564147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:47.707056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:15.563325+0000","last_change":"2024-09-10T06:22:31.813099+0000","last_active":"2024-09-10T06:23:15.563325+0000","last_peered":"2024-09-10T06:23:15.563325+0000","last_clean":"2024-09-10T06:23:15.563325+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:23:15.563325+0000","last_undegraded":"2024-09-10T06:23:15.563325+0000","last_fullsized":"2024-09-10T06:23:15.563325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:10.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.402083+0000","last_change":"2024-09-10T06:22:33.818285+0000","last_active":"2024-09-10T06:23:16.402083+0000","last_peered":"2024-09-10T06:23:16.402083+0000","last_clean":"2024-09-10T06:23:16.402083+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:23:16.402083+0000","last_undegraded":"2024-09-10T06:23:16.402083+0000","last_fullsized":"2024-09-10T06:23:16.402083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:42.507759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.509659+0000","last_change":"2024-09-10T06:26:30.509659+0000","last_active":"2024-09-10T06:26:30.509659+0000","last_peered":"2024-09-10T06:26:30.509659+0000","last_clean":"2024-09-10T06:26:30.509659+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:26:30.509659+0000","last_undegraded":"2024-09-10T06:26:30.509659+0000","last_fullsized":"2024-09-10T06:26:30.509659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.509470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:04.251749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.910497+0000","last_change":"2024-09-10T06:22:33.811540+0000","last_active":"2024-09-10T06:25:45.910497+0000","last_peered":"2024-09-10T06:25:45.910497+0000","last_clean":"2024-09-10T06:25:45.910497+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:25:45.910497+0000","last_undegraded":"2024-09-10T06:25:45.910497+0000","last_fullsized":"2024-09-10T06:25:45.910497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:40.528357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.629278+0000","last_change":"2024-09-10T06:26:33.629278+0000","last_active":"2024-09-10T06:26:33.629278+0000","last_peered":"2024-09-10T06:26:33.629278+0000","last_clean":"2024-09-10T06:26:33.629278+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:26:33.629278+0000","last_undegraded":"2024-09-10T06:26:33.629278+0000","last_fullsized":"2024-09-10T06:26:33.629278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.629098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:15.221664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315934+0000","last_change":"2024-09-10T06:22:33.828847+0000","last_active":"2024-09-10T06:25:46.315934+0000","last_peered":"2024-09-10T06:25:46.315934+0000","last_clean":"2024-09-10T06:25:46.315934+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:25:46.315934+0000","last_undegraded":"2024-09-10T06:25:46.315934+0000","last_fullsized":"2024-09-10T06:25:46.315934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:05.406874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839176+0000","last_change":"2024-09-10T06:22:31.832535+0000","last_active":"2024-09-10T06:23:12.839176+0000","last_peered":"2024-09-10T06:23:12.839176+0000","last_clean":"2024-09-10T06:23:12.839176+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:23:12.839176+0000","last_undegraded":"2024-09-10T06:23:12.839176+0000","last_fullsized":"2024-09-10T06:23:12.839176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:34.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.315089+0000","last_change":"2024-09-10T06:22:33.845847+0000","last_active":"2024-09-10T06:25:46.315089+0000","last_peered":"2024-09-10T06:25:46.315089+0000","last_clean":"2024-09-10T06:25:46.315089+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:25:46.315089+0000","last_undegraded":"2024-09-10T06:25:46.315089+0000","last_fullsized":"2024-09-10T06:25:46.315089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:30.165875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848612+0000","last_change":"2024-09-10T06:22:31.838658+0000","last_active":"2024-09-10T06:23:12.848612+0000","last_peered":"2024-09-10T06:23:12.848612+0000","last_clean":"2024-09-10T06:23:12.848612+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:23:12.848612+0000","last_undegraded":"2024-09-10T06:23:12.848612+0000","last_fullsized":"2024-09-10T06:23:12.848612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:56.723910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:16.848557+0000","last_change":"2024-09-10T06:23:12.871593+0000","last_active":"2024-09-10T06:23:16.848557+0000","last_peered":"2024-09-10T06:23:16.848557+0000","last_clean":"2024-09-10T06:23:16.848557+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:23:16.848557+0000","last_undegraded":"2024-09-10T06:23:16.848557+0000","last_fullsized":"2024-09-10T06:23:16.848557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:13.458403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.549201+0000","last_change":"2024-09-10T06:26:36.549201+0000","last_active":"2024-09-10T06:26:36.549201+0000","last_peered":"2024-09-10T06:26:36.549201+0000","last_clean":"2024-09-10T06:26:36.549201+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:26:36.549201+0000","last_undegraded":"2024-09-10T06:26:36.549201+0000","last_fullsized":"2024-09-10T06:26:36.549201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.549021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:42.805736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'1","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849028+0000","last_change":"2024-09-10T06:22:33.824001+0000","last_active":"2024-09-10T06:24:42.849028+0000","last_peered":"2024-09-10T06:24:42.849028+0000","last_clean":"2024-09-10T06:24:42.849028+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:24:42.849028+0000","last_undegraded":"2024-09-10T06:24:42.849028+0000","last_fullsized":"2024-09-10T06:24:42.849028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:04.705910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.190954+0000","last_change":"2024-09-10T06:22:31.828589+0000","last_active":"2024-09-10T06:25:46.190954+0000","last_peered":"2024-09-10T06:25:46.190954+0000","last_clean":"2024-09-10T06:25:46.190954+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:25:46.190954+0000","last_undegraded":"2024-09-10T06:25:46.190954+0000","last_fullsized":"2024-09-10T06:25:46.190954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:13.166658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836407+0000","last_change":"2024-09-10T06:22:31.822739+0000","last_active":"2024-09-10T06:23:12.836407+0000","last_peered":"2024-09-10T06:23:12.836407+0000","last_clean":"2024-09-10T06:23:12.836407+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:23:12.836407+0000","last_undegraded":"2024-09-10T06:23:12.836407+0000","last_fullsized":"2024-09-10T06:23:12.836407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:18.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.427151+0000","last_change":"2024-09-10T06:22:33.834781+0000","last_active":"2024-09-10T06:24:00.427151+0000","last_peered":"2024-09-10T06:24:00.427151+0000","last_clean":"2024-09-10T06:24:00.427151+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:24:00.427151+0000","last_undegraded":"2024-09-10T06:24:00.427151+0000","last_fullsized":"2024-09-10T06:24:00.427151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:28.196395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.042356+0000","last_change":"2024-09-10T06:22:31.814239+0000","last_active":"2024-09-10T06:24:45.042356+0000","last_peered":"2024-09-10T06:24:45.042356+0000","last_clean":"2024-09-10T06:24:45.042356+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:24:45.042356+0000","last_undegraded":"2024-09-10T06:24:45.042356+0000","last_fullsized":"2024-09-10T06:24:45.042356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:30.873861+0000","last_clean_scrub_stamp":"2024-09-10T06:22:30.873861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:02.443140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.226303+0000","last_change":"2024-09-10T06:22:33.828192+0000","last_active":"2024-09-10T06:25:46.226303+0000","last_peered":"2024-09-10T06:25:46.226303+0000","last_clean":"2024-09-10T06:25:46.226303+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:25:46.226303+0000","last_undegraded":"2024-09-10T06:25:46.226303+0000","last_fullsized":"2024-09-10T06:25:46.226303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:17.430784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640311,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640313,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1007616,"data_stored":724587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673017,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":425984,"data_stored":135733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:42.912 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.912 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.912 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.912 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.913 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.914 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.915 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.916 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.917 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.918 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.919 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.920 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.921 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.922 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.923 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.924 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.925 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.926 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.927 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.928 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.929 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.930 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.931 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.932 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.933 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T06:22:30.873861+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:26:42.934 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:27:02.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f159c10a640 1 Processor -- start 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f159c10a640 1 -- start start 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f159c10a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1594110da0 0x7f1594111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f159c10a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1594073a90 con 0x7f15941116c0 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f159c10a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f15940696e0 con 0x7f1594110da0 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f1599ea6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1594110da0 0x7f1594111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f1599ea6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1594110da0 0x7f1594111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52314/0 (socket says 172.21.15.84:52314) 2024-09-10T06:27:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f1599ea6640 1 -- 172.21.15.84:0/2945922978 learned_addr learned my addr 172.21.15.84:0/2945922978 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:27:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f1599ea6640 1 -- 172.21.15.84:0/2945922978 >> v1:172.21.15.84:6789/0 conn(0x7f15941116c0 legacy=0x7f15941231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T06:27:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.062+0000 7f1599ea6640 1 -- 172.21.15.84:0/2945922978 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159406dd50 con 0x7f1594110da0 2024-09-10T06:27:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 --2- 172.21.15.84:0/2945922978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594111180 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f15880097f0 tx=0x7f158801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8660829cbabe2c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1598ea4640 1 -- 172.21.15.84:0/2945922978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15880b0070 con 0x7f1594110da0 2024-09-10T06:27:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1598ea4640 1 -- 172.21.15.84:0/2945922978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15880ab530 con 0x7f1594110da0 2024-09-10T06:27:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1598ea4640 1 -- 172.21.15.84:0/2945922978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15880ab830 con 0x7f1594110da0 2024-09-10T06:27:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/2945922978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 msgr2=0x7f1594111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 --2- 172.21.15.84:0/2945922978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594111180 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f15880097f0 tx=0x7f158801c430 comp rx=0 tx=0).stop 2024-09-10T06:27:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/2945922978 shutdown_connections 2024-09-10T06:27:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 --2- 172.21.15.84:0/2945922978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594111180 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/2945922978 >> 172.21.15.84:0/2945922978 conn(0x7f1594070900 msgr2=0x7f1594072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/2945922978 shutdown_connections 2024-09-10T06:27:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/2945922978 wait complete. 2024-09-10T06:27:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 Processor -- start 2024-09-10T06:27:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- start start 2024-09-10T06:27:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1594135470 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 -- 172.21.15.84:0/342199896 learned_addr learned my addr 172.21.15.84:0/342199896 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 -- 172.21.15.84:0/342199896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15941331b0 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f1599ea6640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f158801a060 tx=0x7f15880191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15880b0040 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15880b4570 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1594131d30 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15880b4890 con 0x7f1594110da0 2024-09-10T06:27:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.066+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941155b0 con 0x7f1594110da0 2024-09-10T06:27:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1594111180 con 0x7f1594110da0 2024-09-10T06:27:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f15880bb020 con 0x7f1594110da0 2024-09-10T06:27:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f15867fc640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 0x7f157803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f15880b9020 con 0x7f1594110da0 2024-09-10T06:27:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f15996a5640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 0x7f157803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.070+0000 7f15996a5640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 0x7f157803d6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1590001630 tx=0x7f1590007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:03.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.074+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f15880c2020 con 0x7f1594110da0 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.246+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15941120e0 con 0x7f157803b200 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.274+0000 7f15867fc640 1 -- 172.21.15.84:0/342199896 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664370 (secure 0 0 0) 0x7f1590005080 con 0x7f157803b200 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 msgr2=0x7f157803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 0x7f157803d6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1590001630 tx=0x7f1590007a00 comp rx=0 tx=0).stop 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 msgr2=0x7f1594130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f158801a060 tx=0x7f15880191d0 comp rx=0 tx=0).stop 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 shutdown_connections 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f157803b200 0x7f157803d6c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 --2- 172.21.15.84:0/342199896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1594110da0 0x7f1594130730 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 >> 172.21.15.84:0/342199896 conn(0x7f1594070900 msgr2=0x7f1594071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 shutdown_connections 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:03.282+0000 7f159c10a640 1 -- 172.21.15.84:0/342199896 wait complete. 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-10T06:27:01.888737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4606,"ondisk_log_size":4606,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156672,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330688,"statfs":{"total":386547056640,"available":386386624512,"internally_reserved":0,"allocated":2883584,"data_stored":1722172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.466040+0000","last_change":"2024-09-10T06:26:34.465867+0000","last_active":"2024-09-10T06:26:34.466040+0000","last_peered":"2024-09-10T06:26:34.466040+0000","last_clean":"2024-09-10T06:26:34.466040+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:26:34.466040+0000","last_undegraded":"2024-09-10T06:26:34.466040+0000","last_fullsized":"2024-09-10T06:26:34.466040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.465683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:52.407098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.646909+0000","last_change":"2024-09-10T06:26:53.646909+0000","last_active":"2024-09-10T06:26:53.646909+0000","last_peered":"2024-09-10T06:26:53.646909+0000","last_clean":"2024-09-10T06:26:53.646909+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:26:53.646909+0000","last_undegraded":"2024-09-10T06:26:53.646909+0000","last_fullsized":"2024-09-10T06:26:53.646909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.646728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.216502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.020076+0000","last_change":"2024-09-10T06:26:31.019911+0000","last_active":"2024-09-10T06:26:31.020076+0000","last_peered":"2024-09-10T06:26:31.020076+0000","last_clean":"2024-09-10T06:26:31.020076+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:26:31.020076+0000","last_undegraded":"2024-09-10T06:26:31.020076+0000","last_fullsized":"2024-09-10T06:26:31.020076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.019720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.047991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.425854+0000","last_change":"2024-09-10T06:22:33.842321+0000","last_active":"2024-09-10T06:24:00.425854+0000","last_peered":"2024-09-10T06:24:00.425854+0000","last_clean":"2024-09-10T06:24:00.425854+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:24:00.425854+0000","last_undegraded":"2024-09-10T06:24:00.425854+0000","last_fullsized":"2024-09-10T06:24:00.425854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:18.329398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.163437+0000","last_change":"2024-09-10T06:26:51.163437+0000","last_active":"2024-09-10T06:26:51.163437+0000","last_peered":"2024-09-10T06:26:51.163437+0000","last_clean":"2024-09-10T06:26:51.163437+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:26:51.163437+0000","last_undegraded":"2024-09-10T06:26:51.163437+0000","last_fullsized":"2024-09-10T06:26:51.163437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.163242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:11.196431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.849083+0000","last_change":"2024-09-10T06:22:33.842786+0000","last_active":"2024-09-10T06:23:12.849083+0000","last_peered":"2024-09-10T06:23:12.849083+0000","last_clean":"2024-09-10T06:23:12.849083+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:23:12.849083+0000","last_undegraded":"2024-09-10T06:23:12.849083+0000","last_fullsized":"2024-09-10T06:23:12.849083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:29.976864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.746646+0000","last_change":"2024-09-10T06:26:42.746646+0000","last_active":"2024-09-10T06:26:42.746646+0000","last_peered":"2024-09-10T06:26:42.746646+0000","last_clean":"2024-09-10T06:26:42.746646+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:26:42.746646+0000","last_undegraded":"2024-09-10T06:26:42.746646+0000","last_fullsized":"2024-09-10T06:26:42.746646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.746449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:24.690631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.807804+0000","last_change":"2024-09-10T06:26:47.807804+0000","last_active":"2024-09-10T06:26:47.807804+0000","last_peered":"2024-09-10T06:26:47.807804+0000","last_clean":"2024-09-10T06:26:47.807804+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:26:47.807804+0000","last_undegraded":"2024-09-10T06:26:47.807804+0000","last_fullsized":"2024-09-10T06:26:47.807804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.807624+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:44.898834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.241472+0000","last_change":"2024-09-10T06:26:49.241472+0000","last_active":"2024-09-10T06:26:49.241472+0000","last_peered":"2024-09-10T06:26:49.241472+0000","last_clean":"2024-09-10T06:26:49.241472+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:26:49.241472+0000","last_undegraded":"2024-09-10T06:26:49.241472+0000","last_fullsized":"2024-09-10T06:26:49.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.241280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:21.798559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.669065+0000","last_change":"2024-09-10T06:26:54.669065+0000","last_active":"2024-09-10T06:26:54.669065+0000","last_peered":"2024-09-10T06:26:54.669065+0000","last_clean":"2024-09-10T06:26:54.669065+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:26:54.669065+0000","last_undegraded":"2024-09-10T06:26:54.669065+0000","last_fullsized":"2024-09-10T06:26:54.669065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.668892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:55.148303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.383694+0000","last_change":"2024-09-10T06:26:32.383694+0000","last_active":"2024-09-10T06:26:32.383694+0000","last_peered":"2024-09-10T06:26:32.383694+0000","last_clean":"2024-09-10T06:26:32.383694+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:26:32.383694+0000","last_undegraded":"2024-09-10T06:26:32.383694+0000","last_fullsized":"2024-09-10T06:26:32.383694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.383510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:41.546507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856098+0000","last_change":"2024-09-10T06:22:33.830337+0000","last_active":"2024-09-10T06:24:38.856098+0000","last_peered":"2024-09-10T06:24:38.856098+0000","last_clean":"2024-09-10T06:24:38.856098+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:24:38.856098+0000","last_undegraded":"2024-09-10T06:24:38.856098+0000","last_fullsized":"2024-09-10T06:24:38.856098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.236984+0000","last_change":"2024-09-10T06:26:48.236984+0000","last_active":"2024-09-10T06:26:48.236984+0000","last_peered":"2024-09-10T06:26:48.236984+0000","last_clean":"2024-09-10T06:26:48.236984+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:26:48.236984+0000","last_undegraded":"2024-09-10T06:26:48.236984+0000","last_fullsized":"2024-09-10T06:26:48.236984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.236809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:50.855015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.767721+0000","last_change":"2024-09-10T06:26:50.767721+0000","last_active":"2024-09-10T06:26:50.767721+0000","last_peered":"2024-09-10T06:26:50.767721+0000","last_clean":"2024-09-10T06:26:50.767721+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:26:50.767721+0000","last_undegraded":"2024-09-10T06:26:50.767721+0000","last_fullsized":"2024-09-10T06:26:50.767721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.767440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:05.170562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.039477+0000","last_change":"2024-09-10T06:26:30.039477+0000","last_active":"2024-09-10T06:26:30.039477+0000","last_peered":"2024-09-10T06:26:30.039477+0000","last_clean":"2024-09-10T06:26:30.039477+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:26:30.039477+0000","last_undegraded":"2024-09-10T06:26:30.039477+0000","last_fullsized":"2024-09-10T06:26:30.039477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.039298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:00.637143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.805279+0000","last_change":"2024-09-10T06:26:49.805279+0000","last_active":"2024-09-10T06:26:49.805279+0000","last_peered":"2024-09-10T06:26:49.805279+0000","last_clean":"2024-09-10T06:26:49.805279+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:26:49.805279+0000","last_undegraded":"2024-09-10T06:26:49.805279+0000","last_fullsized":"2024-09-10T06:26:49.805279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.805098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.455068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.227494+0000","last_change":"2024-09-10T06:22:33.842666+0000","last_active":"2024-09-10T06:25:46.227494+0000","last_peered":"2024-09-10T06:25:46.227494+0000","last_clean":"2024-09-10T06:25:46.227494+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:25:46.227494+0000","last_undegraded":"2024-09-10T06:25:46.227494+0000","last_fullsized":"2024-09-10T06:25:46.227494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:34.043690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.658943+0000","last_change":"2024-09-10T06:26:34.658943+0000","last_active":"2024-09-10T06:26:34.658943+0000","last_peered":"2024-09-10T06:26:34.658943+0000","last_clean":"2024-09-10T06:26:34.658943+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:26:34.658943+0000","last_undegraded":"2024-09-10T06:26:34.658943+0000","last_fullsized":"2024-09-10T06:26:34.658943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.658763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:49.709576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.693724+0000","last_change":"2024-09-10T06:26:49.693724+0000","last_active":"2024-09-10T06:26:49.693724+0000","last_peered":"2024-09-10T06:26:49.693724+0000","last_clean":"2024-09-10T06:26:49.693724+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:26:49.693724+0000","last_undegraded":"2024-09-10T06:26:49.693724+0000","last_fullsized":"2024-09-10T06:26:49.693724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.693549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:08.446456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.418172+0000","last_change":"2024-09-10T06:26:33.418172+0000","last_active":"2024-09-10T06:26:33.418172+0000","last_peered":"2024-09-10T06:26:33.418172+0000","last_clean":"2024-09-10T06:26:33.418172+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:26:33.418172+0000","last_undegraded":"2024-09-10T06:26:33.418172+0000","last_fullsized":"2024-09-10T06:26:33.418172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.417943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:42.088360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.673252+0000","last_change":"2024-09-10T06:26:50.673252+0000","last_active":"2024-09-10T06:26:50.673252+0000","last_peered":"2024-09-10T06:26:50.673252+0000","last_clean":"2024-09-10T06:26:50.673252+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:26:50.673252+0000","last_undegraded":"2024-09-10T06:26:50.673252+0000","last_fullsized":"2024-09-10T06:26:50.673252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.673058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:46.607628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.556091+0000","last_change":"2024-09-10T06:26:31.556091+0000","last_active":"2024-09-10T06:26:31.556091+0000","last_peered":"2024-09-10T06:26:31.556091+0000","last_clean":"2024-09-10T06:26:31.556091+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:26:31.556091+0000","last_undegraded":"2024-09-10T06:26:31.556091+0000","last_fullsized":"2024-09-10T06:26:31.556091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.555912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:11.664445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.817945+0000","last_change":"2024-09-10T06:26:48.817945+0000","last_active":"2024-09-10T06:26:48.817945+0000","last_peered":"2024-09-10T06:26:48.817945+0000","last_clean":"2024-09-10T06:26:48.817945+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:26:48.817945+0000","last_undegraded":"2024-09-10T06:26:48.817945+0000","last_fullsized":"2024-09-10T06:26:48.817945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.817716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:47.841366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.598629+0000","last_change":"2024-09-10T06:26:32.598629+0000","last_active":"2024-09-10T06:26:32.598629+0000","last_peered":"2024-09-10T06:26:32.598629+0000","last_clean":"2024-09-10T06:26:32.598629+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:26:32.598629+0000","last_undegraded":"2024-09-10T06:26:32.598629+0000","last_fullsized":"2024-09-10T06:26:32.598629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.598449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:24.920243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.782106+0000","last_change":"2024-09-10T06:26:45.782106+0000","last_active":"2024-09-10T06:26:45.782106+0000","last_peered":"2024-09-10T06:26:45.782106+0000","last_clean":"2024-09-10T06:26:45.782106+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:26:45.782106+0000","last_undegraded":"2024-09-10T06:26:45.782106+0000","last_fullsized":"2024-09-10T06:26:45.782106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.781922+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:14.746365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.086704+0000","last_change":"2024-09-10T06:26:28.086704+0000","last_active":"2024-09-10T06:26:28.086704+0000","last_peered":"2024-09-10T06:26:28.086704+0000","last_clean":"2024-09-10T06:26:28.086704+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:26:28.086704+0000","last_undegraded":"2024-09-10T06:26:28.086704+0000","last_fullsized":"2024-09-10T06:26:28.086704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.086529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:43.137342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.670280+0000","last_change":"2024-09-10T06:26:51.670280+0000","last_active":"2024-09-10T06:26:51.670280+0000","last_peered":"2024-09-10T06:26:51.670280+0000","last_clean":"2024-09-10T06:26:51.670280+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:26:51.670280+0000","last_undegraded":"2024-09-10T06:26:51.670280+0000","last_fullsized":"2024-09-10T06:26:51.670280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.670102+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.678798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.234344+0000","last_change":"2024-09-10T06:26:47.234344+0000","last_active":"2024-09-10T06:26:47.234344+0000","last_peered":"2024-09-10T06:26:47.234344+0000","last_clean":"2024-09-10T06:26:47.234344+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:26:47.234344+0000","last_undegraded":"2024-09-10T06:26:47.234344+0000","last_fullsized":"2024-09-10T06:26:47.234344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.234129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:14.974750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.219569+0000","last_change":"2024-09-10T06:26:57.219569+0000","last_active":"2024-09-10T06:26:57.219569+0000","last_peered":"2024-09-10T06:26:57.219569+0000","last_clean":"2024-09-10T06:26:57.219569+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:26:57.219569+0000","last_undegraded":"2024-09-10T06:26:57.219569+0000","last_fullsized":"2024-09-10T06:26:57.219569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.219347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:08.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.268913+0000","last_change":"2024-09-10T06:26:36.268913+0000","last_active":"2024-09-10T06:26:36.268913+0000","last_peered":"2024-09-10T06:26:36.268913+0000","last_clean":"2024-09-10T06:26:36.268913+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:26:36.268913+0000","last_undegraded":"2024-09-10T06:26:36.268913+0000","last_fullsized":"2024-09-10T06:26:36.268913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.268668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:50.827972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843607+0000","last_change":"2024-09-10T06:22:35.832316+0000","last_active":"2024-09-10T06:23:12.843607+0000","last_peered":"2024-09-10T06:23:12.843607+0000","last_clean":"2024-09-10T06:23:12.843607+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:23:12.843607+0000","last_undegraded":"2024-09-10T06:23:12.843607+0000","last_fullsized":"2024-09-10T06:23:12.843607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:46.931707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.668585+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:26:17.668585+0000","last_peered":"2024-09-10T06:26:17.668585+0000","last_clean":"2024-09-10T06:26:17.668585+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:26:17.668585+0000","last_undegraded":"2024-09-10T06:26:17.668585+0000","last_fullsized":"2024-09-10T06:26:17.668585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863080+0000","last_change":"2024-09-10T06:22:39.874714+0000","last_active":"2024-09-10T06:23:12.863080+0000","last_peered":"2024-09-10T06:23:12.863080+0000","last_clean":"2024-09-10T06:23:12.863080+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:23:12.863080+0000","last_undegraded":"2024-09-10T06:23:12.863080+0000","last_fullsized":"2024-09-10T06:23:12.863080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.246335+0000","last_change":"2024-09-10T06:26:58.246335+0000","last_active":"2024-09-10T06:26:58.246335+0000","last_peered":"2024-09-10T06:26:58.246335+0000","last_clean":"2024-09-10T06:26:58.246335+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:26:58.246335+0000","last_undegraded":"2024-09-10T06:26:58.246335+0000","last_fullsized":"2024-09-10T06:26:58.246335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.246124+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:23.180121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.454535+0000","last_change":"2024-09-10T06:26:28.454535+0000","last_active":"2024-09-10T06:26:28.454535+0000","last_peered":"2024-09-10T06:26:28.454535+0000","last_clean":"2024-09-10T06:26:28.454535+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:26:28.454535+0000","last_undegraded":"2024-09-10T06:26:28.454535+0000","last_fullsized":"2024-09-10T06:26:28.454535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.454354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:21.140529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869520+0000","last_change":"2024-09-10T06:23:12.864653+0000","last_active":"2024-09-10T06:23:12.869520+0000","last_peered":"2024-09-10T06:23:12.869520+0000","last_clean":"2024-09-10T06:23:12.869520+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:23:12.869520+0000","last_undegraded":"2024-09-10T06:23:12.869520+0000","last_fullsized":"2024-09-10T06:23:12.869520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:17.149404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.304700+0000","last_change":"2024-09-10T06:22:37.841239+0000","last_active":"2024-09-10T06:24:45.304700+0000","last_peered":"2024-09-10T06:24:45.304700+0000","last_clean":"2024-09-10T06:24:45.304700+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:24:45.304700+0000","last_undegraded":"2024-09-10T06:24:45.304700+0000","last_fullsized":"2024-09-10T06:24:45.304700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:44.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.858813+0000","last_change":"2024-09-10T06:22:39.862579+0000","last_active":"2024-09-10T06:23:12.858813+0000","last_peered":"2024-09-10T06:23:12.858813+0000","last_clean":"2024-09-10T06:23:12.858813+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:23:12.858813+0000","last_undegraded":"2024-09-10T06:23:12.858813+0000","last_fullsized":"2024-09-10T06:23:12.858813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838850+0000","last_change":"2024-09-10T06:22:41.882158+0000","last_active":"2024-09-10T06:23:12.838850+0000","last_peered":"2024-09-10T06:23:12.838850+0000","last_clean":"2024-09-10T06:23:12.838850+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:23:12.838850+0000","last_undegraded":"2024-09-10T06:23:12.838850+0000","last_fullsized":"2024-09-10T06:23:12.838850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:39.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.026772+0000","last_change":"2024-09-10T06:22:33.817269+0000","last_active":"2024-09-10T06:25:46.026772+0000","last_peered":"2024-09-10T06:25:46.026772+0000","last_clean":"2024-09-10T06:25:46.026772+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:25:46.026772+0000","last_undegraded":"2024-09-10T06:25:46.026772+0000","last_fullsized":"2024-09-10T06:25:46.026772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.459795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.235143+0000","last_change":"2024-09-10T06:26:35.235143+0000","last_active":"2024-09-10T06:26:35.235143+0000","last_peered":"2024-09-10T06:26:35.235143+0000","last_clean":"2024-09-10T06:26:35.235143+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:26:35.235143+0000","last_undegraded":"2024-09-10T06:26:35.235143+0000","last_fullsized":"2024-09-10T06:26:35.235143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.234952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:53.200997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.835391+0000","last_change":"2024-09-10T06:26:56.835391+0000","last_active":"2024-09-10T06:26:56.835391+0000","last_peered":"2024-09-10T06:26:56.835391+0000","last_clean":"2024-09-10T06:26:56.835391+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:26:56.835391+0000","last_undegraded":"2024-09-10T06:26:56.835391+0000","last_fullsized":"2024-09-10T06:26:56.835391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.835182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:59.591116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850650+0000","last_change":"2024-09-10T06:22:37.830426+0000","last_active":"2024-09-10T06:23:12.850650+0000","last_peered":"2024-09-10T06:23:12.850650+0000","last_clean":"2024-09-10T06:23:12.850650+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:23:12.850650+0000","last_undegraded":"2024-09-10T06:23:12.850650+0000","last_fullsized":"2024-09-10T06:23:12.850650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:23.078603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.379703+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:26:17.379703+0000","last_peered":"2024-09-10T06:26:17.379703+0000","last_clean":"2024-09-10T06:26:17.379703+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:26:17.379703+0000","last_undegraded":"2024-09-10T06:26:17.379703+0000","last_fullsized":"2024-09-10T06:26:17.379703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.933145+0000","last_change":"2024-09-10T06:22:41.876834+0000","last_active":"2024-09-10T06:25:45.933145+0000","last_peered":"2024-09-10T06:25:45.933145+0000","last_clean":"2024-09-10T06:25:45.933145+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:25:45.933145+0000","last_undegraded":"2024-09-10T06:25:45.933145+0000","last_fullsized":"2024-09-10T06:25:45.933145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:13.544957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'22","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.942629+0000","last_change":"2024-09-10T06:26:36.942629+0000","last_active":"2024-09-10T06:26:36.942629+0000","last_peered":"2024-09-10T06:26:36.942629+0000","last_clean":"2024-09-10T06:26:36.942629+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:26:36.942629+0000","last_undegraded":"2024-09-10T06:26:36.942629+0000","last_fullsized":"2024-09-10T06:26:36.942629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.942444+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:24.199520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.456692+0000","last_change":"2024-09-10T06:26:23.456692+0000","last_active":"2024-09-10T06:26:23.456692+0000","last_peered":"2024-09-10T06:26:23.456692+0000","last_clean":"2024-09-10T06:26:23.456692+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:26:23.456692+0000","last_undegraded":"2024-09-10T06:26:23.456692+0000","last_fullsized":"2024-09-10T06:26:23.456692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.456509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:13.569641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843168+0000","last_change":"2024-09-10T06:22:35.826205+0000","last_active":"2024-09-10T06:23:12.843168+0000","last_peered":"2024-09-10T06:23:12.843168+0000","last_clean":"2024-09-10T06:23:12.843168+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:23:12.843168+0000","last_undegraded":"2024-09-10T06:23:12.843168+0000","last_fullsized":"2024-09-10T06:23:12.843168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:50.705646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.620235+0000","last_change":"2024-09-10T06:22:37.856334+0000","last_active":"2024-09-10T06:26:17.620235+0000","last_peered":"2024-09-10T06:26:17.620235+0000","last_clean":"2024-09-10T06:26:17.620235+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:26:17.620235+0000","last_undegraded":"2024-09-10T06:26:17.620235+0000","last_fullsized":"2024-09-10T06:26:17.620235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:33.554620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":406,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.388110+0000","last_change":"2024-09-10T06:22:39.849083+0000","last_active":"2024-09-10T06:26:17.388110+0000","last_peered":"2024-09-10T06:26:17.388110+0000","last_clean":"2024-09-10T06:26:17.388110+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:26:17.388110+0000","last_undegraded":"2024-09-10T06:26:17.388110+0000","last_fullsized":"2024-09-10T06:26:17.388110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.663264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.179151+0000","last_change":"2024-09-10T06:26:53.179003+0000","last_active":"2024-09-10T06:26:53.179151+0000","last_peered":"2024-09-10T06:26:53.179151+0000","last_clean":"2024-09-10T06:26:53.179151+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:26:53.179151+0000","last_undegraded":"2024-09-10T06:26:53.179151+0000","last_fullsized":"2024-09-10T06:26:53.179151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.178832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:42.811475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.491509+0000","last_change":"2024-09-10T06:26:26.491509+0000","last_active":"2024-09-10T06:26:26.491509+0000","last_peered":"2024-09-10T06:26:26.491509+0000","last_clean":"2024-09-10T06:26:26.491509+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:26:26.491509+0000","last_undegraded":"2024-09-10T06:26:26.491509+0000","last_fullsized":"2024-09-10T06:26:26.491509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.491266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:02.267203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.635870+0000","last_change":"2024-09-10T06:26:55.635748+0000","last_active":"2024-09-10T06:26:55.635870+0000","last_peered":"2024-09-10T06:26:55.635870+0000","last_clean":"2024-09-10T06:26:55.635870+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:26:55.635870+0000","last_undegraded":"2024-09-10T06:26:55.635870+0000","last_fullsized":"2024-09-10T06:26:55.635870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.635574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:54.659225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.705232+0000","last_change":"2024-09-10T06:22:37.842451+0000","last_active":"2024-09-10T06:26:17.705232+0000","last_peered":"2024-09-10T06:26:17.705232+0000","last_clean":"2024-09-10T06:26:17.705232+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:17.705232+0000","last_undegraded":"2024-09-10T06:26:17.705232+0000","last_fullsized":"2024-09-10T06:26:17.705232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841676+0000","last_change":"2024-09-10T06:22:39.849651+0000","last_active":"2024-09-10T06:23:12.841676+0000","last_peered":"2024-09-10T06:23:12.841676+0000","last_clean":"2024-09-10T06:23:12.841676+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:23:12.841676+0000","last_undegraded":"2024-09-10T06:23:12.841676+0000","last_fullsized":"2024-09-10T06:23:12.841676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.873993+0000","last_change":"2024-09-10T06:22:41.883283+0000","last_active":"2024-09-10T06:24:48.873993+0000","last_peered":"2024-09-10T06:24:48.873993+0000","last_clean":"2024-09-10T06:24:48.873993+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:24:48.873993+0000","last_undegraded":"2024-09-10T06:24:48.873993+0000","last_fullsized":"2024-09-10T06:24:48.873993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.750907+0000","last_change":"2024-09-10T06:26:37.750761+0000","last_active":"2024-09-10T06:26:37.750907+0000","last_peered":"2024-09-10T06:26:37.750907+0000","last_clean":"2024-09-10T06:26:37.750907+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:26:37.750907+0000","last_undegraded":"2024-09-10T06:26:37.750907+0000","last_fullsized":"2024-09-10T06:26:37.750907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.750588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:21.168972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.465949+0000","last_change":"2024-09-10T06:26:25.465949+0000","last_active":"2024-09-10T06:26:25.465949+0000","last_peered":"2024-09-10T06:26:25.465949+0000","last_clean":"2024-09-10T06:26:25.465949+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:26:25.465949+0000","last_undegraded":"2024-09-10T06:26:25.465949+0000","last_fullsized":"2024-09-10T06:26:25.465949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.465745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:11.750138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.801096+0000","last_change":"2024-09-10T06:26:53.800884+0000","last_active":"2024-09-10T06:26:53.801096+0000","last_peered":"2024-09-10T06:26:53.801096+0000","last_clean":"2024-09-10T06:26:53.801096+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:26:53.801096+0000","last_undegraded":"2024-09-10T06:26:53.801096+0000","last_fullsized":"2024-09-10T06:26:53.801096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.800700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:36.270704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.536926+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:26:17.536926+0000","last_peered":"2024-09-10T06:26:17.536926+0000","last_clean":"2024-09-10T06:26:17.536926+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:26:17.536926+0000","last_undegraded":"2024-09-10T06:26:17.536926+0000","last_fullsized":"2024-09-10T06:26:17.536926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:51.841880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839107+0000","last_change":"2024-09-10T06:22:39.848528+0000","last_active":"2024-09-10T06:23:12.839107+0000","last_peered":"2024-09-10T06:23:12.839107+0000","last_clean":"2024-09-10T06:23:12.839107+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:23:12.839107+0000","last_undegraded":"2024-09-10T06:23:12.839107+0000","last_fullsized":"2024-09-10T06:23:12.839107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.850238+0000","last_change":"2024-09-10T06:22:41.885846+0000","last_active":"2024-09-10T06:24:47.850238+0000","last_peered":"2024-09-10T06:24:47.850238+0000","last_clean":"2024-09-10T06:24:47.850238+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:24:47.850238+0000","last_undegraded":"2024-09-10T06:24:47.850238+0000","last_fullsized":"2024-09-10T06:24:47.850238+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.592620+0000","last_change":"2024-09-10T06:26:37.592443+0000","last_active":"2024-09-10T06:26:37.592620+0000","last_peered":"2024-09-10T06:26:37.592620+0000","last_clean":"2024-09-10T06:26:37.592620+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:26:37.592620+0000","last_undegraded":"2024-09-10T06:26:37.592620+0000","last_fullsized":"2024-09-10T06:26:37.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.592235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:10.519860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.222379+0000","last_change":"2024-09-10T06:26:34.222379+0000","last_active":"2024-09-10T06:26:34.222379+0000","last_peered":"2024-09-10T06:26:34.222379+0000","last_clean":"2024-09-10T06:26:34.222379+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:26:34.222379+0000","last_undegraded":"2024-09-10T06:26:34.222379+0000","last_fullsized":"2024-09-10T06:26:34.222379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.222107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:52.398385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.836508+0000","last_change":"2024-09-10T06:26:54.836508+0000","last_active":"2024-09-10T06:26:54.836508+0000","last_peered":"2024-09-10T06:26:54.836508+0000","last_clean":"2024-09-10T06:26:54.836508+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:26:54.836508+0000","last_undegraded":"2024-09-10T06:26:54.836508+0000","last_fullsized":"2024-09-10T06:26:54.836508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.836286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:31.547637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.721387+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:26:17.721387+0000","last_peered":"2024-09-10T06:26:17.721387+0000","last_clean":"2024-09-10T06:26:17.721387+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:26:17.721387+0000","last_undegraded":"2024-09-10T06:26:17.721387+0000","last_fullsized":"2024-09-10T06:26:17.721387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":353,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.390485+0000","last_change":"2024-09-10T06:22:39.848534+0000","last_active":"2024-09-10T06:26:17.390485+0000","last_peered":"2024-09-10T06:26:17.390485+0000","last_clean":"2024-09-10T06:26:17.390485+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:26:17.390485+0000","last_undegraded":"2024-09-10T06:26:17.390485+0000","last_fullsized":"2024-09-10T06:26:17.390485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.033442+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.033442+0000","last_peered":"2024-09-10T06:25:46.033442+0000","last_clean":"2024-09-10T06:25:46.033442+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.033442+0000","last_undegraded":"2024-09-10T06:25:46.033442+0000","last_fullsized":"2024-09-10T06:25:46.033442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:09.433461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.631720+0000","last_change":"2024-09-10T06:26:38.631720+0000","last_active":"2024-09-10T06:26:38.631720+0000","last_peered":"2024-09-10T06:26:38.631720+0000","last_clean":"2024-09-10T06:26:38.631720+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:26:38.631720+0000","last_undegraded":"2024-09-10T06:26:38.631720+0000","last_fullsized":"2024-09-10T06:26:38.631720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.631513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:27.113368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.205009+0000","last_change":"2024-09-10T06:26:33.205009+0000","last_active":"2024-09-10T06:26:33.205009+0000","last_peered":"2024-09-10T06:26:33.205009+0000","last_clean":"2024-09-10T06:26:33.205009+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:26:33.205009+0000","last_undegraded":"2024-09-10T06:26:33.205009+0000","last_fullsized":"2024-09-10T06:26:33.205009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.204830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.417787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.807872+0000","last_change":"2024-09-10T06:26:49.807716+0000","last_active":"2024-09-10T06:26:49.807872+0000","last_peered":"2024-09-10T06:26:49.807872+0000","last_clean":"2024-09-10T06:26:49.807872+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:26:49.807872+0000","last_undegraded":"2024-09-10T06:26:49.807872+0000","last_fullsized":"2024-09-10T06:26:49.807872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:23.493668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.560828+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:26:17.560828+0000","last_peered":"2024-09-10T06:26:17.560828+0000","last_clean":"2024-09-10T06:26:17.560828+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:26:17.560828+0000","last_undegraded":"2024-09-10T06:26:17.560828+0000","last_fullsized":"2024-09-10T06:26:17.560828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.839618+0000","last_change":"2024-09-10T06:22:39.863363+0000","last_active":"2024-09-10T06:23:12.839618+0000","last_peered":"2024-09-10T06:23:12.839618+0000","last_clean":"2024-09-10T06:23:12.839618+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:23:12.839618+0000","last_undegraded":"2024-09-10T06:23:12.839618+0000","last_fullsized":"2024-09-10T06:23:12.839618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:26.190788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.543985+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.543985+0000","last_peered":"2024-09-10T06:25:46.543985+0000","last_clean":"2024-09-10T06:25:46.543985+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.543985+0000","last_undegraded":"2024-09-10T06:25:46.543985+0000","last_fullsized":"2024-09-10T06:25:46.543985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:23.191344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.680863+0000","last_change":"2024-09-10T06:26:39.680863+0000","last_active":"2024-09-10T06:26:39.680863+0000","last_peered":"2024-09-10T06:26:39.680863+0000","last_clean":"2024-09-10T06:26:39.680863+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:26:39.680863+0000","last_undegraded":"2024-09-10T06:26:39.680863+0000","last_fullsized":"2024-09-10T06:26:39.680863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.680672+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:43.246870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.091180+0000","last_change":"2024-09-10T06:26:23.091180+0000","last_active":"2024-09-10T06:26:23.091180+0000","last_peered":"2024-09-10T06:26:23.091180+0000","last_clean":"2024-09-10T06:26:23.091180+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:26:23.091180+0000","last_undegraded":"2024-09-10T06:26:23.091180+0000","last_fullsized":"2024-09-10T06:26:23.091180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.091001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:02.894224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.727049+0000","last_change":"2024-09-10T06:26:52.727049+0000","last_active":"2024-09-10T06:26:52.727049+0000","last_peered":"2024-09-10T06:26:52.727049+0000","last_clean":"2024-09-10T06:26:52.727049+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:26:52.727049+0000","last_undegraded":"2024-09-10T06:26:52.727049+0000","last_fullsized":"2024-09-10T06:26:52.727049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.726845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.566639+0000","last_change":"2024-09-10T06:22:37.840476+0000","last_active":"2024-09-10T06:26:17.566639+0000","last_peered":"2024-09-10T06:26:17.566639+0000","last_clean":"2024-09-10T06:26:17.566639+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:26:17.566639+0000","last_undegraded":"2024-09-10T06:26:17.566639+0000","last_fullsized":"2024-09-10T06:26:17.566639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:46.140065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852181+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:23:12.852181+0000","last_peered":"2024-09-10T06:23:12.852181+0000","last_clean":"2024-09-10T06:23:12.852181+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:23:12.852181+0000","last_undegraded":"2024-09-10T06:23:12.852181+0000","last_fullsized":"2024-09-10T06:23:12.852181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:28.869185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.493991+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:25:46.493991+0000","last_peered":"2024-09-10T06:25:46.493991+0000","last_clean":"2024-09-10T06:25:46.493991+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:25:46.493991+0000","last_undegraded":"2024-09-10T06:25:46.493991+0000","last_fullsized":"2024-09-10T06:25:46.493991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.209024+0000","last_change":"2024-09-10T06:26:55.209024+0000","last_active":"2024-09-10T06:26:55.209024+0000","last_peered":"2024-09-10T06:26:55.209024+0000","last_clean":"2024-09-10T06:26:55.209024+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:26:55.209024+0000","last_undegraded":"2024-09-10T06:26:55.209024+0000","last_fullsized":"2024-09-10T06:26:55.209024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.208816+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:39.866888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.181095+0000","last_change":"2024-09-10T06:26:32.180956+0000","last_active":"2024-09-10T06:26:32.181095+0000","last_peered":"2024-09-10T06:26:32.181095+0000","last_clean":"2024-09-10T06:26:32.181095+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:26:32.181095+0000","last_undegraded":"2024-09-10T06:26:32.181095+0000","last_fullsized":"2024-09-10T06:26:32.181095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.180772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:44.519421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.771226+0000","last_change":"2024-09-10T06:26:50.771226+0000","last_active":"2024-09-10T06:26:50.771226+0000","last_peered":"2024-09-10T06:26:50.771226+0000","last_clean":"2024-09-10T06:26:50.771226+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:26:50.771226+0000","last_undegraded":"2024-09-10T06:26:50.771226+0000","last_fullsized":"2024-09-10T06:26:50.771226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.771046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:01.764276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.513879+0000","last_change":"2024-09-10T06:22:37.829900+0000","last_active":"2024-09-10T06:26:17.513879+0000","last_peered":"2024-09-10T06:26:17.513879+0000","last_clean":"2024-09-10T06:26:17.513879+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:26:17.513879+0000","last_undegraded":"2024-09-10T06:26:17.513879+0000","last_fullsized":"2024-09-10T06:26:17.513879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:05.605855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.380679+0000","last_change":"2024-09-10T06:22:39.846764+0000","last_active":"2024-09-10T06:26:17.380679+0000","last_peered":"2024-09-10T06:26:17.380679+0000","last_clean":"2024-09-10T06:26:17.380679+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:26:17.380679+0000","last_undegraded":"2024-09-10T06:26:17.380679+0000","last_fullsized":"2024-09-10T06:26:17.380679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:28.680331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.498112+0000","last_change":"2024-09-10T06:22:41.877711+0000","last_active":"2024-09-10T06:25:46.498112+0000","last_peered":"2024-09-10T06:25:46.498112+0000","last_clean":"2024-09-10T06:25:46.498112+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:25:46.498112+0000","last_undegraded":"2024-09-10T06:25:46.498112+0000","last_fullsized":"2024-09-10T06:25:46.498112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.678024+0000","last_change":"2024-09-10T06:26:39.678024+0000","last_active":"2024-09-10T06:26:39.678024+0000","last_peered":"2024-09-10T06:26:39.678024+0000","last_clean":"2024-09-10T06:26:39.678024+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:26:39.678024+0000","last_undegraded":"2024-09-10T06:26:39.678024+0000","last_fullsized":"2024-09-10T06:26:39.678024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.677842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:41.426578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.226344+0000","last_change":"2024-09-10T06:26:31.226136+0000","last_active":"2024-09-10T06:26:31.226344+0000","last_peered":"2024-09-10T06:26:31.226344+0000","last_clean":"2024-09-10T06:26:31.226344+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:26:31.226344+0000","last_undegraded":"2024-09-10T06:26:31.226344+0000","last_fullsized":"2024-09-10T06:26:31.226344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.225929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.622943+0000","last_change":"2024-09-10T06:26:56.622943+0000","last_active":"2024-09-10T06:26:56.622943+0000","last_peered":"2024-09-10T06:26:56.622943+0000","last_clean":"2024-09-10T06:26:56.622943+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:56.622943+0000","last_undegraded":"2024-09-10T06:26:56.622943+0000","last_fullsized":"2024-09-10T06:26:56.622943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.622754+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:30.308911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.108170+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:41.108170+0000","last_peered":"2024-09-10T06:24:41.108170+0000","last_clean":"2024-09-10T06:24:41.108170+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:41.108170+0000","last_undegraded":"2024-09-10T06:24:41.108170+0000","last_fullsized":"2024-09-10T06:24:41.108170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:55.452418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.383675+0000","last_change":"2024-09-10T06:22:39.867510+0000","last_active":"2024-09-10T06:26:17.383675+0000","last_peered":"2024-09-10T06:26:17.383675+0000","last_clean":"2024-09-10T06:26:17.383675+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:26:17.383675+0000","last_undegraded":"2024-09-10T06:26:17.383675+0000","last_fullsized":"2024-09-10T06:26:17.383675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:22.396125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.873863+0000","last_change":"2024-09-10T06:22:41.877931+0000","last_active":"2024-09-10T06:24:48.873863+0000","last_peered":"2024-09-10T06:24:48.873863+0000","last_clean":"2024-09-10T06:24:48.873863+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:24:48.873863+0000","last_undegraded":"2024-09-10T06:24:48.873863+0000","last_fullsized":"2024-09-10T06:24:48.873863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.706449+0000","last_change":"2024-09-10T06:26:38.706449+0000","last_active":"2024-09-10T06:26:38.706449+0000","last_peered":"2024-09-10T06:26:38.706449+0000","last_clean":"2024-09-10T06:26:38.706449+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:26:38.706449+0000","last_undegraded":"2024-09-10T06:26:38.706449+0000","last_fullsized":"2024-09-10T06:26:38.706449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.706224+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:22.987665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.163027+0000","last_change":"2024-09-10T06:26:29.162880+0000","last_active":"2024-09-10T06:26:29.163027+0000","last_peered":"2024-09-10T06:26:29.163027+0000","last_clean":"2024-09-10T06:26:29.163027+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:26:29.163027+0000","last_undegraded":"2024-09-10T06:26:29.163027+0000","last_fullsized":"2024-09-10T06:26:29.163027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.162701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:58.415388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.840975+0000","last_change":"2024-09-10T06:22:35.825977+0000","last_active":"2024-09-10T06:23:12.840975+0000","last_peered":"2024-09-10T06:23:12.840975+0000","last_clean":"2024-09-10T06:23:12.840975+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:23:12.840975+0000","last_undegraded":"2024-09-10T06:23:12.840975+0000","last_fullsized":"2024-09-10T06:23:12.840975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:11.248462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.677114+0000","last_change":"2024-09-10T06:22:37.839279+0000","last_active":"2024-09-10T06:26:17.677114+0000","last_peered":"2024-09-10T06:26:17.677114+0000","last_clean":"2024-09-10T06:26:17.677114+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:26:17.677114+0000","last_undegraded":"2024-09-10T06:26:17.677114+0000","last_fullsized":"2024-09-10T06:26:17.677114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:06.212865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.848398+0000","last_change":"2024-09-10T06:22:39.878895+0000","last_active":"2024-09-10T06:23:12.848398+0000","last_peered":"2024-09-10T06:23:12.848398+0000","last_clean":"2024-09-10T06:23:12.848398+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:23:12.848398+0000","last_undegraded":"2024-09-10T06:23:12.848398+0000","last_fullsized":"2024-09-10T06:23:12.848398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:13.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'18","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.550577+0000","last_change":"2024-09-10T06:22:41.871094+0000","last_active":"2024-09-10T06:25:46.550577+0000","last_peered":"2024-09-10T06:25:46.550577+0000","last_clean":"2024-09-10T06:25:46.550577+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:25:46.550577+0000","last_undegraded":"2024-09-10T06:25:46.550577+0000","last_fullsized":"2024-09-10T06:25:46.550577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.183922+0000","last_change":"2024-09-10T06:26:52.183922+0000","last_active":"2024-09-10T06:26:52.183922+0000","last_peered":"2024-09-10T06:26:52.183922+0000","last_clean":"2024-09-10T06:26:52.183922+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:26:52.183922+0000","last_undegraded":"2024-09-10T06:26:52.183922+0000","last_fullsized":"2024-09-10T06:26:52.183922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.183746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:24.557171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.430887+0000","last_change":"2024-09-10T06:26:21.430739+0000","last_active":"2024-09-10T06:26:21.430887+0000","last_peered":"2024-09-10T06:26:21.430887+0000","last_clean":"2024-09-10T06:26:21.430887+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:26:21.430887+0000","last_undegraded":"2024-09-10T06:26:21.430887+0000","last_fullsized":"2024-09-10T06:26:21.430887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.430530+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.906584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.133425+0000","last_change":"2024-09-10T06:26:25.133287+0000","last_active":"2024-09-10T06:26:25.133425+0000","last_peered":"2024-09-10T06:26:25.133425+0000","last_clean":"2024-09-10T06:26:25.133425+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:26:25.133425+0000","last_undegraded":"2024-09-10T06:26:25.133425+0000","last_fullsized":"2024-09-10T06:26:25.133425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.133112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:31.494004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.114495+0000","last_change":"2024-09-10T06:26:27.114356+0000","last_active":"2024-09-10T06:26:27.114495+0000","last_peered":"2024-09-10T06:26:27.114495+0000","last_clean":"2024-09-10T06:26:27.114495+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:26:27.114495+0000","last_undegraded":"2024-09-10T06:26:27.114495+0000","last_fullsized":"2024-09-10T06:26:27.114495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.114182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:12.450302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849112+0000","last_change":"2024-09-10T06:22:35.829421+0000","last_active":"2024-09-10T06:24:42.849112+0000","last_peered":"2024-09-10T06:24:42.849112+0000","last_clean":"2024-09-10T06:24:42.849112+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:24:42.849112+0000","last_undegraded":"2024-09-10T06:24:42.849112+0000","last_fullsized":"2024-09-10T06:24:42.849112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.697090+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:26:17.697090+0000","last_peered":"2024-09-10T06:26:17.697090+0000","last_clean":"2024-09-10T06:26:17.697090+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:26:17.697090+0000","last_undegraded":"2024-09-10T06:26:17.697090+0000","last_fullsized":"2024-09-10T06:26:17.697090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844360+0000","last_change":"2024-09-10T06:22:39.874607+0000","last_active":"2024-09-10T06:23:12.844360+0000","last_peered":"2024-09-10T06:23:12.844360+0000","last_clean":"2024-09-10T06:23:12.844360+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:23:12.844360+0000","last_undegraded":"2024-09-10T06:23:12.844360+0000","last_fullsized":"2024-09-10T06:23:12.844360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:21.914353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.408318+0000","last_change":"2024-09-10T06:22:41.876599+0000","last_active":"2024-09-10T06:25:46.408318+0000","last_peered":"2024-09-10T06:25:46.408318+0000","last_clean":"2024-09-10T06:25:46.408318+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:25:46.408318+0000","last_undegraded":"2024-09-10T06:25:46.408318+0000","last_fullsized":"2024-09-10T06:25:46.408318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:44.168045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.220282+0000","last_change":"2024-09-10T06:26:54.220282+0000","last_active":"2024-09-10T06:26:54.220282+0000","last_peered":"2024-09-10T06:26:54.220282+0000","last_clean":"2024-09-10T06:26:54.220282+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:26:54.220282+0000","last_undegraded":"2024-09-10T06:26:54.220282+0000","last_fullsized":"2024-09-10T06:26:54.220282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.220103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:38.687973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.062353+0000","last_change":"2024-09-10T06:26:23.062225+0000","last_active":"2024-09-10T06:26:23.062353+0000","last_peered":"2024-09-10T06:26:23.062353+0000","last_clean":"2024-09-10T06:26:23.062353+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:26:23.062353+0000","last_undegraded":"2024-09-10T06:26:23.062353+0000","last_fullsized":"2024-09-10T06:26:23.062353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.062051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:53.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.133509+0000","last_change":"2024-09-10T06:26:27.133378+0000","last_active":"2024-09-10T06:26:27.133509+0000","last_peered":"2024-09-10T06:26:27.133509+0000","last_clean":"2024-09-10T06:26:27.133509+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:26:27.133509+0000","last_undegraded":"2024-09-10T06:26:27.133509+0000","last_fullsized":"2024-09-10T06:26:27.133509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.133202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.725768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.858282+0000","last_change":"2024-09-10T06:22:35.827447+0000","last_active":"2024-09-10T06:24:48.858282+0000","last_peered":"2024-09-10T06:24:48.858282+0000","last_clean":"2024-09-10T06:24:48.858282+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:24:48.858282+0000","last_undegraded":"2024-09-10T06:24:48.858282+0000","last_fullsized":"2024-09-10T06:24:48.858282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'285","reported_seq":504,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.725817+0000","last_change":"2024-09-10T06:22:37.854177+0000","last_active":"2024-09-10T06:26:17.725817+0000","last_peered":"2024-09-10T06:26:17.725817+0000","last_clean":"2024-09-10T06:26:17.725817+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:26:17.725817+0000","last_undegraded":"2024-09-10T06:26:17.725817+0000","last_fullsized":"2024-09-10T06:26:17.725817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.858086+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:24:48.858086+0000","last_peered":"2024-09-10T06:24:48.858086+0000","last_clean":"2024-09-10T06:24:48.858086+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:24:48.858086+0000","last_undegraded":"2024-09-10T06:24:48.858086+0000","last_fullsized":"2024-09-10T06:24:48.858086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.160315+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:00.160315+0000","last_peered":"2024-09-10T06:24:00.160315+0000","last_clean":"2024-09-10T06:24:00.160315+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:00.160315+0000","last_undegraded":"2024-09-10T06:24:00.160315+0000","last_fullsized":"2024-09-10T06:24:00.160315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:50.342282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.938954+0000","last_change":"2024-09-10T06:26:37.938819+0000","last_active":"2024-09-10T06:26:37.938954+0000","last_peered":"2024-09-10T06:26:37.938954+0000","last_clean":"2024-09-10T06:26:37.938954+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:26:37.938954+0000","last_undegraded":"2024-09-10T06:26:37.938954+0000","last_fullsized":"2024-09-10T06:26:37.938954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.938636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:58.249435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.534176+0000","last_change":"2024-09-10T06:26:22.533999+0000","last_active":"2024-09-10T06:26:22.534176+0000","last_peered":"2024-09-10T06:26:22.534176+0000","last_clean":"2024-09-10T06:26:22.534176+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:26:22.534176+0000","last_undegraded":"2024-09-10T06:26:22.534176+0000","last_fullsized":"2024-09-10T06:26:22.534176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.533815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:40.223076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.986222+0000","last_change":"2024-09-10T06:26:32.986222+0000","last_active":"2024-09-10T06:26:32.986222+0000","last_peered":"2024-09-10T06:26:32.986222+0000","last_clean":"2024-09-10T06:26:32.986222+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:26:32.986222+0000","last_undegraded":"2024-09-10T06:26:32.986222+0000","last_fullsized":"2024-09-10T06:26:32.986222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.986038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:36.552236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.774001+0000","last_change":"2024-09-10T06:26:51.773755+0000","last_active":"2024-09-10T06:26:51.774001+0000","last_peered":"2024-09-10T06:26:51.774001+0000","last_clean":"2024-09-10T06:26:51.774001+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:26:51.774001+0000","last_undegraded":"2024-09-10T06:26:51.774001+0000","last_fullsized":"2024-09-10T06:26:51.774001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.773529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:00.851784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.865605+0000","last_change":"2024-09-10T06:26:57.865605+0000","last_active":"2024-09-10T06:26:57.865605+0000","last_peered":"2024-09-10T06:26:57.865605+0000","last_clean":"2024-09-10T06:26:57.865605+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:26:57.865605+0000","last_undegraded":"2024-09-10T06:26:57.865605+0000","last_fullsized":"2024-09-10T06:26:57.865605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.865375+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:00.148660+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.845129+0000","last_change":"2024-09-10T06:22:39.874540+0000","last_active":"2024-09-10T06:24:47.845129+0000","last_peered":"2024-09-10T06:24:47.845129+0000","last_clean":"2024-09-10T06:24:47.845129+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:24:47.845129+0000","last_undegraded":"2024-09-10T06:24:47.845129+0000","last_fullsized":"2024-09-10T06:24:47.845129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.290272+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.290272+0000","last_peered":"2024-09-10T06:25:46.290272+0000","last_clean":"2024-09-10T06:25:46.290272+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.290272+0000","last_undegraded":"2024-09-10T06:25:46.290272+0000","last_fullsized":"2024-09-10T06:25:46.290272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:04.752709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.937901+0000","last_change":"2024-09-10T06:26:35.937768+0000","last_active":"2024-09-10T06:26:35.937901+0000","last_peered":"2024-09-10T06:26:35.937901+0000","last_clean":"2024-09-10T06:26:35.937901+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:26:35.937901+0000","last_undegraded":"2024-09-10T06:26:35.937901+0000","last_fullsized":"2024-09-10T06:26:35.937901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.937562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:19.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.110596+0000","last_change":"2024-09-10T06:26:24.110300+0000","last_active":"2024-09-10T06:26:24.110596+0000","last_peered":"2024-09-10T06:26:24.110596+0000","last_clean":"2024-09-10T06:26:24.110596+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:26:24.110596+0000","last_undegraded":"2024-09-10T06:26:24.110596+0000","last_fullsized":"2024-09-10T06:26:24.110596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.110079+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:06.285600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.521768+0000","last_change":"2024-09-10T06:26:23.521588+0000","last_active":"2024-09-10T06:26:23.521768+0000","last_peered":"2024-09-10T06:26:23.521768+0000","last_clean":"2024-09-10T06:26:23.521768+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:26:23.521768+0000","last_undegraded":"2024-09-10T06:26:23.521768+0000","last_fullsized":"2024-09-10T06:26:23.521768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.521400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.804217+0000","last_change":"2024-09-10T06:26:47.804089+0000","last_active":"2024-09-10T06:26:47.804217+0000","last_peered":"2024-09-10T06:26:47.804217+0000","last_clean":"2024-09-10T06:26:47.804217+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:26:47.804217+0000","last_undegraded":"2024-09-10T06:26:47.804217+0000","last_fullsized":"2024-09-10T06:26:47.804217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.803914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:48.283325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.348701+0000","last_change":"2024-09-10T06:22:37.862236+0000","last_active":"2024-09-10T06:25:45.348701+0000","last_peered":"2024-09-10T06:25:45.348701+0000","last_clean":"2024-09-10T06:25:45.348701+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:25:45.348701+0000","last_undegraded":"2024-09-10T06:25:45.348701+0000","last_fullsized":"2024-09-10T06:25:45.348701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.852351+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:23:12.852351+0000","last_peered":"2024-09-10T06:23:12.852351+0000","last_clean":"2024-09-10T06:23:12.852351+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:23:12.852351+0000","last_undegraded":"2024-09-10T06:23:12.852351+0000","last_fullsized":"2024-09-10T06:23:12.852351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:16.549997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:44.851668+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:44.851668+0000","last_peered":"2024-09-10T06:24:44.851668+0000","last_clean":"2024-09-10T06:24:44.851668+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:44.851668+0000","last_undegraded":"2024-09-10T06:24:44.851668+0000","last_fullsized":"2024-09-10T06:24:44.851668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:52.726497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.689351+0000","last_change":"2024-09-10T06:26:35.689163+0000","last_active":"2024-09-10T06:26:35.689351+0000","last_peered":"2024-09-10T06:26:35.689351+0000","last_clean":"2024-09-10T06:26:35.689351+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:26:35.689351+0000","last_undegraded":"2024-09-10T06:26:35.689351+0000","last_fullsized":"2024-09-10T06:26:35.689351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.688987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:31.604105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.490317+0000","last_change":"2024-09-10T06:26:24.490106+0000","last_active":"2024-09-10T06:26:24.490317+0000","last_peered":"2024-09-10T06:26:24.490317+0000","last_clean":"2024-09-10T06:26:24.490317+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:26:24.490317+0000","last_undegraded":"2024-09-10T06:26:24.490317+0000","last_fullsized":"2024-09-10T06:26:24.490317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.489901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:12.908340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.051982+0000","last_change":"2024-09-10T06:26:22.051863+0000","last_active":"2024-09-10T06:26:22.051982+0000","last_peered":"2024-09-10T06:26:22.051982+0000","last_clean":"2024-09-10T06:26:22.051982+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:26:22.051982+0000","last_undegraded":"2024-09-10T06:26:22.051982+0000","last_fullsized":"2024-09-10T06:26:22.051982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.051670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:16.319555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.777642+0000","last_change":"2024-09-10T06:26:52.777642+0000","last_active":"2024-09-10T06:26:52.777642+0000","last_peered":"2024-09-10T06:26:52.777642+0000","last_clean":"2024-09-10T06:26:52.777642+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:26:52.777642+0000","last_undegraded":"2024-09-10T06:26:52.777642+0000","last_fullsized":"2024-09-10T06:26:52.777642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.777465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:35.701349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'69","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.633622+0000","last_change":"2024-09-10T06:22:37.854489+0000","last_active":"2024-09-10T06:26:17.633622+0000","last_peered":"2024-09-10T06:26:17.633622+0000","last_clean":"2024-09-10T06:26:17.633622+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:17.633622+0000","last_undegraded":"2024-09-10T06:26:17.633622+0000","last_fullsized":"2024-09-10T06:26:17.633622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.872989+0000","last_change":"2024-09-10T06:22:39.846133+0000","last_active":"2024-09-10T06:24:43.872989+0000","last_peered":"2024-09-10T06:24:43.872989+0000","last_clean":"2024-09-10T06:24:43.872989+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:24:43.872989+0000","last_undegraded":"2024-09-10T06:24:43.872989+0000","last_fullsized":"2024-09-10T06:24:43.872989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.152168+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:45.152168+0000","last_peered":"2024-09-10T06:24:45.152168+0000","last_clean":"2024-09-10T06:24:45.152168+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:45.152168+0000","last_undegraded":"2024-09-10T06:24:45.152168+0000","last_fullsized":"2024-09-10T06:24:45.152168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:03.105694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.722988+0000","last_change":"2024-09-10T06:26:36.722846+0000","last_active":"2024-09-10T06:26:36.722988+0000","last_peered":"2024-09-10T06:26:36.722988+0000","last_clean":"2024-09-10T06:26:36.722988+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:26:36.722988+0000","last_undegraded":"2024-09-10T06:26:36.722988+0000","last_fullsized":"2024-09-10T06:26:36.722988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.722678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:48.489772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.119809+0000","last_change":"2024-09-10T06:26:26.119665+0000","last_active":"2024-09-10T06:26:26.119809+0000","last_peered":"2024-09-10T06:26:26.119809+0000","last_clean":"2024-09-10T06:26:26.119809+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:26:26.119809+0000","last_undegraded":"2024-09-10T06:26:26.119809+0000","last_fullsized":"2024-09-10T06:26:26.119809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.119470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:37.159096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.160188+0000","last_change":"2024-09-10T06:26:26.160035+0000","last_active":"2024-09-10T06:26:26.160188+0000","last_peered":"2024-09-10T06:26:26.160188+0000","last_clean":"2024-09-10T06:26:26.160188+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:26:26.160188+0000","last_undegraded":"2024-09-10T06:26:26.160188+0000","last_fullsized":"2024-09-10T06:26:26.160188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.159855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:31.433358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"23'1","reported_seq":232,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.369714+0000","last_change":"2024-09-10T06:23:12.872333+0000","last_active":"2024-09-10T06:26:17.369714+0000","last_peered":"2024-09-10T06:26:17.369714+0000","last_clean":"2024-09-10T06:26:17.369714+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:26:17.369714+0000","last_undegraded":"2024-09-10T06:26:17.369714+0000","last_fullsized":"2024-09-10T06:26:17.369714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'16","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.849060+0000","last_change":"2024-09-10T06:22:37.854976+0000","last_active":"2024-09-10T06:24:42.849060+0000","last_peered":"2024-09-10T06:24:42.849060+0000","last_clean":"2024-09-10T06:24:42.849060+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:24:42.849060+0000","last_undegraded":"2024-09-10T06:24:42.849060+0000","last_fullsized":"2024-09-10T06:24:42.849060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":361,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.730711+0000","last_change":"2024-09-10T06:22:39.861337+0000","last_active":"2024-09-10T06:26:17.730711+0000","last_peered":"2024-09-10T06:26:17.730711+0000","last_clean":"2024-09-10T06:26:17.730711+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:26:17.730711+0000","last_undegraded":"2024-09-10T06:26:17.730711+0000","last_fullsized":"2024-09-10T06:26:17.730711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.443293+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.443293+0000","last_peered":"2024-09-10T06:25:45.443293+0000","last_clean":"2024-09-10T06:25:45.443293+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.443293+0000","last_undegraded":"2024-09-10T06:25:45.443293+0000","last_fullsized":"2024-09-10T06:25:45.443293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:55.232354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.209654+0000","last_change":"2024-09-10T06:26:50.209654+0000","last_active":"2024-09-10T06:26:50.209654+0000","last_peered":"2024-09-10T06:26:50.209654+0000","last_clean":"2024-09-10T06:26:50.209654+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:26:50.209654+0000","last_undegraded":"2024-09-10T06:26:50.209654+0000","last_fullsized":"2024-09-10T06:26:50.209654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.209478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:06.513527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.188162+0000","last_change":"2024-09-10T06:26:30.188003+0000","last_active":"2024-09-10T06:26:30.188162+0000","last_peered":"2024-09-10T06:26:30.188162+0000","last_clean":"2024-09-10T06:26:30.188162+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:26:30.188162+0000","last_undegraded":"2024-09-10T06:26:30.188162+0000","last_fullsized":"2024-09-10T06:26:30.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.187831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:12.704769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.007778+0000","last_change":"2024-09-10T06:26:21.007725+0000","last_active":"2024-09-10T06:26:21.007778+0000","last_peered":"2024-09-10T06:26:21.007778+0000","last_clean":"2024-09-10T06:26:21.007778+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:26:21.007778+0000","last_undegraded":"2024-09-10T06:26:21.007778+0000","last_fullsized":"2024-09-10T06:26:21.007778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.007653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:45.011060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.856894+0000","last_change":"2024-09-10T06:22:35.820479+0000","last_active":"2024-09-10T06:24:43.856894+0000","last_peered":"2024-09-10T06:24:43.856894+0000","last_clean":"2024-09-10T06:24:43.856894+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:24:43.856894+0000","last_undegraded":"2024-09-10T06:24:43.856894+0000","last_fullsized":"2024-09-10T06:24:43.856894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'11","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.405274+0000","last_change":"2024-09-10T06:22:37.862986+0000","last_active":"2024-09-10T06:25:46.405274+0000","last_peered":"2024-09-10T06:25:46.405274+0000","last_clean":"2024-09-10T06:25:46.405274+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:25:46.405274+0000","last_undegraded":"2024-09-10T06:25:46.405274+0000","last_fullsized":"2024-09-10T06:25:46.405274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.740599+0000","last_change":"2024-09-10T06:22:39.849096+0000","last_active":"2024-09-10T06:26:17.740599+0000","last_peered":"2024-09-10T06:26:17.740599+0000","last_clean":"2024-09-10T06:26:17.740599+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:26:17.740599+0000","last_undegraded":"2024-09-10T06:26:17.740599+0000","last_fullsized":"2024-09-10T06:26:17.740599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.854659+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:23:12.854659+0000","last_peered":"2024-09-10T06:23:12.854659+0000","last_clean":"2024-09-10T06:23:12.854659+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:23:12.854659+0000","last_undegraded":"2024-09-10T06:23:12.854659+0000","last_fullsized":"2024-09-10T06:23:12.854659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:51.319778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.502161+0000","last_change":"2024-09-10T06:26:35.501999+0000","last_active":"2024-09-10T06:26:35.502161+0000","last_peered":"2024-09-10T06:26:35.502161+0000","last_clean":"2024-09-10T06:26:35.502161+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:26:35.502161+0000","last_undegraded":"2024-09-10T06:26:35.502161+0000","last_fullsized":"2024-09-10T06:26:35.502161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.501822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:29.856717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.433328+0000","last_change":"2024-09-10T06:26:22.433192+0000","last_active":"2024-09-10T06:26:22.433328+0000","last_peered":"2024-09-10T06:26:22.433328+0000","last_clean":"2024-09-10T06:26:22.433328+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:26:22.433328+0000","last_undegraded":"2024-09-10T06:26:22.433328+0000","last_fullsized":"2024-09-10T06:26:22.433328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.433009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.297315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.163161+0000","last_change":"2024-09-10T06:26:28.163027+0000","last_active":"2024-09-10T06:26:28.163161+0000","last_peered":"2024-09-10T06:26:28.163161+0000","last_clean":"2024-09-10T06:26:28.163161+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:26:28.163161+0000","last_undegraded":"2024-09-10T06:26:28.163161+0000","last_fullsized":"2024-09-10T06:26:28.163161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.162858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:23.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.855842+0000","last_change":"2024-09-10T06:22:35.819593+0000","last_active":"2024-09-10T06:24:38.855842+0000","last_peered":"2024-09-10T06:24:38.855842+0000","last_clean":"2024-09-10T06:24:38.855842+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:24:38.855842+0000","last_undegraded":"2024-09-10T06:24:38.855842+0000","last_fullsized":"2024-09-10T06:24:38.855842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'99","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.822092+0000","last_change":"2024-09-10T06:26:58.822092+0000","last_active":"2024-09-10T06:26:58.822092+0000","last_peered":"2024-09-10T06:26:58.822092+0000","last_clean":"2024-09-10T06:26:58.822092+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:58.822092+0000","last_undegraded":"2024-09-10T06:26:58.822092+0000","last_fullsized":"2024-09-10T06:26:58.822092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.821871+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:30.069598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:47.845014+0000","last_change":"2024-09-10T06:22:39.863729+0000","last_active":"2024-09-10T06:24:47.845014+0000","last_peered":"2024-09-10T06:24:47.845014+0000","last_clean":"2024-09-10T06:24:47.845014+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:24:47.845014+0000","last_undegraded":"2024-09-10T06:24:47.845014+0000","last_fullsized":"2024-09-10T06:24:47.845014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.847958+0000","last_change":"2024-09-10T06:22:41.881112+0000","last_active":"2024-09-10T06:23:12.847958+0000","last_peered":"2024-09-10T06:23:12.847958+0000","last_clean":"2024-09-10T06:23:12.847958+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:23:12.847958+0000","last_undegraded":"2024-09-10T06:23:12.847958+0000","last_fullsized":"2024-09-10T06:23:12.847958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:25.826328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.874138+0000","last_change":"2024-09-10T06:22:41.876338+0000","last_active":"2024-09-10T06:24:48.874138+0000","last_peered":"2024-09-10T06:24:48.874138+0000","last_clean":"2024-09-10T06:24:48.874138+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:24:48.874138+0000","last_undegraded":"2024-09-10T06:24:48.874138+0000","last_fullsized":"2024-09-10T06:24:48.874138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.698211+0000","last_change":"2024-09-10T06:26:41.698211+0000","last_active":"2024-09-10T06:26:41.698211+0000","last_peered":"2024-09-10T06:26:41.698211+0000","last_clean":"2024-09-10T06:26:41.698211+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:26:41.698211+0000","last_undegraded":"2024-09-10T06:26:41.698211+0000","last_fullsized":"2024-09-10T06:26:41.698211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.698029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.247060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.306783+0000","last_change":"2024-09-10T06:26:37.306783+0000","last_active":"2024-09-10T06:26:37.306783+0000","last_peered":"2024-09-10T06:26:37.306783+0000","last_clean":"2024-09-10T06:26:37.306783+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:26:37.306783+0000","last_undegraded":"2024-09-10T06:26:37.306783+0000","last_fullsized":"2024-09-10T06:26:37.306783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.306607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:41.035747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.650913+0000","last_change":"2024-09-10T06:26:57.650913+0000","last_active":"2024-09-10T06:26:57.650913+0000","last_peered":"2024-09-10T06:26:57.650913+0000","last_clean":"2024-09-10T06:26:57.650913+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:26:57.650913+0000","last_undegraded":"2024-09-10T06:26:57.650913+0000","last_fullsized":"2024-09-10T06:26:57.650913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.650735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:08.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.710326+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:26:17.710326+0000","last_peered":"2024-09-10T06:26:17.710326+0000","last_clean":"2024-09-10T06:26:17.710326+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:26:17.710326+0000","last_undegraded":"2024-09-10T06:26:17.710326+0000","last_fullsized":"2024-09-10T06:26:17.710326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:26.288777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.874538+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.874538+0000","last_peered":"2024-09-10T06:24:42.874538+0000","last_clean":"2024-09-10T06:24:42.874538+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.874538+0000","last_undegraded":"2024-09-10T06:24:42.874538+0000","last_fullsized":"2024-09-10T06:24:42.874538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.686734+0000","last_change":"2024-09-10T06:26:40.686734+0000","last_active":"2024-09-10T06:26:40.686734+0000","last_peered":"2024-09-10T06:26:40.686734+0000","last_clean":"2024-09-10T06:26:40.686734+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:26:40.686734+0000","last_undegraded":"2024-09-10T06:26:40.686734+0000","last_fullsized":"2024-09-10T06:26:40.686734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.686561+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:13.693128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.467698+0000","last_change":"2024-09-10T06:26:27.467698+0000","last_active":"2024-09-10T06:26:27.467698+0000","last_peered":"2024-09-10T06:26:27.467698+0000","last_clean":"2024-09-10T06:26:27.467698+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:26:27.467698+0000","last_undegraded":"2024-09-10T06:26:27.467698+0000","last_fullsized":"2024-09-10T06:26:27.467698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.467505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:10.628970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.869488+0000","last_change":"2024-09-10T06:23:12.867412+0000","last_active":"2024-09-10T06:23:12.869488+0000","last_peered":"2024-09-10T06:23:12.869488+0000","last_clean":"2024-09-10T06:23:12.869488+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:23:12.869488+0000","last_undegraded":"2024-09-10T06:23:12.869488+0000","last_fullsized":"2024-09-10T06:23:12.869488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:36.393456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.328298+0000","last_change":"2024-09-10T06:22:37.830828+0000","last_active":"2024-09-10T06:25:45.328298+0000","last_peered":"2024-09-10T06:25:45.328298+0000","last_clean":"2024-09-10T06:25:45.328298+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:25:45.328298+0000","last_undegraded":"2024-09-10T06:25:45.328298+0000","last_fullsized":"2024-09-10T06:25:45.328298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:07.091562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843216+0000","last_change":"2024-09-10T06:22:39.848395+0000","last_active":"2024-09-10T06:23:12.843216+0000","last_peered":"2024-09-10T06:23:12.843216+0000","last_clean":"2024-09-10T06:23:12.843216+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:23:12.843216+0000","last_undegraded":"2024-09-10T06:23:12.843216+0000","last_fullsized":"2024-09-10T06:23:12.843216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:09.006172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.840670+0000","last_change":"2024-09-10T06:26:42.840670+0000","last_active":"2024-09-10T06:26:42.840670+0000","last_peered":"2024-09-10T06:26:42.840670+0000","last_clean":"2024-09-10T06:26:42.840670+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:26:42.840670+0000","last_undegraded":"2024-09-10T06:26:42.840670+0000","last_fullsized":"2024-09-10T06:26:42.840670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.840563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:01.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.412608+0000","last_change":"2024-09-10T06:26:30.412608+0000","last_active":"2024-09-10T06:26:30.412608+0000","last_peered":"2024-09-10T06:26:30.412608+0000","last_clean":"2024-09-10T06:26:30.412608+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:26:30.412608+0000","last_undegraded":"2024-09-10T06:26:30.412608+0000","last_fullsized":"2024-09-10T06:26:30.412608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.412443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:27.375871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.706775+0000","last_change":"2024-09-10T06:26:53.706775+0000","last_active":"2024-09-10T06:26:53.706775+0000","last_peered":"2024-09-10T06:26:53.706775+0000","last_clean":"2024-09-10T06:26:53.706775+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:26:53.706775+0000","last_undegraded":"2024-09-10T06:26:53.706775+0000","last_fullsized":"2024-09-10T06:26:53.706775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.706565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:21.763699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.868369+0000","last_change":"2024-09-10T06:26:55.868369+0000","last_active":"2024-09-10T06:26:55.868369+0000","last_peered":"2024-09-10T06:26:55.868369+0000","last_clean":"2024-09-10T06:26:55.868369+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:55.868369+0000","last_undegraded":"2024-09-10T06:26:55.868369+0000","last_fullsized":"2024-09-10T06:26:55.868369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.868167+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:51.332406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.841932+0000","last_change":"2024-09-10T06:22:39.860162+0000","last_active":"2024-09-10T06:23:12.841932+0000","last_peered":"2024-09-10T06:23:12.841932+0000","last_clean":"2024-09-10T06:23:12.841932+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:23:12.841932+0000","last_undegraded":"2024-09-10T06:23:12.841932+0000","last_fullsized":"2024-09-10T06:23:12.841932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.197236+0000","last_change":"2024-09-10T06:26:56.197236+0000","last_active":"2024-09-10T06:26:56.197236+0000","last_peered":"2024-09-10T06:26:56.197236+0000","last_clean":"2024-09-10T06:26:56.197236+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:26:56.197236+0000","last_undegraded":"2024-09-10T06:26:56.197236+0000","last_fullsized":"2024-09-10T06:26:56.197236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.197045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:27.788695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.483285+0000","last_change":"2024-09-10T06:26:24.483285+0000","last_active":"2024-09-10T06:26:24.483285+0000","last_peered":"2024-09-10T06:26:24.483285+0000","last_clean":"2024-09-10T06:26:24.483285+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:26:24.483285+0000","last_undegraded":"2024-09-10T06:26:24.483285+0000","last_fullsized":"2024-09-10T06:26:24.483285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.483039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:30.019052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845725+0000","last_change":"2024-09-10T06:22:35.828039+0000","last_active":"2024-09-10T06:23:12.845725+0000","last_peered":"2024-09-10T06:23:12.845725+0000","last_clean":"2024-09-10T06:23:12.845725+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:23:12.845725+0000","last_undegraded":"2024-09-10T06:23:12.845725+0000","last_fullsized":"2024-09-10T06:23:12.845725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:58.234193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.584254+0000","last_change":"2024-09-10T06:22:37.829063+0000","last_active":"2024-09-10T06:26:17.584254+0000","last_peered":"2024-09-10T06:26:17.584254+0000","last_clean":"2024-09-10T06:26:17.584254+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:26:17.584254+0000","last_undegraded":"2024-09-10T06:26:17.584254+0000","last_fullsized":"2024-09-10T06:26:17.584254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:45.497612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.850768+0000","last_change":"2024-09-10T06:22:39.856106+0000","last_active":"2024-09-10T06:23:12.850768+0000","last_peered":"2024-09-10T06:23:12.850768+0000","last_clean":"2024-09-10T06:23:12.850768+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:23:12.850768+0000","last_undegraded":"2024-09-10T06:23:12.850768+0000","last_fullsized":"2024-09-10T06:23:12.850768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:22.774573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856367+0000","last_change":"2024-09-10T06:22:33.814824+0000","last_active":"2024-09-10T06:24:38.856367+0000","last_peered":"2024-09-10T06:24:38.856367+0000","last_clean":"2024-09-10T06:24:38.856367+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:24:38.856367+0000","last_undegraded":"2024-09-10T06:24:38.856367+0000","last_fullsized":"2024-09-10T06:24:38.856367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.321035+0000","last_change":"2024-09-10T06:26:38.321035+0000","last_active":"2024-09-10T06:26:38.321035+0000","last_peered":"2024-09-10T06:26:38.321035+0000","last_clean":"2024-09-10T06:26:38.321035+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:26:38.321035+0000","last_undegraded":"2024-09-10T06:26:38.321035+0000","last_fullsized":"2024-09-10T06:26:38.321035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.320842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:44.932697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:37.842857+0000","last_change":"2024-09-10T06:22:35.822184+0000","last_active":"2024-09-10T06:24:37.842857+0000","last_peered":"2024-09-10T06:24:37.842857+0000","last_clean":"2024-09-10T06:24:37.842857+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:24:37.842857+0000","last_undegraded":"2024-09-10T06:24:37.842857+0000","last_fullsized":"2024-09-10T06:24:37.842857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'60","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.574533+0000","last_change":"2024-09-10T06:22:37.830120+0000","last_active":"2024-09-10T06:26:17.574533+0000","last_peered":"2024-09-10T06:26:17.574533+0000","last_clean":"2024-09-10T06:26:17.574533+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:17.574533+0000","last_undegraded":"2024-09-10T06:26:17.574533+0000","last_fullsized":"2024-09-10T06:26:17.574533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:47.211732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.851037+0000","last_change":"2024-09-10T06:22:39.848736+0000","last_active":"2024-09-10T06:23:12.851037+0000","last_peered":"2024-09-10T06:23:12.851037+0000","last_clean":"2024-09-10T06:23:12.851037+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:23:12.851037+0000","last_undegraded":"2024-09-10T06:23:12.851037+0000","last_fullsized":"2024-09-10T06:23:12.851037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:11.240979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.985592+0000","last_change":"2024-09-10T06:26:33.985592+0000","last_active":"2024-09-10T06:26:33.985592+0000","last_peered":"2024-09-10T06:26:33.985592+0000","last_clean":"2024-09-10T06:26:33.985592+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:26:33.985592+0000","last_undegraded":"2024-09-10T06:26:33.985592+0000","last_fullsized":"2024-09-10T06:26:33.985592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.985394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.488251+0000","last_change":"2024-09-10T06:26:25.488251+0000","last_active":"2024-09-10T06:26:25.488251+0000","last_peered":"2024-09-10T06:26:25.488251+0000","last_clean":"2024-09-10T06:26:25.488251+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:26:25.488251+0000","last_undegraded":"2024-09-10T06:26:25.488251+0000","last_fullsized":"2024-09-10T06:26:25.488251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.488065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:13.168721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.813155+0000","last_change":"2024-09-10T06:26:56.813155+0000","last_active":"2024-09-10T06:26:56.813155+0000","last_peered":"2024-09-10T06:26:56.813155+0000","last_clean":"2024-09-10T06:26:56.813155+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:56.813155+0000","last_undegraded":"2024-09-10T06:26:56.813155+0000","last_fullsized":"2024-09-10T06:26:56.813155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.812957+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:18.279075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.592680+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:26:17.592680+0000","last_peered":"2024-09-10T06:26:17.592680+0000","last_clean":"2024-09-10T06:26:17.592680+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:26:17.592680+0000","last_undegraded":"2024-09-10T06:26:17.592680+0000","last_fullsized":"2024-09-10T06:26:17.592680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.863319+0000","last_change":"2024-09-10T06:22:39.877024+0000","last_active":"2024-09-10T06:23:12.863319+0000","last_peered":"2024-09-10T06:23:12.863319+0000","last_clean":"2024-09-10T06:23:12.863319+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:23:12.863319+0000","last_undegraded":"2024-09-10T06:23:12.863319+0000","last_fullsized":"2024-09-10T06:23:12.863319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:00.620035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'15","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.331568+0000","last_change":"2024-09-10T06:22:33.837034+0000","last_active":"2024-09-10T06:25:46.331568+0000","last_peered":"2024-09-10T06:25:46.331568+0000","last_clean":"2024-09-10T06:25:46.331568+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:25:46.331568+0000","last_undegraded":"2024-09-10T06:25:46.331568+0000","last_fullsized":"2024-09-10T06:25:46.331568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:17.540245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.472997+0000","last_change":"2024-09-10T06:26:26.472997+0000","last_active":"2024-09-10T06:26:26.472997+0000","last_peered":"2024-09-10T06:26:26.472997+0000","last_clean":"2024-09-10T06:26:26.472997+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:26:26.472997+0000","last_undegraded":"2024-09-10T06:26:26.472997+0000","last_fullsized":"2024-09-10T06:26:26.472997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.472822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:54.495647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.792297+0000","last_change":"2024-09-10T06:26:55.792297+0000","last_active":"2024-09-10T06:26:55.792297+0000","last_peered":"2024-09-10T06:26:55.792297+0000","last_clean":"2024-09-10T06:26:55.792297+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:26:55.792297+0000","last_undegraded":"2024-09-10T06:26:55.792297+0000","last_fullsized":"2024-09-10T06:26:55.792297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.792027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:33.611842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'36","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.472439+0000","last_change":"2024-09-10T06:22:37.830486+0000","last_active":"2024-09-10T06:26:17.472439+0000","last_peered":"2024-09-10T06:26:17.472439+0000","last_clean":"2024-09-10T06:26:17.472439+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:17.472439+0000","last_undegraded":"2024-09-10T06:26:17.472439+0000","last_fullsized":"2024-09-10T06:26:17.472439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.843970+0000","last_change":"2024-09-10T06:22:39.856459+0000","last_active":"2024-09-10T06:24:42.843970+0000","last_peered":"2024-09-10T06:24:42.843970+0000","last_clean":"2024-09-10T06:24:42.843970+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:24:42.843970+0000","last_undegraded":"2024-09-10T06:24:42.843970+0000","last_fullsized":"2024-09-10T06:24:42.843970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.845005+0000","last_change":"2024-09-10T06:26:41.845005+0000","last_active":"2024-09-10T06:26:41.845005+0000","last_peered":"2024-09-10T06:26:41.845005+0000","last_clean":"2024-09-10T06:26:41.845005+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:26:41.845005+0000","last_undegraded":"2024-09-10T06:26:41.845005+0000","last_fullsized":"2024-09-10T06:26:41.845005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.844823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:18.354085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.271903+0000","last_change":"2024-09-10T06:26:40.271903+0000","last_active":"2024-09-10T06:26:40.271903+0000","last_peered":"2024-09-10T06:26:40.271903+0000","last_clean":"2024-09-10T06:26:40.271903+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:26:40.271903+0000","last_undegraded":"2024-09-10T06:26:40.271903+0000","last_fullsized":"2024-09-10T06:26:40.271903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.271701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.922441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.861904+0000","last_change":"2024-09-10T06:22:35.827032+0000","last_active":"2024-09-10T06:23:12.861904+0000","last_peered":"2024-09-10T06:23:12.861904+0000","last_clean":"2024-09-10T06:23:12.861904+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:23:12.861904+0000","last_undegraded":"2024-09-10T06:23:12.861904+0000","last_fullsized":"2024-09-10T06:23:12.861904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:49.922300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856277+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:24:38.856277+0000","last_peered":"2024-09-10T06:24:38.856277+0000","last_clean":"2024-09-10T06:24:38.856277+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:24:38.856277+0000","last_undegraded":"2024-09-10T06:24:38.856277+0000","last_fullsized":"2024-09-10T06:24:38.856277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":423,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.728117+0000","last_change":"2024-09-10T06:22:39.875817+0000","last_active":"2024-09-10T06:26:17.728117+0000","last_peered":"2024-09-10T06:26:17.728117+0000","last_clean":"2024-09-10T06:26:17.728117+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:26:17.728117+0000","last_undegraded":"2024-09-10T06:26:17.728117+0000","last_fullsized":"2024-09-10T06:26:17.728117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.766249+0000","last_change":"2024-09-10T06:26:43.766249+0000","last_active":"2024-09-10T06:26:43.766249+0000","last_peered":"2024-09-10T06:26:43.766249+0000","last_clean":"2024-09-10T06:26:43.766249+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:26:43.766249+0000","last_undegraded":"2024-09-10T06:26:43.766249+0000","last_fullsized":"2024-09-10T06:26:43.766249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.766065+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:03.179883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.514686+0000","last_change":"2024-09-10T06:26:27.514686+0000","last_active":"2024-09-10T06:26:27.514686+0000","last_peered":"2024-09-10T06:26:27.514686+0000","last_clean":"2024-09-10T06:26:27.514686+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:26:27.514686+0000","last_undegraded":"2024-09-10T06:26:27.514686+0000","last_fullsized":"2024-09-10T06:26:27.514686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.514477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:51.644214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844008+0000","last_change":"2024-09-10T06:22:35.833008+0000","last_active":"2024-09-10T06:23:12.844008+0000","last_peered":"2024-09-10T06:23:12.844008+0000","last_clean":"2024-09-10T06:23:12.844008+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:23:12.844008+0000","last_undegraded":"2024-09-10T06:23:12.844008+0000","last_fullsized":"2024-09-10T06:23:12.844008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:36.743768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'40","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.520329+0000","last_change":"2024-09-10T06:22:37.842924+0000","last_active":"2024-09-10T06:26:17.520329+0000","last_peered":"2024-09-10T06:26:17.520329+0000","last_clean":"2024-09-10T06:26:17.520329+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:26:17.520329+0000","last_undegraded":"2024-09-10T06:26:17.520329+0000","last_fullsized":"2024-09-10T06:26:17.520329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:30.428322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.838319+0000","last_change":"2024-09-10T06:22:39.852052+0000","last_active":"2024-09-10T06:23:12.838319+0000","last_peered":"2024-09-10T06:23:12.838319+0000","last_clean":"2024-09-10T06:23:12.838319+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:23:12.838319+0000","last_undegraded":"2024-09-10T06:23:12.838319+0000","last_fullsized":"2024-09-10T06:23:12.838319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.818568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.853350+0000","last_change":"2024-09-10T06:26:48.853350+0000","last_active":"2024-09-10T06:26:48.853350+0000","last_peered":"2024-09-10T06:26:48.853350+0000","last_clean":"2024-09-10T06:26:48.853350+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:26:48.853350+0000","last_undegraded":"2024-09-10T06:26:48.853350+0000","last_fullsized":"2024-09-10T06:26:48.853350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.853173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.980423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.320847+0000","last_change":"2024-09-10T06:26:39.320847+0000","last_active":"2024-09-10T06:26:39.320847+0000","last_peered":"2024-09-10T06:26:39.320847+0000","last_clean":"2024-09-10T06:26:39.320847+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:26:39.320847+0000","last_undegraded":"2024-09-10T06:26:39.320847+0000","last_fullsized":"2024-09-10T06:26:39.320847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.320667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:50.205168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.748950+0000","last_change":"2024-09-10T06:26:54.748950+0000","last_active":"2024-09-10T06:26:54.748950+0000","last_peered":"2024-09-10T06:26:54.748950+0000","last_clean":"2024-09-10T06:26:54.748950+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:26:54.748950+0000","last_undegraded":"2024-09-10T06:26:54.748950+0000","last_fullsized":"2024-09-10T06:26:54.748950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.748750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:36.180223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.529209+0000","last_change":"2024-09-10T06:22:37.832200+0000","last_active":"2024-09-10T06:26:17.529209+0000","last_peered":"2024-09-10T06:26:17.529209+0000","last_clean":"2024-09-10T06:26:17.529209+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:26:17.529209+0000","last_undegraded":"2024-09-10T06:26:17.529209+0000","last_fullsized":"2024-09-10T06:26:17.529209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:39.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.101302+0000","last_change":"2024-09-10T06:22:33.814209+0000","last_active":"2024-09-10T06:24:41.101302+0000","last_peered":"2024-09-10T06:24:41.101302+0000","last_clean":"2024-09-10T06:24:41.101302+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:24:41.101302+0000","last_undegraded":"2024-09-10T06:24:41.101302+0000","last_fullsized":"2024-09-10T06:24:41.101302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:00.082406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.100568+0000","last_change":"2024-09-10T06:26:24.100296+0000","last_active":"2024-09-10T06:26:24.100568+0000","last_peered":"2024-09-10T06:26:24.100568+0000","last_clean":"2024-09-10T06:26:24.100568+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:26:24.100568+0000","last_undegraded":"2024-09-10T06:26:24.100568+0000","last_fullsized":"2024-09-10T06:26:24.100568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.100028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:50.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.844155+0000","last_change":"2024-09-10T06:22:35.836069+0000","last_active":"2024-09-10T06:23:12.844155+0000","last_peered":"2024-09-10T06:23:12.844155+0000","last_clean":"2024-09-10T06:23:12.844155+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:23:12.844155+0000","last_undegraded":"2024-09-10T06:23:12.844155+0000","last_fullsized":"2024-09-10T06:23:12.844155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:00.796858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.457971+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:26:17.457971+0000","last_peered":"2024-09-10T06:26:17.457971+0000","last_clean":"2024-09-10T06:26:17.457971+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:26:17.457971+0000","last_undegraded":"2024-09-10T06:26:17.457971+0000","last_fullsized":"2024-09-10T06:26:17.457971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.677762+0000","last_change":"2024-09-10T06:26:40.677762+0000","last_active":"2024-09-10T06:26:40.677762+0000","last_peered":"2024-09-10T06:26:40.677762+0000","last_clean":"2024-09-10T06:26:40.677762+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:26:40.677762+0000","last_undegraded":"2024-09-10T06:26:40.677762+0000","last_fullsized":"2024-09-10T06:26:40.677762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.677546+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:35.665500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.482430+0000","last_change":"2024-09-10T06:26:28.482269+0000","last_active":"2024-09-10T06:26:28.482430+0000","last_peered":"2024-09-10T06:26:28.482430+0000","last_clean":"2024-09-10T06:26:28.482430+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:26:28.482430+0000","last_undegraded":"2024-09-10T06:26:28.482430+0000","last_fullsized":"2024-09-10T06:26:28.482430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.482098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:08.791707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:41.613650+0000","last_change":"2024-09-10T06:22:35.836495+0000","last_active":"2024-09-10T06:24:41.613650+0000","last_peered":"2024-09-10T06:24:41.613650+0000","last_clean":"2024-09-10T06:24:41.613650+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:24:41.613650+0000","last_undegraded":"2024-09-10T06:24:41.613650+0000","last_fullsized":"2024-09-10T06:24:41.613650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:34.787291+0000","last_clean_scrub_stamp":"2024-09-10T06:22:34.787291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:39.725479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.476533+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:26:17.476533+0000","last_peered":"2024-09-10T06:26:17.476533+0000","last_clean":"2024-09-10T06:26:17.476533+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:26:17.476533+0000","last_undegraded":"2024-09-10T06:26:17.476533+0000","last_fullsized":"2024-09-10T06:26:17.476533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.843200+0000","last_change":"2024-09-10T06:22:39.852286+0000","last_active":"2024-09-10T06:23:12.843200+0000","last_peered":"2024-09-10T06:23:12.843200+0000","last_clean":"2024-09-10T06:23:12.843200+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:23:12.843200+0000","last_undegraded":"2024-09-10T06:23:12.843200+0000","last_fullsized":"2024-09-10T06:23:12.843200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:57.990237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.779775+0000","last_change":"2024-09-10T06:26:43.779653+0000","last_active":"2024-09-10T06:26:43.779775+0000","last_peered":"2024-09-10T06:26:43.779775+0000","last_clean":"2024-09-10T06:26:43.779775+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:26:43.779775+0000","last_undegraded":"2024-09-10T06:26:43.779775+0000","last_fullsized":"2024-09-10T06:26:43.779775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.779476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:31.036552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.433609+0000","last_change":"2024-09-10T06:26:29.433336+0000","last_active":"2024-09-10T06:26:29.433609+0000","last_peered":"2024-09-10T06:26:29.433609+0000","last_clean":"2024-09-10T06:26:29.433609+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:26:29.433609+0000","last_undegraded":"2024-09-10T06:26:29.433609+0000","last_fullsized":"2024-09-10T06:26:29.433609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.433088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:15.744029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.839137+0000","last_change":"2024-09-10T06:26:45.838993+0000","last_active":"2024-09-10T06:26:45.839137+0000","last_peered":"2024-09-10T06:26:45.839137+0000","last_clean":"2024-09-10T06:26:45.839137+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:26:45.839137+0000","last_undegraded":"2024-09-10T06:26:45.839137+0000","last_fullsized":"2024-09-10T06:26:45.839137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.838814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:56.402021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.047162+0000","last_change":"2024-09-10T06:26:29.046913+0000","last_active":"2024-09-10T06:26:29.047162+0000","last_peered":"2024-09-10T06:26:29.047162+0000","last_clean":"2024-09-10T06:26:29.047162+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:26:29.047162+0000","last_undegraded":"2024-09-10T06:26:29.047162+0000","last_fullsized":"2024-09-10T06:26:29.047162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.046701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:29.715468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.781486+0000","last_change":"2024-09-10T06:26:44.781486+0000","last_active":"2024-09-10T06:26:44.781486+0000","last_peered":"2024-09-10T06:26:44.781486+0000","last_clean":"2024-09-10T06:26:44.781486+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:26:44.781486+0000","last_undegraded":"2024-09-10T06:26:44.781486+0000","last_fullsized":"2024-09-10T06:26:44.781486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.781299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:57.451138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.302408+0000","last_change":"2024-09-10T06:26:41.302121+0000","last_active":"2024-09-10T06:26:41.302408+0000","last_peered":"2024-09-10T06:26:41.302408+0000","last_clean":"2024-09-10T06:26:41.302408+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:26:41.302408+0000","last_undegraded":"2024-09-10T06:26:41.302408+0000","last_fullsized":"2024-09-10T06:26:41.302408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.301927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:41.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.808725+0000","last_change":"2024-09-10T06:26:46.808544+0000","last_active":"2024-09-10T06:26:46.808725+0000","last_peered":"2024-09-10T06:26:46.808725+0000","last_clean":"2024-09-10T06:26:46.808725+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:26:46.808725+0000","last_undegraded":"2024-09-10T06:26:46.808725+0000","last_fullsized":"2024-09-10T06:26:46.808725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.808370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:30.378145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.079366+0000","last_change":"2024-09-10T06:26:25.079186+0000","last_active":"2024-09-10T06:26:25.079366+0000","last_peered":"2024-09-10T06:26:25.079366+0000","last_clean":"2024-09-10T06:26:25.079366+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:26:25.079366+0000","last_undegraded":"2024-09-10T06:26:25.079366+0000","last_fullsized":"2024-09-10T06:26:25.079366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.079003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:58.821283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.891740+0000","last_change":"2024-09-10T06:26:40.891588+0000","last_active":"2024-09-10T06:26:40.891740+0000","last_peered":"2024-09-10T06:26:40.891740+0000","last_clean":"2024-09-10T06:26:40.891740+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:26:40.891740+0000","last_undegraded":"2024-09-10T06:26:40.891740+0000","last_fullsized":"2024-09-10T06:26:40.891740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.891412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:16.731907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.995214+0000","last_change":"2024-09-10T06:26:31.995009+0000","last_active":"2024-09-10T06:26:31.995214+0000","last_peered":"2024-09-10T06:26:31.995214+0000","last_clean":"2024-09-10T06:26:31.995214+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:26:31.995214+0000","last_undegraded":"2024-09-10T06:26:31.995214+0000","last_fullsized":"2024-09-10T06:26:31.995214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.994787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:49.297894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.735118+0000","last_change":"2024-09-10T06:26:42.734856+0000","last_active":"2024-09-10T06:26:42.735118+0000","last_peered":"2024-09-10T06:26:42.735118+0000","last_clean":"2024-09-10T06:26:42.735118+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:26:42.735118+0000","last_undegraded":"2024-09-10T06:26:42.735118+0000","last_fullsized":"2024-09-10T06:26:42.735118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.734628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:25.938010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.497928+0000","last_change":"2024-09-10T06:26:29.497669+0000","last_active":"2024-09-10T06:26:29.497928+0000","last_peered":"2024-09-10T06:26:29.497928+0000","last_clean":"2024-09-10T06:26:29.497928+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:26:29.497928+0000","last_undegraded":"2024-09-10T06:26:29.497928+0000","last_fullsized":"2024-09-10T06:26:29.497928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.497454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:45.426363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.888535+0000","last_change":"2024-09-10T06:26:43.888535+0000","last_active":"2024-09-10T06:26:43.888535+0000","last_peered":"2024-09-10T06:26:43.888535+0000","last_clean":"2024-09-10T06:26:43.888535+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:26:43.888535+0000","last_undegraded":"2024-09-10T06:26:43.888535+0000","last_fullsized":"2024-09-10T06:26:43.888535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.888359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:39.822929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.393901+0000","last_change":"2024-09-10T06:26:31.393760+0000","last_active":"2024-09-10T06:26:31.393901+0000","last_peered":"2024-09-10T06:26:31.393901+0000","last_clean":"2024-09-10T06:26:31.393901+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:26:31.393901+0000","last_undegraded":"2024-09-10T06:26:31.393901+0000","last_fullsized":"2024-09-10T06:26:31.393901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.393581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:26.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.725882+0000","last_change":"2024-09-10T06:26:41.725569+0000","last_active":"2024-09-10T06:26:41.725882+0000","last_peered":"2024-09-10T06:26:41.725882+0000","last_clean":"2024-09-10T06:26:41.725882+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:26:41.725882+0000","last_undegraded":"2024-09-10T06:26:41.725882+0000","last_fullsized":"2024-09-10T06:26:41.725882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.725350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:08.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.946847+0000","last_change":"2024-09-10T06:26:34.946711+0000","last_active":"2024-09-10T06:26:34.946847+0000","last_peered":"2024-09-10T06:26:34.946847+0000","last_clean":"2024-09-10T06:26:34.946847+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:26:34.946847+0000","last_undegraded":"2024-09-10T06:26:34.946847+0000","last_fullsized":"2024-09-10T06:26:34.946847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.946534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:24.024731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.734871+0000","last_change":"2024-09-10T06:26:48.734871+0000","last_active":"2024-09-10T06:26:48.734871+0000","last_peered":"2024-09-10T06:26:48.734871+0000","last_clean":"2024-09-10T06:26:48.734871+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:26:48.734871+0000","last_undegraded":"2024-09-10T06:26:48.734871+0000","last_fullsized":"2024-09-10T06:26:48.734871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.734684+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.243947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.259823+0000","last_change":"2024-09-10T06:26:42.259572+0000","last_active":"2024-09-10T06:26:42.259823+0000","last_peered":"2024-09-10T06:26:42.259823+0000","last_clean":"2024-09-10T06:26:42.259823+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:26:42.259823+0000","last_undegraded":"2024-09-10T06:26:42.259823+0000","last_fullsized":"2024-09-10T06:26:42.259823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.259331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:33.896423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.155407+0000","last_change":"2024-09-10T06:22:33.846598+0000","last_active":"2024-09-10T06:24:00.155407+0000","last_peered":"2024-09-10T06:24:00.155407+0000","last_clean":"2024-09-10T06:24:00.155407+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:24:00.155407+0000","last_undegraded":"2024-09-10T06:24:00.155407+0000","last_fullsized":"2024-09-10T06:24:00.155407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:32.783175+0000","last_clean_scrub_stamp":"2024-09-10T06:22:32.783175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:51.493151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.928711+0000","last_change":"2024-09-10T06:26:39.928711+0000","last_active":"2024-09-10T06:26:39.928711+0000","last_peered":"2024-09-10T06:26:39.928711+0000","last_clean":"2024-09-10T06:26:39.928711+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:26:39.928711+0000","last_undegraded":"2024-09-10T06:26:39.928711+0000","last_fullsized":"2024-09-10T06:26:39.928711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.928507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:38.868895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.881074+0000","last_change":"2024-09-10T06:26:44.881074+0000","last_active":"2024-09-10T06:26:44.881074+0000","last_peered":"2024-09-10T06:26:44.881074+0000","last_clean":"2024-09-10T06:26:44.881074+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:26:44.881074+0000","last_undegraded":"2024-09-10T06:26:44.881074+0000","last_fullsized":"2024-09-10T06:26:44.881074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.880889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:04.889584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.509659+0000","last_change":"2024-09-10T06:26:30.509659+0000","last_active":"2024-09-10T06:26:30.509659+0000","last_peered":"2024-09-10T06:26:30.509659+0000","last_clean":"2024-09-10T06:26:30.509659+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:26:30.509659+0000","last_undegraded":"2024-09-10T06:26:30.509659+0000","last_fullsized":"2024-09-10T06:26:30.509659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.509470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:04.251749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.757058+0000","last_change":"2024-09-10T06:26:47.757058+0000","last_active":"2024-09-10T06:26:47.757058+0000","last_peered":"2024-09-10T06:26:47.757058+0000","last_clean":"2024-09-10T06:26:47.757058+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:26:47.757058+0000","last_undegraded":"2024-09-10T06:26:47.757058+0000","last_fullsized":"2024-09-10T06:26:47.757058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.756834+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:23.597329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.629278+0000","last_change":"2024-09-10T06:26:33.629278+0000","last_active":"2024-09-10T06:26:33.629278+0000","last_peered":"2024-09-10T06:26:33.629278+0000","last_clean":"2024-09-10T06:26:33.629278+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:26:33.629278+0000","last_undegraded":"2024-09-10T06:26:33.629278+0000","last_fullsized":"2024-09-10T06:26:33.629278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.629098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:15.221664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.753129+0000","last_change":"2024-09-10T06:26:46.753129+0000","last_active":"2024-09-10T06:26:46.753129+0000","last_peered":"2024-09-10T06:26:46.753129+0000","last_clean":"2024-09-10T06:26:46.753129+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:26:46.753129+0000","last_undegraded":"2024-09-10T06:26:46.753129+0000","last_fullsized":"2024-09-10T06:26:46.753129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.752953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:45.693341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.245879+0000","last_change":"2024-09-10T06:26:43.245879+0000","last_active":"2024-09-10T06:26:43.245879+0000","last_peered":"2024-09-10T06:26:43.245879+0000","last_clean":"2024-09-10T06:26:43.245879+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:26:43.245879+0000","last_undegraded":"2024-09-10T06:26:43.245879+0000","last_fullsized":"2024-09-10T06:26:43.245879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.245659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.348752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.746074+0000","last_change":"2024-09-10T06:26:45.746074+0000","last_active":"2024-09-10T06:26:45.746074+0000","last_peered":"2024-09-10T06:26:45.746074+0000","last_clean":"2024-09-10T06:26:45.746074+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:26:45.746074+0000","last_undegraded":"2024-09-10T06:26:45.746074+0000","last_fullsized":"2024-09-10T06:26:45.746074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.745895+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:13.731142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.218872+0000","last_change":"2024-09-10T06:26:44.218872+0000","last_active":"2024-09-10T06:26:44.218872+0000","last_peered":"2024-09-10T06:26:44.218872+0000","last_clean":"2024-09-10T06:26:44.218872+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:26:44.218872+0000","last_undegraded":"2024-09-10T06:26:44.218872+0000","last_fullsized":"2024-09-10T06:26:44.218872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.218685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:25.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.827937+0000","last_change":"2024-09-10T06:26:46.827937+0000","last_active":"2024-09-10T06:26:46.827937+0000","last_peered":"2024-09-10T06:26:46.827937+0000","last_clean":"2024-09-10T06:26:46.827937+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:26:46.827937+0000","last_undegraded":"2024-09-10T06:26:46.827937+0000","last_fullsized":"2024-09-10T06:26:46.827937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.827760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:10.751238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.549201+0000","last_change":"2024-09-10T06:26:36.549201+0000","last_active":"2024-09-10T06:26:36.549201+0000","last_peered":"2024-09-10T06:26:36.549201+0000","last_clean":"2024-09-10T06:26:36.549201+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:26:36.549201+0000","last_undegraded":"2024-09-10T06:26:36.549201+0000","last_fullsized":"2024-09-10T06:26:36.549201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.549021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:42.805736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.754846+0000","last_change":"2024-09-10T06:26:44.754694+0000","last_active":"2024-09-10T06:26:44.754846+0000","last_peered":"2024-09-10T06:26:44.754846+0000","last_clean":"2024-09-10T06:26:44.754846+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:26:44.754846+0000","last_undegraded":"2024-09-10T06:26:44.754846+0000","last_fullsized":"2024-09-10T06:26:44.754846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.754512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:05.065310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.239130+0000","last_change":"2024-09-10T06:26:45.239130+0000","last_active":"2024-09-10T06:26:45.239130+0000","last_peered":"2024-09-10T06:26:45.239130+0000","last_clean":"2024-09-10T06:26:45.239130+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:26:45.239130+0000","last_undegraded":"2024-09-10T06:26:45.239130+0000","last_fullsized":"2024-09-10T06:26:45.239130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.238956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:09.120153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.192191+0000","last_change":"2024-09-10T06:26:46.192191+0000","last_active":"2024-09-10T06:26:46.192191+0000","last_peered":"2024-09-10T06:26:46.192191+0000","last_clean":"2024-09-10T06:26:46.192191+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:26:46.192191+0000","last_undegraded":"2024-09-10T06:26:46.192191+0000","last_fullsized":"2024-09-10T06:26:46.192191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.192012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:04.479544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.752609+0000","last_change":"2024-09-10T06:26:51.752609+0000","last_active":"2024-09-10T06:26:51.752609+0000","last_peered":"2024-09-10T06:26:51.752609+0000","last_clean":"2024-09-10T06:26:51.752609+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:26:51.752609+0000","last_undegraded":"2024-09-10T06:26:51.752609+0000","last_fullsized":"2024-09-10T06:26:51.752609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.752428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:35.735944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.934649+0000","last_change":"2024-09-10T06:26:38.934649+0000","last_active":"2024-09-10T06:26:38.934649+0000","last_peered":"2024-09-10T06:26:38.934649+0000","last_clean":"2024-09-10T06:26:38.934649+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:26:38.934649+0000","last_undegraded":"2024-09-10T06:26:38.934649+0000","last_fullsized":"2024-09-10T06:26:38.934649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.934464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:06.919711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.648863+0000","last_change":"2024-09-10T06:26:52.648863+0000","last_active":"2024-09-10T06:26:52.648863+0000","last_peered":"2024-09-10T06:26:52.648863+0000","last_clean":"2024-09-10T06:26:52.648863+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:26:52.648863+0000","last_undegraded":"2024-09-10T06:26:52.648863+0000","last_fullsized":"2024-09-10T06:26:52.648863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.648684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:03.211891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1396,"ondisk_log_size":1396,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640315,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640317,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1007616,"data_stored":724587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673021,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":425984,"data_stored":135733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:27:03.319 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.319 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.320 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.321 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.322 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.323 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.323 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.323 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.323 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.324 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.325 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.326 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.327 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.328 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.329 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.330 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.331 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.332 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.333 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T06:22:34.787291+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.334 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.335 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.335 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T06:22:32.783175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:03.335 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:27:23.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:27:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.462+0000 7f7b28992640 1 Processor -- start 2024-09-10T06:27:23.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.462+0000 7f7b28992640 1 -- start start 2024-09-10T06:27:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b24110da0 0x7f7b24111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:23.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b24073a90 con 0x7f7b241116c0 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240696e0 con 0x7f7b24110da0 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b21d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7b241116c0 0x7f7b241231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58968/0 (socket says 172.21.15.84:58968) 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b24110da0 0x7f7b24111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b21d9b640 1 -- 172.21.15.84:0/898629729 learned_addr learned my addr 172.21.15.84:0/898629729 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2259c640 1 -- 172.21.15.84:0/898629729 >> v1:172.21.15.84:6789/0 conn(0x7f7b241116c0 legacy=0x7f7b241231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2259c640 1 -- 172.21.15.84:0/898629729 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2406dd50 con 0x7f7b24110da0 2024-09-10T06:27:23.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2159a640 1 -- 172.21.15.84:0/898629729 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972411780 0 0) 0x7f7b24073a90 con 0x7f7b241116c0 2024-09-10T06:27:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2259c640 1 --2- 172.21.15.84:0/898629729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24111180 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009740 tx=0x7f7b1801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd536d990b3d8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2159a640 1 -- 172.21.15.84:0/898629729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180b0070 con 0x7f7b24110da0 2024-09-10T06:27:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2159a640 1 -- 172.21.15.84:0/898629729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b180ab530 con 0x7f7b24110da0 2024-09-10T06:27:23.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b2159a640 1 -- 172.21.15.84:0/898629729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180ab830 con 0x7f7b24110da0 2024-09-10T06:27:23.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- 172.21.15.84:0/898629729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 msgr2=0x7f7b24111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:23.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 --2- 172.21.15.84:0/898629729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24111180 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009740 tx=0x7f7b1801c370 comp rx=0 tx=0).stop 2024-09-10T06:27:23.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- 172.21.15.84:0/898629729 shutdown_connections 2024-09-10T06:27:23.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 --2- 172.21.15.84:0/898629729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24111180 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:23.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- 172.21.15.84:0/898629729 >> 172.21.15.84:0/898629729 conn(0x7f7b24070900 msgr2=0x7f7b24072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:23.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- 172.21.15.84:0/898629729 shutdown_connections 2024-09-10T06:27:23.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.466+0000 7f7b28992640 1 -- 172.21.15.84:0/898629729 wait complete. 2024-09-10T06:27:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 Processor -- start 2024-09-10T06:27:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 -- start start 2024-09-10T06:27:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24135470 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50568/0 (socket says 172.21.15.84:50568) 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b2259c640 1 -- 172.21.15.84:0/1247689205 learned_addr learned my addr 172.21.15.84:0/1247689205 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b2259c640 1 -- 172.21.15.84:0/1247689205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24130c90 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b2259c640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ae040 tx=0x7f7b18019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180b8020 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b180b4600 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b241305c0 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180b0040 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b24122e50 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24111180 con 0x7f7b24110da0 2024-09-10T06:27:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b180bb020 con 0x7f7b24110da0 2024-09-10T06:27:23.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 0x7f7b0403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:23.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.470+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7b180e94e0 con 0x7f7b24110da0 2024-09-10T06:27:23.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.474+0000 7f7b21d9b640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 0x7f7b0403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:23.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.474+0000 7f7b21d9b640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 0x7f7b0403d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b140078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.478+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7b180c2030 con 0x7f7b24110da0 2024-09-10T06:27:23.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.642+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b24114060 con 0x7f7b0403b1d0 2024-09-10T06:27:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.670+0000 7f7b12ffd640 1 -- 172.21.15.84:0/1247689205 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665114 (secure 0 0 0) 0x7f7b24114060 con 0x7f7b0403b1d0 2024-09-10T06:27:23.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:27:23.691 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:27:23.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 msgr2=0x7f7b0403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:23.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 0x7f7b0403d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b140078e0 comp rx=0 tx=0).stop 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 msgr2=0x7f7b24122740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ae040 tx=0x7f7b18019110 comp rx=0 tx=0).stop 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 shutdown_connections 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f7b0403b1d0 0x7f7b0403d690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 --2- 172.21.15.84:0/1247689205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b24110da0 0x7f7b24122740 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 >> 172.21.15.84:0/1247689205 conn(0x7f7b24070900 msgr2=0x7f7b2412ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 shutdown_connections 2024-09-10T06:27:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:23.674+0000 7f7b28992640 1 -- 172.21.15.84:0/1247689205 wait complete. 2024-09-10T06:27:23.697 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-10T06:27:21.899887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4726,"ondisk_log_size":4726,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":164992,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322368,"statfs":{"total":386547056640,"available":386378104832,"internally_reserved":0,"allocated":2883584,"data_stored":1722172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006873"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.466040+0000","last_change":"2024-09-10T06:26:34.465867+0000","last_active":"2024-09-10T06:26:34.466040+0000","last_peered":"2024-09-10T06:26:34.466040+0000","last_clean":"2024-09-10T06:26:34.466040+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:26:34.466040+0000","last_undegraded":"2024-09-10T06:26:34.466040+0000","last_fullsized":"2024-09-10T06:26:34.466040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.465683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:52.407098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.646909+0000","last_change":"2024-09-10T06:26:53.646909+0000","last_active":"2024-09-10T06:26:53.646909+0000","last_peered":"2024-09-10T06:26:53.646909+0000","last_clean":"2024-09-10T06:26:53.646909+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:26:53.646909+0000","last_undegraded":"2024-09-10T06:26:53.646909+0000","last_fullsized":"2024-09-10T06:26:53.646909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.646728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.216502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.020076+0000","last_change":"2024-09-10T06:26:31.019911+0000","last_active":"2024-09-10T06:26:31.020076+0000","last_peered":"2024-09-10T06:26:31.020076+0000","last_clean":"2024-09-10T06:26:31.020076+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:26:31.020076+0000","last_undegraded":"2024-09-10T06:26:31.020076+0000","last_fullsized":"2024-09-10T06:26:31.020076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.019720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.047991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.260098+0000","last_change":"2024-09-10T06:27:05.260098+0000","last_active":"2024-09-10T06:27:05.260098+0000","last_peered":"2024-09-10T06:27:05.260098+0000","last_clean":"2024-09-10T06:27:05.260098+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:27:05.260098+0000","last_undegraded":"2024-09-10T06:27:05.260098+0000","last_fullsized":"2024-09-10T06:27:05.260098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.259897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:58.244968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.163437+0000","last_change":"2024-09-10T06:26:51.163437+0000","last_active":"2024-09-10T06:26:51.163437+0000","last_peered":"2024-09-10T06:26:51.163437+0000","last_clean":"2024-09-10T06:26:51.163437+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:26:51.163437+0000","last_undegraded":"2024-09-10T06:26:51.163437+0000","last_fullsized":"2024-09-10T06:26:51.163437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.163242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:11.196431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.301843+0000","last_change":"2024-09-10T06:27:06.301843+0000","last_active":"2024-09-10T06:27:06.301843+0000","last_peered":"2024-09-10T06:27:06.301843+0000","last_clean":"2024-09-10T06:27:06.301843+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:27:06.301843+0000","last_undegraded":"2024-09-10T06:27:06.301843+0000","last_fullsized":"2024-09-10T06:27:06.301843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.301644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:48.919378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.746646+0000","last_change":"2024-09-10T06:26:42.746646+0000","last_active":"2024-09-10T06:26:42.746646+0000","last_peered":"2024-09-10T06:26:42.746646+0000","last_clean":"2024-09-10T06:26:42.746646+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:26:42.746646+0000","last_undegraded":"2024-09-10T06:26:42.746646+0000","last_fullsized":"2024-09-10T06:26:42.746646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.746449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:24.690631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.807804+0000","last_change":"2024-09-10T06:26:47.807804+0000","last_active":"2024-09-10T06:26:47.807804+0000","last_peered":"2024-09-10T06:26:47.807804+0000","last_clean":"2024-09-10T06:26:47.807804+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:26:47.807804+0000","last_undegraded":"2024-09-10T06:26:47.807804+0000","last_fullsized":"2024-09-10T06:26:47.807804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.807624+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:44.898834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.241472+0000","last_change":"2024-09-10T06:26:49.241472+0000","last_active":"2024-09-10T06:26:49.241472+0000","last_peered":"2024-09-10T06:26:49.241472+0000","last_clean":"2024-09-10T06:26:49.241472+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:26:49.241472+0000","last_undegraded":"2024-09-10T06:26:49.241472+0000","last_fullsized":"2024-09-10T06:26:49.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.241280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:21.798559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.669065+0000","last_change":"2024-09-10T06:26:54.669065+0000","last_active":"2024-09-10T06:26:54.669065+0000","last_peered":"2024-09-10T06:26:54.669065+0000","last_clean":"2024-09-10T06:26:54.669065+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:26:54.669065+0000","last_undegraded":"2024-09-10T06:26:54.669065+0000","last_fullsized":"2024-09-10T06:26:54.669065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.668892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:55.148303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.383694+0000","last_change":"2024-09-10T06:26:32.383694+0000","last_active":"2024-09-10T06:26:32.383694+0000","last_peered":"2024-09-10T06:26:32.383694+0000","last_clean":"2024-09-10T06:26:32.383694+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:26:32.383694+0000","last_undegraded":"2024-09-10T06:26:32.383694+0000","last_fullsized":"2024-09-10T06:26:32.383694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.383510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:41.546507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.392644+0000","last_change":"2024-09-10T06:27:08.392644+0000","last_active":"2024-09-10T06:27:08.392644+0000","last_peered":"2024-09-10T06:27:08.392644+0000","last_clean":"2024-09-10T06:27:08.392644+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:27:08.392644+0000","last_undegraded":"2024-09-10T06:27:08.392644+0000","last_fullsized":"2024-09-10T06:27:08.392644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.392426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:06.940408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.236984+0000","last_change":"2024-09-10T06:26:48.236984+0000","last_active":"2024-09-10T06:26:48.236984+0000","last_peered":"2024-09-10T06:26:48.236984+0000","last_clean":"2024-09-10T06:26:48.236984+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:26:48.236984+0000","last_undegraded":"2024-09-10T06:26:48.236984+0000","last_fullsized":"2024-09-10T06:26:48.236984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.236809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:50.855015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.767721+0000","last_change":"2024-09-10T06:26:50.767721+0000","last_active":"2024-09-10T06:26:50.767721+0000","last_peered":"2024-09-10T06:26:50.767721+0000","last_clean":"2024-09-10T06:26:50.767721+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:26:50.767721+0000","last_undegraded":"2024-09-10T06:26:50.767721+0000","last_fullsized":"2024-09-10T06:26:50.767721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.767440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:05.170562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.039477+0000","last_change":"2024-09-10T06:26:30.039477+0000","last_active":"2024-09-10T06:26:30.039477+0000","last_peered":"2024-09-10T06:26:30.039477+0000","last_clean":"2024-09-10T06:26:30.039477+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:26:30.039477+0000","last_undegraded":"2024-09-10T06:26:30.039477+0000","last_fullsized":"2024-09-10T06:26:30.039477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.039298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:00.637143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.805279+0000","last_change":"2024-09-10T06:26:49.805279+0000","last_active":"2024-09-10T06:26:49.805279+0000","last_peered":"2024-09-10T06:26:49.805279+0000","last_clean":"2024-09-10T06:26:49.805279+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:26:49.805279+0000","last_undegraded":"2024-09-10T06:26:49.805279+0000","last_fullsized":"2024-09-10T06:26:49.805279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.805098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.455068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.228333+0000","last_change":"2024-09-10T06:27:04.228183+0000","last_active":"2024-09-10T06:27:04.228333+0000","last_peered":"2024-09-10T06:27:04.228333+0000","last_clean":"2024-09-10T06:27:04.228333+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:27:04.228333+0000","last_undegraded":"2024-09-10T06:27:04.228333+0000","last_fullsized":"2024-09-10T06:27:04.228333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.227971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:12.018865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.658943+0000","last_change":"2024-09-10T06:26:34.658943+0000","last_active":"2024-09-10T06:26:34.658943+0000","last_peered":"2024-09-10T06:26:34.658943+0000","last_clean":"2024-09-10T06:26:34.658943+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:26:34.658943+0000","last_undegraded":"2024-09-10T06:26:34.658943+0000","last_fullsized":"2024-09-10T06:26:34.658943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.658763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:49.709576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.693896+0000","last_change":"2024-09-10T06:26:49.693724+0000","last_active":"2024-09-10T06:26:49.693896+0000","last_peered":"2024-09-10T06:26:49.693896+0000","last_clean":"2024-09-10T06:26:49.693896+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:26:49.693896+0000","last_undegraded":"2024-09-10T06:26:49.693896+0000","last_fullsized":"2024-09-10T06:26:49.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.693549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:08.446456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.418172+0000","last_change":"2024-09-10T06:26:33.418172+0000","last_active":"2024-09-10T06:26:33.418172+0000","last_peered":"2024-09-10T06:26:33.418172+0000","last_clean":"2024-09-10T06:26:33.418172+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:26:33.418172+0000","last_undegraded":"2024-09-10T06:26:33.418172+0000","last_fullsized":"2024-09-10T06:26:33.418172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.417943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:42.088360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.673426+0000","last_change":"2024-09-10T06:26:50.673252+0000","last_active":"2024-09-10T06:26:50.673426+0000","last_peered":"2024-09-10T06:26:50.673426+0000","last_clean":"2024-09-10T06:26:50.673426+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:26:50.673426+0000","last_undegraded":"2024-09-10T06:26:50.673426+0000","last_fullsized":"2024-09-10T06:26:50.673426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.673058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:46.607628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.556091+0000","last_change":"2024-09-10T06:26:31.556091+0000","last_active":"2024-09-10T06:26:31.556091+0000","last_peered":"2024-09-10T06:26:31.556091+0000","last_clean":"2024-09-10T06:26:31.556091+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:26:31.556091+0000","last_undegraded":"2024-09-10T06:26:31.556091+0000","last_fullsized":"2024-09-10T06:26:31.556091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.555912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:11.664445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.817945+0000","last_change":"2024-09-10T06:26:48.817945+0000","last_active":"2024-09-10T06:26:48.817945+0000","last_peered":"2024-09-10T06:26:48.817945+0000","last_clean":"2024-09-10T06:26:48.817945+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:26:48.817945+0000","last_undegraded":"2024-09-10T06:26:48.817945+0000","last_fullsized":"2024-09-10T06:26:48.817945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.817716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:47.841366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.598629+0000","last_change":"2024-09-10T06:26:32.598629+0000","last_active":"2024-09-10T06:26:32.598629+0000","last_peered":"2024-09-10T06:26:32.598629+0000","last_clean":"2024-09-10T06:26:32.598629+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:26:32.598629+0000","last_undegraded":"2024-09-10T06:26:32.598629+0000","last_fullsized":"2024-09-10T06:26:32.598629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.598449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:24.920243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.782106+0000","last_change":"2024-09-10T06:26:45.782106+0000","last_active":"2024-09-10T06:26:45.782106+0000","last_peered":"2024-09-10T06:26:45.782106+0000","last_clean":"2024-09-10T06:26:45.782106+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:26:45.782106+0000","last_undegraded":"2024-09-10T06:26:45.782106+0000","last_fullsized":"2024-09-10T06:26:45.782106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.781922+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:14.746365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.086704+0000","last_change":"2024-09-10T06:26:28.086704+0000","last_active":"2024-09-10T06:26:28.086704+0000","last_peered":"2024-09-10T06:26:28.086704+0000","last_clean":"2024-09-10T06:26:28.086704+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:26:28.086704+0000","last_undegraded":"2024-09-10T06:26:28.086704+0000","last_fullsized":"2024-09-10T06:26:28.086704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.086529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:43.137342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.670280+0000","last_change":"2024-09-10T06:26:51.670280+0000","last_active":"2024-09-10T06:26:51.670280+0000","last_peered":"2024-09-10T06:26:51.670280+0000","last_clean":"2024-09-10T06:26:51.670280+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:26:51.670280+0000","last_undegraded":"2024-09-10T06:26:51.670280+0000","last_fullsized":"2024-09-10T06:26:51.670280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.670102+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.678798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.234590+0000","last_change":"2024-09-10T06:26:47.234344+0000","last_active":"2024-09-10T06:26:47.234590+0000","last_peered":"2024-09-10T06:26:47.234590+0000","last_clean":"2024-09-10T06:26:47.234590+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:26:47.234590+0000","last_undegraded":"2024-09-10T06:26:47.234590+0000","last_fullsized":"2024-09-10T06:26:47.234590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.234129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:14.974750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'37","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.489593+0000","last_change":"2024-09-10T06:22:41.891389+0000","last_active":"2024-09-10T06:25:46.489593+0000","last_peered":"2024-09-10T06:25:46.489593+0000","last_clean":"2024-09-10T06:25:46.489593+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:25:46.489593+0000","last_undegraded":"2024-09-10T06:25:46.489593+0000","last_fullsized":"2024-09-10T06:25:46.489593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:34.566731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.219740+0000","last_change":"2024-09-10T06:26:57.219569+0000","last_active":"2024-09-10T06:26:57.219740+0000","last_peered":"2024-09-10T06:26:57.219740+0000","last_clean":"2024-09-10T06:26:57.219740+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:26:57.219740+0000","last_undegraded":"2024-09-10T06:26:57.219740+0000","last_fullsized":"2024-09-10T06:26:57.219740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.219347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:08.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.269168+0000","last_change":"2024-09-10T06:26:36.268913+0000","last_active":"2024-09-10T06:26:36.269168+0000","last_peered":"2024-09-10T06:26:36.269168+0000","last_clean":"2024-09-10T06:26:36.269168+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:26:36.269168+0000","last_undegraded":"2024-09-10T06:26:36.269168+0000","last_fullsized":"2024-09-10T06:26:36.269168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.268668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:50.827972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.364666+0000","last_change":"2024-09-10T06:27:16.364666+0000","last_active":"2024-09-10T06:27:16.364666+0000","last_peered":"2024-09-10T06:27:16.364666+0000","last_clean":"2024-09-10T06:27:16.364666+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:27:16.364666+0000","last_undegraded":"2024-09-10T06:27:16.364666+0000","last_fullsized":"2024-09-10T06:27:16.364666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.364504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:38.523435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.668585+0000","last_change":"2024-09-10T06:22:37.859763+0000","last_active":"2024-09-10T06:26:17.668585+0000","last_peered":"2024-09-10T06:26:17.668585+0000","last_clean":"2024-09-10T06:26:17.668585+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:26:17.668585+0000","last_undegraded":"2024-09-10T06:26:17.668585+0000","last_fullsized":"2024-09-10T06:26:17.668585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:44.547078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.813696+0000","last_change":"2024-09-10T06:27:14.813696+0000","last_active":"2024-09-10T06:27:14.813696+0000","last_peered":"2024-09-10T06:27:14.813696+0000","last_clean":"2024-09-10T06:27:14.813696+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:27:14.813696+0000","last_undegraded":"2024-09-10T06:27:14.813696+0000","last_fullsized":"2024-09-10T06:27:14.813696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.813484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:20.583529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.162717+0000","last_change":"2024-09-10T06:22:41.890472+0000","last_active":"2024-09-10T06:24:00.162717+0000","last_peered":"2024-09-10T06:24:00.162717+0000","last_clean":"2024-09-10T06:24:00.162717+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:24:00.162717+0000","last_undegraded":"2024-09-10T06:24:00.162717+0000","last_fullsized":"2024-09-10T06:24:00.162717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:42.307918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.246335+0000","last_change":"2024-09-10T06:26:58.246335+0000","last_active":"2024-09-10T06:26:58.246335+0000","last_peered":"2024-09-10T06:26:58.246335+0000","last_clean":"2024-09-10T06:26:58.246335+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:26:58.246335+0000","last_undegraded":"2024-09-10T06:26:58.246335+0000","last_fullsized":"2024-09-10T06:26:58.246335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.246124+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:23.180121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.454724+0000","last_change":"2024-09-10T06:26:28.454535+0000","last_active":"2024-09-10T06:26:28.454724+0000","last_peered":"2024-09-10T06:26:28.454724+0000","last_clean":"2024-09-10T06:26:28.454724+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:26:28.454724+0000","last_undegraded":"2024-09-10T06:26:28.454724+0000","last_fullsized":"2024-09-10T06:26:28.454724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.454354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:21.140529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.686119+0000","last_change":"2024-09-10T06:26:58.686119+0000","last_active":"2024-09-10T06:26:58.686119+0000","last_peered":"2024-09-10T06:26:58.686119+0000","last_clean":"2024-09-10T06:26:58.686119+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:26:58.686119+0000","last_undegraded":"2024-09-10T06:26:58.686119+0000","last_fullsized":"2024-09-10T06:26:58.686119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.685947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:42.669463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.808998+0000","last_change":"2024-09-10T06:27:08.808998+0000","last_active":"2024-09-10T06:27:08.808998+0000","last_peered":"2024-09-10T06:27:08.808998+0000","last_clean":"2024-09-10T06:27:08.808998+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:27:08.808998+0000","last_undegraded":"2024-09-10T06:27:08.808998+0000","last_fullsized":"2024-09-10T06:27:08.808998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.808779+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:45.316350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.797478+0000","last_change":"2024-09-10T06:27:13.797478+0000","last_active":"2024-09-10T06:27:13.797478+0000","last_peered":"2024-09-10T06:27:13.797478+0000","last_clean":"2024-09-10T06:27:13.797478+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:27:13.797478+0000","last_undegraded":"2024-09-10T06:27:13.797478+0000","last_fullsized":"2024-09-10T06:27:13.797478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:22.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.072279+0000","last_change":"2024-09-10T06:27:17.072279+0000","last_active":"2024-09-10T06:27:17.072279+0000","last_peered":"2024-09-10T06:27:17.072279+0000","last_clean":"2024-09-10T06:27:17.072279+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:27:17.072279+0000","last_undegraded":"2024-09-10T06:27:17.072279+0000","last_fullsized":"2024-09-10T06:27:17.072279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.072077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:49.470636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.272162+0000","last_change":"2024-09-10T06:26:59.272162+0000","last_active":"2024-09-10T06:26:59.272162+0000","last_peered":"2024-09-10T06:26:59.272162+0000","last_clean":"2024-09-10T06:26:59.272162+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:26:59.272162+0000","last_undegraded":"2024-09-10T06:26:59.272162+0000","last_fullsized":"2024-09-10T06:26:59.272162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.271973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:48.087167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.235278+0000","last_change":"2024-09-10T06:26:35.235143+0000","last_active":"2024-09-10T06:26:35.235278+0000","last_peered":"2024-09-10T06:26:35.235278+0000","last_clean":"2024-09-10T06:26:35.235278+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:26:35.235278+0000","last_undegraded":"2024-09-10T06:26:35.235278+0000","last_fullsized":"2024-09-10T06:26:35.235278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.234952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:53.200997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.835391+0000","last_change":"2024-09-10T06:26:56.835391+0000","last_active":"2024-09-10T06:26:56.835391+0000","last_peered":"2024-09-10T06:26:56.835391+0000","last_clean":"2024-09-10T06:26:56.835391+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:26:56.835391+0000","last_undegraded":"2024-09-10T06:26:56.835391+0000","last_fullsized":"2024-09-10T06:26:56.835391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.835182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:59.591116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.969782+0000","last_change":"2024-09-10T06:27:02.969630+0000","last_active":"2024-09-10T06:27:02.969782+0000","last_peered":"2024-09-10T06:27:02.969782+0000","last_clean":"2024-09-10T06:27:02.969782+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:27:02.969782+0000","last_undegraded":"2024-09-10T06:27:02.969782+0000","last_fullsized":"2024-09-10T06:27:02.969782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.969422+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:36.259987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.379703+0000","last_change":"2024-09-10T06:22:39.878290+0000","last_active":"2024-09-10T06:26:17.379703+0000","last_peered":"2024-09-10T06:26:17.379703+0000","last_clean":"2024-09-10T06:26:17.379703+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:26:17.379703+0000","last_undegraded":"2024-09-10T06:26:17.379703+0000","last_fullsized":"2024-09-10T06:26:17.379703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:18.386671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.958875+0000","last_change":"2024-09-10T06:27:15.958875+0000","last_active":"2024-09-10T06:27:15.958875+0000","last_peered":"2024-09-10T06:27:15.958875+0000","last_clean":"2024-09-10T06:27:15.958875+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:27:15.958875+0000","last_undegraded":"2024-09-10T06:27:15.958875+0000","last_fullsized":"2024-09-10T06:27:15.958875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.958685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:29.946098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'22","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.942629+0000","last_change":"2024-09-10T06:26:36.942629+0000","last_active":"2024-09-10T06:26:36.942629+0000","last_peered":"2024-09-10T06:26:36.942629+0000","last_clean":"2024-09-10T06:26:36.942629+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:26:36.942629+0000","last_undegraded":"2024-09-10T06:26:36.942629+0000","last_fullsized":"2024-09-10T06:26:36.942629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.942444+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:24.199520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.456820+0000","last_change":"2024-09-10T06:26:23.456692+0000","last_active":"2024-09-10T06:26:23.456820+0000","last_peered":"2024-09-10T06:26:23.456820+0000","last_clean":"2024-09-10T06:26:23.456820+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:26:23.456820+0000","last_undegraded":"2024-09-10T06:26:23.456820+0000","last_fullsized":"2024-09-10T06:26:23.456820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.456509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:13.569641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.410327+0000","last_change":"2024-09-10T06:27:15.410327+0000","last_active":"2024-09-10T06:27:15.410327+0000","last_peered":"2024-09-10T06:27:15.410327+0000","last_clean":"2024-09-10T06:27:15.410327+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:27:15.410327+0000","last_undegraded":"2024-09-10T06:27:15.410327+0000","last_fullsized":"2024-09-10T06:27:15.410327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.410128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:40.645404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.934107+0000","last_change":"2024-09-10T06:27:03.934107+0000","last_active":"2024-09-10T06:27:03.934107+0000","last_peered":"2024-09-10T06:27:03.934107+0000","last_clean":"2024-09-10T06:27:03.934107+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:27:03.934107+0000","last_undegraded":"2024-09-10T06:27:03.934107+0000","last_fullsized":"2024-09-10T06:27:03.934107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.933915+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:45.925845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.073358+0000","last_change":"2024-09-10T06:27:11.073358+0000","last_active":"2024-09-10T06:27:11.073358+0000","last_peered":"2024-09-10T06:27:11.073358+0000","last_clean":"2024-09-10T06:27:11.073358+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:27:11.073358+0000","last_undegraded":"2024-09-10T06:27:11.073358+0000","last_fullsized":"2024-09-10T06:27:11.073358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.073173+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:26.420496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.179151+0000","last_change":"2024-09-10T06:26:53.179003+0000","last_active":"2024-09-10T06:26:53.179151+0000","last_peered":"2024-09-10T06:26:53.179151+0000","last_clean":"2024-09-10T06:26:53.179151+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:26:53.179151+0000","last_undegraded":"2024-09-10T06:26:53.179151+0000","last_fullsized":"2024-09-10T06:26:53.179151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.178832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:42.811475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.491722+0000","last_change":"2024-09-10T06:26:26.491509+0000","last_active":"2024-09-10T06:26:26.491722+0000","last_peered":"2024-09-10T06:26:26.491722+0000","last_clean":"2024-09-10T06:26:26.491722+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:26:26.491722+0000","last_undegraded":"2024-09-10T06:26:26.491722+0000","last_fullsized":"2024-09-10T06:26:26.491722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.491266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:02.267203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.635870+0000","last_change":"2024-09-10T06:26:55.635748+0000","last_active":"2024-09-10T06:26:55.635870+0000","last_peered":"2024-09-10T06:26:55.635870+0000","last_clean":"2024-09-10T06:26:55.635870+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:26:55.635870+0000","last_undegraded":"2024-09-10T06:26:55.635870+0000","last_fullsized":"2024-09-10T06:26:55.635870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.635574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:54.659225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.853113+0000","last_change":"2024-09-10T06:26:59.853113+0000","last_active":"2024-09-10T06:26:59.853113+0000","last_peered":"2024-09-10T06:26:59.853113+0000","last_clean":"2024-09-10T06:26:59.853113+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:59.853113+0000","last_undegraded":"2024-09-10T06:26:59.853113+0000","last_fullsized":"2024-09-10T06:26:59.853113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.852901+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:05.503788+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.142100+0000","last_change":"2024-09-10T06:27:09.141933+0000","last_active":"2024-09-10T06:27:09.142100+0000","last_peered":"2024-09-10T06:27:09.142100+0000","last_clean":"2024-09-10T06:27:09.142100+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:27:09.142100+0000","last_undegraded":"2024-09-10T06:27:09.142100+0000","last_fullsized":"2024-09-10T06:27:09.142100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.141754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:21.411218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.004387+0000","last_change":"2024-09-10T06:27:13.004387+0000","last_active":"2024-09-10T06:27:13.004387+0000","last_peered":"2024-09-10T06:27:13.004387+0000","last_clean":"2024-09-10T06:27:13.004387+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:27:13.004387+0000","last_undegraded":"2024-09-10T06:27:13.004387+0000","last_fullsized":"2024-09-10T06:27:13.004387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.004209+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:35.846831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.750907+0000","last_change":"2024-09-10T06:26:37.750761+0000","last_active":"2024-09-10T06:26:37.750907+0000","last_peered":"2024-09-10T06:26:37.750907+0000","last_clean":"2024-09-10T06:26:37.750907+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:26:37.750907+0000","last_undegraded":"2024-09-10T06:26:37.750907+0000","last_fullsized":"2024-09-10T06:26:37.750907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.750588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:21.168972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.466097+0000","last_change":"2024-09-10T06:26:25.465949+0000","last_active":"2024-09-10T06:26:25.466097+0000","last_peered":"2024-09-10T06:26:25.466097+0000","last_clean":"2024-09-10T06:26:25.466097+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:26:25.466097+0000","last_undegraded":"2024-09-10T06:26:25.466097+0000","last_fullsized":"2024-09-10T06:26:25.466097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.465745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:11.750138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.801096+0000","last_change":"2024-09-10T06:26:53.800884+0000","last_active":"2024-09-10T06:26:53.801096+0000","last_peered":"2024-09-10T06:26:53.801096+0000","last_clean":"2024-09-10T06:26:53.801096+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:26:53.801096+0000","last_undegraded":"2024-09-10T06:26:53.801096+0000","last_fullsized":"2024-09-10T06:26:53.801096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.800700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:36.270704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.538847+0000","last_change":"2024-09-10T06:22:37.863788+0000","last_active":"2024-09-10T06:26:17.538847+0000","last_peered":"2024-09-10T06:26:17.538847+0000","last_clean":"2024-09-10T06:26:17.538847+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:26:17.538847+0000","last_undegraded":"2024-09-10T06:26:17.538847+0000","last_fullsized":"2024-09-10T06:26:17.538847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.112633+0000","last_change":"2024-09-10T06:27:12.112633+0000","last_active":"2024-09-10T06:27:12.112633+0000","last_peered":"2024-09-10T06:27:12.112633+0000","last_clean":"2024-09-10T06:27:12.112633+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:27:12.112633+0000","last_undegraded":"2024-09-10T06:27:12.112633+0000","last_fullsized":"2024-09-10T06:27:12.112633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.112450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:50.224384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.778437+0000","last_change":"2024-09-10T06:27:17.778437+0000","last_active":"2024-09-10T06:27:17.778437+0000","last_peered":"2024-09-10T06:27:17.778437+0000","last_clean":"2024-09-10T06:27:17.778437+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:27:17.778437+0000","last_undegraded":"2024-09-10T06:27:17.778437+0000","last_fullsized":"2024-09-10T06:27:17.778437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.778228+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:33.125552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.592620+0000","last_change":"2024-09-10T06:26:37.592443+0000","last_active":"2024-09-10T06:26:37.592620+0000","last_peered":"2024-09-10T06:26:37.592620+0000","last_clean":"2024-09-10T06:26:37.592620+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:26:37.592620+0000","last_undegraded":"2024-09-10T06:26:37.592620+0000","last_fullsized":"2024-09-10T06:26:37.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.592235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:10.519860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.222626+0000","last_change":"2024-09-10T06:26:34.222379+0000","last_active":"2024-09-10T06:26:34.222626+0000","last_peered":"2024-09-10T06:26:34.222626+0000","last_clean":"2024-09-10T06:26:34.222626+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:26:34.222626+0000","last_undegraded":"2024-09-10T06:26:34.222626+0000","last_fullsized":"2024-09-10T06:26:34.222626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.222107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:52.398385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.836789+0000","last_change":"2024-09-10T06:26:54.836508+0000","last_active":"2024-09-10T06:26:54.836789+0000","last_peered":"2024-09-10T06:26:54.836789+0000","last_clean":"2024-09-10T06:26:54.836789+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:26:54.836789+0000","last_undegraded":"2024-09-10T06:26:54.836789+0000","last_fullsized":"2024-09-10T06:26:54.836789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.836286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:31.547637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.721387+0000","last_change":"2024-09-10T06:22:37.857410+0000","last_active":"2024-09-10T06:26:17.721387+0000","last_peered":"2024-09-10T06:26:17.721387+0000","last_clean":"2024-09-10T06:26:17.721387+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:26:17.721387+0000","last_undegraded":"2024-09-10T06:26:17.721387+0000","last_fullsized":"2024-09-10T06:26:17.721387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.141755+0000","last_change":"2024-09-10T06:27:13.141755+0000","last_active":"2024-09-10T06:27:13.141755+0000","last_peered":"2024-09-10T06:27:13.141755+0000","last_clean":"2024-09-10T06:27:13.141755+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:27:13.141755+0000","last_undegraded":"2024-09-10T06:27:13.141755+0000","last_fullsized":"2024-09-10T06:27:13.141755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.141565+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.899954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.049896+0000","last_change":"2024-09-10T06:22:41.879392+0000","last_active":"2024-09-10T06:25:46.049896+0000","last_peered":"2024-09-10T06:25:46.049896+0000","last_clean":"2024-09-10T06:25:46.049896+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:25:46.049896+0000","last_undegraded":"2024-09-10T06:25:46.049896+0000","last_fullsized":"2024-09-10T06:25:46.049896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.631870+0000","last_change":"2024-09-10T06:26:38.631720+0000","last_active":"2024-09-10T06:26:38.631870+0000","last_peered":"2024-09-10T06:26:38.631870+0000","last_clean":"2024-09-10T06:26:38.631870+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:26:38.631870+0000","last_undegraded":"2024-09-10T06:26:38.631870+0000","last_fullsized":"2024-09-10T06:26:38.631870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.631513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:27.113368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.205169+0000","last_change":"2024-09-10T06:26:33.205009+0000","last_active":"2024-09-10T06:26:33.205169+0000","last_peered":"2024-09-10T06:26:33.205169+0000","last_clean":"2024-09-10T06:26:33.205169+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:26:33.205169+0000","last_undegraded":"2024-09-10T06:26:33.205169+0000","last_fullsized":"2024-09-10T06:26:33.205169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.204830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.417787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.807872+0000","last_change":"2024-09-10T06:26:49.807716+0000","last_active":"2024-09-10T06:26:49.807872+0000","last_peered":"2024-09-10T06:26:49.807872+0000","last_clean":"2024-09-10T06:26:49.807872+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:26:49.807872+0000","last_undegraded":"2024-09-10T06:26:49.807872+0000","last_fullsized":"2024-09-10T06:26:49.807872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:23.493668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'61","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.560828+0000","last_change":"2024-09-10T06:22:37.858765+0000","last_active":"2024-09-10T06:26:17.560828+0000","last_peered":"2024-09-10T06:26:17.560828+0000","last_clean":"2024-09-10T06:26:17.560828+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:26:17.560828+0000","last_undegraded":"2024-09-10T06:26:17.560828+0000","last_fullsized":"2024-09-10T06:26:17.560828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.147438+0000","last_change":"2024-09-10T06:27:08.147438+0000","last_active":"2024-09-10T06:27:08.147438+0000","last_peered":"2024-09-10T06:27:08.147438+0000","last_clean":"2024-09-10T06:27:08.147438+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:27:08.147438+0000","last_undegraded":"2024-09-10T06:27:08.147438+0000","last_fullsized":"2024-09-10T06:27:08.147438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.147252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:13.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.554576+0000","last_change":"2024-09-10T06:22:41.861741+0000","last_active":"2024-09-10T06:25:46.554576+0000","last_peered":"2024-09-10T06:25:46.554576+0000","last_clean":"2024-09-10T06:25:46.554576+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:25:46.554576+0000","last_undegraded":"2024-09-10T06:25:46.554576+0000","last_fullsized":"2024-09-10T06:25:46.554576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.681020+0000","last_change":"2024-09-10T06:26:39.680863+0000","last_active":"2024-09-10T06:26:39.681020+0000","last_peered":"2024-09-10T06:26:39.681020+0000","last_clean":"2024-09-10T06:26:39.681020+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:26:39.681020+0000","last_undegraded":"2024-09-10T06:26:39.681020+0000","last_fullsized":"2024-09-10T06:26:39.681020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.680672+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:43.246870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.091359+0000","last_change":"2024-09-10T06:26:23.091180+0000","last_active":"2024-09-10T06:26:23.091359+0000","last_peered":"2024-09-10T06:26:23.091359+0000","last_clean":"2024-09-10T06:26:23.091359+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:26:23.091359+0000","last_undegraded":"2024-09-10T06:26:23.091359+0000","last_fullsized":"2024-09-10T06:26:23.091359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.091001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:02.894224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.727201+0000","last_change":"2024-09-10T06:26:52.727049+0000","last_active":"2024-09-10T06:26:52.727201+0000","last_peered":"2024-09-10T06:26:52.727201+0000","last_clean":"2024-09-10T06:26:52.727201+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:26:52.727201+0000","last_undegraded":"2024-09-10T06:26:52.727201+0000","last_fullsized":"2024-09-10T06:26:52.727201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.726845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.812634+0000","last_change":"2024-09-10T06:27:06.812490+0000","last_active":"2024-09-10T06:27:06.812634+0000","last_peered":"2024-09-10T06:27:06.812634+0000","last_clean":"2024-09-10T06:27:06.812634+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:27:06.812634+0000","last_undegraded":"2024-09-10T06:27:06.812634+0000","last_fullsized":"2024-09-10T06:27:06.812634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.812279+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:02.301733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:58.861547+0000","last_change":"2024-09-10T06:22:39.877427+0000","last_active":"2024-09-10T06:24:58.861547+0000","last_peered":"2024-09-10T06:24:58.861547+0000","last_clean":"2024-09-10T06:24:58.861547+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:24:58.861547+0000","last_undegraded":"2024-09-10T06:24:58.861547+0000","last_fullsized":"2024-09-10T06:24:58.861547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.493991+0000","last_change":"2024-09-10T06:22:41.889617+0000","last_active":"2024-09-10T06:25:46.493991+0000","last_peered":"2024-09-10T06:25:46.493991+0000","last_clean":"2024-09-10T06:25:46.493991+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:25:46.493991+0000","last_undegraded":"2024-09-10T06:25:46.493991+0000","last_fullsized":"2024-09-10T06:25:46.493991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.209176+0000","last_change":"2024-09-10T06:26:55.209024+0000","last_active":"2024-09-10T06:26:55.209176+0000","last_peered":"2024-09-10T06:26:55.209176+0000","last_clean":"2024-09-10T06:26:55.209176+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:26:55.209176+0000","last_undegraded":"2024-09-10T06:26:55.209176+0000","last_fullsized":"2024-09-10T06:26:55.209176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.208816+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:39.866888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.181095+0000","last_change":"2024-09-10T06:26:32.180956+0000","last_active":"2024-09-10T06:26:32.181095+0000","last_peered":"2024-09-10T06:26:32.181095+0000","last_clean":"2024-09-10T06:26:32.181095+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:26:32.181095+0000","last_undegraded":"2024-09-10T06:26:32.181095+0000","last_fullsized":"2024-09-10T06:26:32.181095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.180772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:44.519421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.771357+0000","last_change":"2024-09-10T06:26:50.771226+0000","last_active":"2024-09-10T06:26:50.771357+0000","last_peered":"2024-09-10T06:26:50.771357+0000","last_clean":"2024-09-10T06:26:50.771357+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:26:50.771357+0000","last_undegraded":"2024-09-10T06:26:50.771357+0000","last_fullsized":"2024-09-10T06:26:50.771357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.771046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:01.764276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.886754+0000","last_change":"2024-09-10T06:27:00.886670+0000","last_active":"2024-09-10T06:27:00.886754+0000","last_peered":"2024-09-10T06:27:00.886754+0000","last_clean":"2024-09-10T06:27:00.886754+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:27:00.886754+0000","last_undegraded":"2024-09-10T06:27:00.886754+0000","last_fullsized":"2024-09-10T06:27:00.886754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.886552+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:20.328951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.950698+0000","last_change":"2024-09-10T06:27:06.950515+0000","last_active":"2024-09-10T06:27:06.950698+0000","last_peered":"2024-09-10T06:27:06.950698+0000","last_clean":"2024-09-10T06:27:06.950698+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:27:06.950698+0000","last_undegraded":"2024-09-10T06:27:06.950698+0000","last_fullsized":"2024-09-10T06:27:06.950698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.950332+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:45.058450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.048195+0000","last_change":"2024-09-10T06:27:16.048195+0000","last_active":"2024-09-10T06:27:16.048195+0000","last_peered":"2024-09-10T06:27:16.048195+0000","last_clean":"2024-09-10T06:27:16.048195+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:27:16.048195+0000","last_undegraded":"2024-09-10T06:27:16.048195+0000","last_fullsized":"2024-09-10T06:27:16.048195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.048009+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:54.490977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.678158+0000","last_change":"2024-09-10T06:26:39.678024+0000","last_active":"2024-09-10T06:26:39.678158+0000","last_peered":"2024-09-10T06:26:39.678158+0000","last_clean":"2024-09-10T06:26:39.678158+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:26:39.678158+0000","last_undegraded":"2024-09-10T06:26:39.678158+0000","last_fullsized":"2024-09-10T06:26:39.678158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.677842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:41.426578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.226344+0000","last_change":"2024-09-10T06:26:31.226136+0000","last_active":"2024-09-10T06:26:31.226344+0000","last_peered":"2024-09-10T06:26:31.226344+0000","last_clean":"2024-09-10T06:26:31.226344+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:26:31.226344+0000","last_undegraded":"2024-09-10T06:26:31.226344+0000","last_fullsized":"2024-09-10T06:26:31.226344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.225929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.623077+0000","last_change":"2024-09-10T06:26:56.622943+0000","last_active":"2024-09-10T06:26:56.623077+0000","last_peered":"2024-09-10T06:26:56.623077+0000","last_clean":"2024-09-10T06:26:56.623077+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:56.623077+0000","last_undegraded":"2024-09-10T06:26:56.623077+0000","last_fullsized":"2024-09-10T06:26:56.623077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.622754+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:30.308911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:53.859856+0000","last_change":"2024-09-10T06:22:37.863978+0000","last_active":"2024-09-10T06:24:53.859856+0000","last_peered":"2024-09-10T06:24:53.859856+0000","last_clean":"2024-09-10T06:24:53.859856+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:24:53.859856+0000","last_undegraded":"2024-09-10T06:24:53.859856+0000","last_fullsized":"2024-09-10T06:24:53.859856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.790722+0000","last_change":"2024-09-10T06:27:11.790567+0000","last_active":"2024-09-10T06:27:11.790722+0000","last_peered":"2024-09-10T06:27:11.790722+0000","last_clean":"2024-09-10T06:27:11.790722+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:27:11.790722+0000","last_undegraded":"2024-09-10T06:27:11.790722+0000","last_fullsized":"2024-09-10T06:27:11.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.790389+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:15.981073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.008058+0000","last_change":"2024-09-10T06:27:12.008058+0000","last_active":"2024-09-10T06:27:12.008058+0000","last_peered":"2024-09-10T06:27:12.008058+0000","last_clean":"2024-09-10T06:27:12.008058+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:27:12.008058+0000","last_undegraded":"2024-09-10T06:27:12.008058+0000","last_fullsized":"2024-09-10T06:27:12.008058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.007872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:58.932903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.706591+0000","last_change":"2024-09-10T06:26:38.706449+0000","last_active":"2024-09-10T06:26:38.706591+0000","last_peered":"2024-09-10T06:26:38.706591+0000","last_clean":"2024-09-10T06:26:38.706591+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:26:38.706591+0000","last_undegraded":"2024-09-10T06:26:38.706591+0000","last_fullsized":"2024-09-10T06:26:38.706591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.706224+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:22.987665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.163027+0000","last_change":"2024-09-10T06:26:29.162880+0000","last_active":"2024-09-10T06:26:29.163027+0000","last_peered":"2024-09-10T06:26:29.163027+0000","last_clean":"2024-09-10T06:26:29.163027+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:26:29.163027+0000","last_undegraded":"2024-09-10T06:26:29.163027+0000","last_fullsized":"2024-09-10T06:26:29.163027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.162701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:58.415388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.421200+0000","last_change":"2024-09-10T06:27:12.421200+0000","last_active":"2024-09-10T06:27:12.421200+0000","last_peered":"2024-09-10T06:27:12.421200+0000","last_clean":"2024-09-10T06:27:12.421200+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:27:12.421200+0000","last_undegraded":"2024-09-10T06:27:12.421200+0000","last_fullsized":"2024-09-10T06:27:12.421200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.421025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:07.088348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.793831+0000","last_change":"2024-09-10T06:27:07.793669+0000","last_active":"2024-09-10T06:27:07.793831+0000","last_peered":"2024-09-10T06:27:07.793831+0000","last_clean":"2024-09-10T06:27:07.793831+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:27:07.793831+0000","last_undegraded":"2024-09-10T06:27:07.793831+0000","last_fullsized":"2024-09-10T06:27:07.793831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.793475+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:45.277415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.913742+0000","last_change":"2024-09-10T06:27:05.913496+0000","last_active":"2024-09-10T06:27:05.913742+0000","last_peered":"2024-09-10T06:27:05.913742+0000","last_clean":"2024-09-10T06:27:05.913742+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:27:05.913742+0000","last_undegraded":"2024-09-10T06:27:05.913742+0000","last_fullsized":"2024-09-10T06:27:05.913742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.913303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:22.053524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.795898+0000","last_change":"2024-09-10T06:27:16.795898+0000","last_active":"2024-09-10T06:27:16.795898+0000","last_peered":"2024-09-10T06:27:16.795898+0000","last_clean":"2024-09-10T06:27:16.795898+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:27:16.795898+0000","last_undegraded":"2024-09-10T06:27:16.795898+0000","last_fullsized":"2024-09-10T06:27:16.795898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.795716+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:39.359169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.183922+0000","last_change":"2024-09-10T06:26:52.183922+0000","last_active":"2024-09-10T06:26:52.183922+0000","last_peered":"2024-09-10T06:26:52.183922+0000","last_clean":"2024-09-10T06:26:52.183922+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:26:52.183922+0000","last_undegraded":"2024-09-10T06:26:52.183922+0000","last_fullsized":"2024-09-10T06:26:52.183922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.183746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:24.557171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.430887+0000","last_change":"2024-09-10T06:26:21.430739+0000","last_active":"2024-09-10T06:26:21.430887+0000","last_peered":"2024-09-10T06:26:21.430887+0000","last_clean":"2024-09-10T06:26:21.430887+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:26:21.430887+0000","last_undegraded":"2024-09-10T06:26:21.430887+0000","last_fullsized":"2024-09-10T06:26:21.430887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.430530+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.906584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.133425+0000","last_change":"2024-09-10T06:26:25.133287+0000","last_active":"2024-09-10T06:26:25.133425+0000","last_peered":"2024-09-10T06:26:25.133425+0000","last_clean":"2024-09-10T06:26:25.133425+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:26:25.133425+0000","last_undegraded":"2024-09-10T06:26:25.133425+0000","last_fullsized":"2024-09-10T06:26:25.133425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.133112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:31.494004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.114495+0000","last_change":"2024-09-10T06:26:27.114356+0000","last_active":"2024-09-10T06:26:27.114495+0000","last_peered":"2024-09-10T06:26:27.114495+0000","last_clean":"2024-09-10T06:26:27.114495+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:26:27.114495+0000","last_undegraded":"2024-09-10T06:26:27.114495+0000","last_fullsized":"2024-09-10T06:26:27.114495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.114182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:12.450302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.706809+0000","last_change":"2024-09-10T06:27:02.706809+0000","last_active":"2024-09-10T06:27:02.706809+0000","last_peered":"2024-09-10T06:27:02.706809+0000","last_clean":"2024-09-10T06:27:02.706809+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:27:02.706809+0000","last_undegraded":"2024-09-10T06:27:02.706809+0000","last_fullsized":"2024-09-10T06:27:02.706809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.706627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:58.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.697090+0000","last_change":"2024-09-10T06:22:37.861040+0000","last_active":"2024-09-10T06:26:17.697090+0000","last_peered":"2024-09-10T06:26:17.697090+0000","last_clean":"2024-09-10T06:26:17.697090+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:26:17.697090+0000","last_undegraded":"2024-09-10T06:26:17.697090+0000","last_fullsized":"2024-09-10T06:26:17.697090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.133402+0000","last_change":"2024-09-10T06:27:07.133402+0000","last_active":"2024-09-10T06:27:07.133402+0000","last_peered":"2024-09-10T06:27:07.133402+0000","last_clean":"2024-09-10T06:27:07.133402+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:27:07.133402+0000","last_undegraded":"2024-09-10T06:27:07.133402+0000","last_fullsized":"2024-09-10T06:27:07.133402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.133224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:15.988185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.982002+0000","last_change":"2024-09-10T06:27:13.982002+0000","last_active":"2024-09-10T06:27:13.982002+0000","last_peered":"2024-09-10T06:27:13.982002+0000","last_clean":"2024-09-10T06:27:13.982002+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:27:13.982002+0000","last_undegraded":"2024-09-10T06:27:13.982002+0000","last_fullsized":"2024-09-10T06:27:13.982002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.981774+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:13.403816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.220282+0000","last_change":"2024-09-10T06:26:54.220282+0000","last_active":"2024-09-10T06:26:54.220282+0000","last_peered":"2024-09-10T06:26:54.220282+0000","last_clean":"2024-09-10T06:26:54.220282+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:26:54.220282+0000","last_undegraded":"2024-09-10T06:26:54.220282+0000","last_fullsized":"2024-09-10T06:26:54.220282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.220103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:38.687973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.062353+0000","last_change":"2024-09-10T06:26:23.062225+0000","last_active":"2024-09-10T06:26:23.062353+0000","last_peered":"2024-09-10T06:26:23.062353+0000","last_clean":"2024-09-10T06:26:23.062353+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:26:23.062353+0000","last_undegraded":"2024-09-10T06:26:23.062353+0000","last_fullsized":"2024-09-10T06:26:23.062353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.062051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:53.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.133509+0000","last_change":"2024-09-10T06:26:27.133378+0000","last_active":"2024-09-10T06:26:27.133509+0000","last_peered":"2024-09-10T06:26:27.133509+0000","last_clean":"2024-09-10T06:26:27.133509+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:26:27.133509+0000","last_undegraded":"2024-09-10T06:26:27.133509+0000","last_fullsized":"2024-09-10T06:26:27.133509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.133202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.725768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.373888+0000","last_change":"2024-09-10T06:27:11.373888+0000","last_active":"2024-09-10T06:27:11.373888+0000","last_peered":"2024-09-10T06:27:11.373888+0000","last_clean":"2024-09-10T06:27:11.373888+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:27:11.373888+0000","last_undegraded":"2024-09-10T06:27:11.373888+0000","last_fullsized":"2024-09-10T06:27:11.373888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.373710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:50.802747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":522,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.787324+0000","last_change":"2024-09-10T06:27:05.787324+0000","last_active":"2024-09-10T06:27:05.787324+0000","last_peered":"2024-09-10T06:27:05.787324+0000","last_clean":"2024-09-10T06:27:05.787324+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:27:05.787324+0000","last_undegraded":"2024-09-10T06:27:05.787324+0000","last_fullsized":"2024-09-10T06:27:05.787324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.787116+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:29.185370+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:48.858086+0000","last_change":"2024-09-10T06:22:39.878055+0000","last_active":"2024-09-10T06:24:48.858086+0000","last_peered":"2024-09-10T06:24:48.858086+0000","last_clean":"2024-09-10T06:24:48.858086+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:24:48.858086+0000","last_undegraded":"2024-09-10T06:24:48.858086+0000","last_fullsized":"2024-09-10T06:24:48.858086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851383+0000","last_change":"2024-09-10T06:22:41.886909+0000","last_active":"2024-09-10T06:24:52.851383+0000","last_peered":"2024-09-10T06:24:52.851383+0000","last_clean":"2024-09-10T06:24:52.851383+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:24:52.851383+0000","last_undegraded":"2024-09-10T06:24:52.851383+0000","last_fullsized":"2024-09-10T06:24:52.851383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.938954+0000","last_change":"2024-09-10T06:26:37.938819+0000","last_active":"2024-09-10T06:26:37.938954+0000","last_peered":"2024-09-10T06:26:37.938954+0000","last_clean":"2024-09-10T06:26:37.938954+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:26:37.938954+0000","last_undegraded":"2024-09-10T06:26:37.938954+0000","last_fullsized":"2024-09-10T06:26:37.938954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.938636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:58.249435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.534176+0000","last_change":"2024-09-10T06:26:22.533999+0000","last_active":"2024-09-10T06:26:22.534176+0000","last_peered":"2024-09-10T06:26:22.534176+0000","last_clean":"2024-09-10T06:26:22.534176+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:26:22.534176+0000","last_undegraded":"2024-09-10T06:26:22.534176+0000","last_fullsized":"2024-09-10T06:26:22.534176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.533815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:40.223076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.986222+0000","last_change":"2024-09-10T06:26:32.986222+0000","last_active":"2024-09-10T06:26:32.986222+0000","last_peered":"2024-09-10T06:26:32.986222+0000","last_clean":"2024-09-10T06:26:32.986222+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:26:32.986222+0000","last_undegraded":"2024-09-10T06:26:32.986222+0000","last_fullsized":"2024-09-10T06:26:32.986222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.986038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:36.552236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.774001+0000","last_change":"2024-09-10T06:26:51.773755+0000","last_active":"2024-09-10T06:26:51.774001+0000","last_peered":"2024-09-10T06:26:51.774001+0000","last_clean":"2024-09-10T06:26:51.774001+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:26:51.774001+0000","last_undegraded":"2024-09-10T06:26:51.774001+0000","last_fullsized":"2024-09-10T06:26:51.774001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.773529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:00.851784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.865605+0000","last_change":"2024-09-10T06:26:57.865605+0000","last_active":"2024-09-10T06:26:57.865605+0000","last_peered":"2024-09-10T06:26:57.865605+0000","last_clean":"2024-09-10T06:26:57.865605+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:26:57.865605+0000","last_undegraded":"2024-09-10T06:26:57.865605+0000","last_fullsized":"2024-09-10T06:26:57.865605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.865375+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:00.148660+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.048056+0000","last_change":"2024-09-10T06:27:05.048056+0000","last_active":"2024-09-10T06:27:05.048056+0000","last_peered":"2024-09-10T06:27:05.048056+0000","last_clean":"2024-09-10T06:27:05.048056+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:27:05.048056+0000","last_undegraded":"2024-09-10T06:27:05.048056+0000","last_fullsized":"2024-09-10T06:27:05.048056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.047881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:09.238565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.393708+0000","last_change":"2024-09-10T06:22:41.893274+0000","last_active":"2024-09-10T06:25:46.393708+0000","last_peered":"2024-09-10T06:25:46.393708+0000","last_clean":"2024-09-10T06:25:46.393708+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:25:46.393708+0000","last_undegraded":"2024-09-10T06:25:46.393708+0000","last_fullsized":"2024-09-10T06:25:46.393708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.937901+0000","last_change":"2024-09-10T06:26:35.937768+0000","last_active":"2024-09-10T06:26:35.937901+0000","last_peered":"2024-09-10T06:26:35.937901+0000","last_clean":"2024-09-10T06:26:35.937901+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:26:35.937901+0000","last_undegraded":"2024-09-10T06:26:35.937901+0000","last_fullsized":"2024-09-10T06:26:35.937901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.937562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:19.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.110596+0000","last_change":"2024-09-10T06:26:24.110300+0000","last_active":"2024-09-10T06:26:24.110596+0000","last_peered":"2024-09-10T06:26:24.110596+0000","last_clean":"2024-09-10T06:26:24.110596+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:26:24.110596+0000","last_undegraded":"2024-09-10T06:26:24.110596+0000","last_fullsized":"2024-09-10T06:26:24.110596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.110079+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:06.285600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.521768+0000","last_change":"2024-09-10T06:26:23.521588+0000","last_active":"2024-09-10T06:26:23.521768+0000","last_peered":"2024-09-10T06:26:23.521768+0000","last_clean":"2024-09-10T06:26:23.521768+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:26:23.521768+0000","last_undegraded":"2024-09-10T06:26:23.521768+0000","last_fullsized":"2024-09-10T06:26:23.521768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.521400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.804217+0000","last_change":"2024-09-10T06:26:47.804089+0000","last_active":"2024-09-10T06:26:47.804217+0000","last_peered":"2024-09-10T06:26:47.804217+0000","last_clean":"2024-09-10T06:26:47.804217+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:26:47.804217+0000","last_undegraded":"2024-09-10T06:26:47.804217+0000","last_fullsized":"2024-09-10T06:26:47.804217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.803914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:48.283325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.438193+0000","last_change":"2024-09-10T06:27:18.438193+0000","last_active":"2024-09-10T06:27:18.438193+0000","last_peered":"2024-09-10T06:27:18.438193+0000","last_clean":"2024-09-10T06:27:18.438193+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:27:18.438193+0000","last_undegraded":"2024-09-10T06:27:18.438193+0000","last_fullsized":"2024-09-10T06:27:18.438193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.437997+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:56.198406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:53.860018+0000","last_change":"2024-09-10T06:22:39.878426+0000","last_active":"2024-09-10T06:24:53.860018+0000","last_peered":"2024-09-10T06:24:53.860018+0000","last_clean":"2024-09-10T06:24:53.860018+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:24:53.860018+0000","last_undegraded":"2024-09-10T06:24:53.860018+0000","last_fullsized":"2024-09-10T06:24:53.860018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:52.851217+0000","last_change":"2024-09-10T06:22:41.891299+0000","last_active":"2024-09-10T06:24:52.851217+0000","last_peered":"2024-09-10T06:24:52.851217+0000","last_clean":"2024-09-10T06:24:52.851217+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:24:52.851217+0000","last_undegraded":"2024-09-10T06:24:52.851217+0000","last_fullsized":"2024-09-10T06:24:52.851217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.689351+0000","last_change":"2024-09-10T06:26:35.689163+0000","last_active":"2024-09-10T06:26:35.689351+0000","last_peered":"2024-09-10T06:26:35.689351+0000","last_clean":"2024-09-10T06:26:35.689351+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:26:35.689351+0000","last_undegraded":"2024-09-10T06:26:35.689351+0000","last_fullsized":"2024-09-10T06:26:35.689351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.688987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:31.604105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.490317+0000","last_change":"2024-09-10T06:26:24.490106+0000","last_active":"2024-09-10T06:26:24.490317+0000","last_peered":"2024-09-10T06:26:24.490317+0000","last_clean":"2024-09-10T06:26:24.490317+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:26:24.490317+0000","last_undegraded":"2024-09-10T06:26:24.490317+0000","last_fullsized":"2024-09-10T06:26:24.490317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.489901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:12.908340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.051982+0000","last_change":"2024-09-10T06:26:22.051863+0000","last_active":"2024-09-10T06:26:22.051982+0000","last_peered":"2024-09-10T06:26:22.051982+0000","last_clean":"2024-09-10T06:26:22.051982+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:26:22.051982+0000","last_undegraded":"2024-09-10T06:26:22.051982+0000","last_fullsized":"2024-09-10T06:26:22.051982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.051670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:16.319555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.777642+0000","last_change":"2024-09-10T06:26:52.777642+0000","last_active":"2024-09-10T06:26:52.777642+0000","last_peered":"2024-09-10T06:26:52.777642+0000","last_clean":"2024-09-10T06:26:52.777642+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:26:52.777642+0000","last_undegraded":"2024-09-10T06:26:52.777642+0000","last_fullsized":"2024-09-10T06:26:52.777642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.777465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:35.701349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.890446+0000","last_change":"2024-09-10T06:26:57.890446+0000","last_active":"2024-09-10T06:26:57.890446+0000","last_peered":"2024-09-10T06:26:57.890446+0000","last_clean":"2024-09-10T06:26:57.890446+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:57.890446+0000","last_undegraded":"2024-09-10T06:26:57.890446+0000","last_fullsized":"2024-09-10T06:26:57.890446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.890180+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:20.654790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.912572+0000","last_change":"2024-09-10T06:27:04.912572+0000","last_active":"2024-09-10T06:27:04.912572+0000","last_peered":"2024-09-10T06:27:04.912572+0000","last_clean":"2024-09-10T06:27:04.912572+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:27:04.912572+0000","last_undegraded":"2024-09-10T06:27:04.912572+0000","last_fullsized":"2024-09-10T06:27:04.912572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.912401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:17.835171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:57.847856+0000","last_change":"2024-09-10T06:22:41.874822+0000","last_active":"2024-09-10T06:24:57.847856+0000","last_peered":"2024-09-10T06:24:57.847856+0000","last_clean":"2024-09-10T06:24:57.847856+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:24:57.847856+0000","last_undegraded":"2024-09-10T06:24:57.847856+0000","last_fullsized":"2024-09-10T06:24:57.847856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.722988+0000","last_change":"2024-09-10T06:26:36.722846+0000","last_active":"2024-09-10T06:26:36.722988+0000","last_peered":"2024-09-10T06:26:36.722988+0000","last_clean":"2024-09-10T06:26:36.722988+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:26:36.722988+0000","last_undegraded":"2024-09-10T06:26:36.722988+0000","last_fullsized":"2024-09-10T06:26:36.722988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.722678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:48.489772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.119809+0000","last_change":"2024-09-10T06:26:26.119665+0000","last_active":"2024-09-10T06:26:26.119809+0000","last_peered":"2024-09-10T06:26:26.119809+0000","last_clean":"2024-09-10T06:26:26.119809+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:26:26.119809+0000","last_undegraded":"2024-09-10T06:26:26.119809+0000","last_fullsized":"2024-09-10T06:26:26.119809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.119470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:37.159096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.160188+0000","last_change":"2024-09-10T06:26:26.160035+0000","last_active":"2024-09-10T06:26:26.160188+0000","last_peered":"2024-09-10T06:26:26.160188+0000","last_clean":"2024-09-10T06:26:26.160188+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:26:26.160188+0000","last_undegraded":"2024-09-10T06:26:26.160188+0000","last_fullsized":"2024-09-10T06:26:26.160188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.159855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:31.433358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'2","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.403837+0000","last_change":"2024-09-10T06:27:10.403837+0000","last_active":"2024-09-10T06:27:10.403837+0000","last_peered":"2024-09-10T06:27:10.403837+0000","last_clean":"2024-09-10T06:27:10.403837+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:27:10.403837+0000","last_undegraded":"2024-09-10T06:27:10.403837+0000","last_fullsized":"2024-09-10T06:27:10.403837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.403652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:32.480460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.796424+0000","last_change":"2024-09-10T06:27:04.796424+0000","last_active":"2024-09-10T06:27:04.796424+0000","last_peered":"2024-09-10T06:27:04.796424+0000","last_clean":"2024-09-10T06:27:04.796424+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:27:04.796424+0000","last_undegraded":"2024-09-10T06:27:04.796424+0000","last_fullsized":"2024-09-10T06:27:04.796424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.796219+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:27.560828+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.790398+0000","last_change":"2024-09-10T06:27:10.790398+0000","last_active":"2024-09-10T06:27:10.790398+0000","last_peered":"2024-09-10T06:27:10.790398+0000","last_clean":"2024-09-10T06:27:10.790398+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:27:10.790398+0000","last_undegraded":"2024-09-10T06:27:10.790398+0000","last_fullsized":"2024-09-10T06:27:10.790398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.790197+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:52.737759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:45.902644+0000","last_change":"2024-09-10T06:22:41.894621+0000","last_active":"2024-09-10T06:25:45.902644+0000","last_peered":"2024-09-10T06:25:45.902644+0000","last_clean":"2024-09-10T06:25:45.902644+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:25:45.902644+0000","last_undegraded":"2024-09-10T06:25:45.902644+0000","last_fullsized":"2024-09-10T06:25:45.902644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.209654+0000","last_change":"2024-09-10T06:26:50.209654+0000","last_active":"2024-09-10T06:26:50.209654+0000","last_peered":"2024-09-10T06:26:50.209654+0000","last_clean":"2024-09-10T06:26:50.209654+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:26:50.209654+0000","last_undegraded":"2024-09-10T06:26:50.209654+0000","last_fullsized":"2024-09-10T06:26:50.209654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.209478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:06.513527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.188162+0000","last_change":"2024-09-10T06:26:30.188003+0000","last_active":"2024-09-10T06:26:30.188162+0000","last_peered":"2024-09-10T06:26:30.188162+0000","last_clean":"2024-09-10T06:26:30.188162+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:26:30.188162+0000","last_undegraded":"2024-09-10T06:26:30.188162+0000","last_fullsized":"2024-09-10T06:26:30.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.187831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:12.704769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.007778+0000","last_change":"2024-09-10T06:26:21.007725+0000","last_active":"2024-09-10T06:26:21.007778+0000","last_peered":"2024-09-10T06:26:21.007778+0000","last_clean":"2024-09-10T06:26:21.007778+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:26:21.007778+0000","last_undegraded":"2024-09-10T06:26:21.007778+0000","last_fullsized":"2024-09-10T06:26:21.007778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.007653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:45.011060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.355791+0000","last_change":"2024-09-10T06:27:09.355791+0000","last_active":"2024-09-10T06:27:09.355791+0000","last_peered":"2024-09-10T06:27:09.355791+0000","last_clean":"2024-09-10T06:27:09.355791+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:27:09.355791+0000","last_undegraded":"2024-09-10T06:27:09.355791+0000","last_fullsized":"2024-09-10T06:27:09.355791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.355613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:07.390539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.420797+0000","last_change":"2024-09-10T06:27:17.420797+0000","last_active":"2024-09-10T06:27:17.420797+0000","last_peered":"2024-09-10T06:27:17.420797+0000","last_clean":"2024-09-10T06:27:17.420797+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:27:17.420797+0000","last_undegraded":"2024-09-10T06:27:17.420797+0000","last_fullsized":"2024-09-10T06:27:17.420797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.420603+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:02.195942+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.048731+0000","last_change":"2024-09-10T06:27:04.048731+0000","last_active":"2024-09-10T06:27:04.048731+0000","last_peered":"2024-09-10T06:27:04.048731+0000","last_clean":"2024-09-10T06:27:04.048731+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:27:04.048731+0000","last_undegraded":"2024-09-10T06:27:04.048731+0000","last_fullsized":"2024-09-10T06:27:04.048731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.048546+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:45.996107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:57.852540+0000","last_change":"2024-09-10T06:22:41.890653+0000","last_active":"2024-09-10T06:24:57.852540+0000","last_peered":"2024-09-10T06:24:57.852540+0000","last_clean":"2024-09-10T06:24:57.852540+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:24:57.852540+0000","last_undegraded":"2024-09-10T06:24:57.852540+0000","last_fullsized":"2024-09-10T06:24:57.852540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.502161+0000","last_change":"2024-09-10T06:26:35.501999+0000","last_active":"2024-09-10T06:26:35.502161+0000","last_peered":"2024-09-10T06:26:35.502161+0000","last_clean":"2024-09-10T06:26:35.502161+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:26:35.502161+0000","last_undegraded":"2024-09-10T06:26:35.502161+0000","last_fullsized":"2024-09-10T06:26:35.502161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.501822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:29.856717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.433328+0000","last_change":"2024-09-10T06:26:22.433192+0000","last_active":"2024-09-10T06:26:22.433328+0000","last_peered":"2024-09-10T06:26:22.433328+0000","last_clean":"2024-09-10T06:26:22.433328+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:26:22.433328+0000","last_undegraded":"2024-09-10T06:26:22.433328+0000","last_fullsized":"2024-09-10T06:26:22.433328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.433009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.297315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.163161+0000","last_change":"2024-09-10T06:26:28.163027+0000","last_active":"2024-09-10T06:26:28.163161+0000","last_peered":"2024-09-10T06:26:28.163161+0000","last_clean":"2024-09-10T06:26:28.163161+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:26:28.163161+0000","last_undegraded":"2024-09-10T06:26:28.163161+0000","last_fullsized":"2024-09-10T06:26:28.163161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.162858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:23.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.345259+0000","last_change":"2024-09-10T06:27:07.345259+0000","last_active":"2024-09-10T06:27:07.345259+0000","last_peered":"2024-09-10T06:27:07.345259+0000","last_clean":"2024-09-10T06:27:07.345259+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:27:07.345259+0000","last_undegraded":"2024-09-10T06:27:07.345259+0000","last_fullsized":"2024-09-10T06:27:07.345259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.345085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.226244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'99","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.822092+0000","last_change":"2024-09-10T06:26:58.822092+0000","last_active":"2024-09-10T06:26:58.822092+0000","last_peered":"2024-09-10T06:26:58.822092+0000","last_clean":"2024-09-10T06:26:58.822092+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:58.822092+0000","last_undegraded":"2024-09-10T06:26:58.822092+0000","last_fullsized":"2024-09-10T06:26:58.822092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.821871+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:30.069598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.089281+0000","last_change":"2024-09-10T06:27:06.089281+0000","last_active":"2024-09-10T06:27:06.089281+0000","last_peered":"2024-09-10T06:27:06.089281+0000","last_clean":"2024-09-10T06:27:06.089281+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:27:06.089281+0000","last_undegraded":"2024-09-10T06:27:06.089281+0000","last_fullsized":"2024-09-10T06:27:06.089281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.089099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:07.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.993365+0000","last_change":"2024-09-10T06:27:14.993365+0000","last_active":"2024-09-10T06:27:14.993365+0000","last_peered":"2024-09-10T06:27:14.993365+0000","last_clean":"2024-09-10T06:27:14.993365+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:27:14.993365+0000","last_undegraded":"2024-09-10T06:27:14.993365+0000","last_fullsized":"2024-09-10T06:27:14.993365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.993162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:56.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.936482+0000","last_change":"2024-09-10T06:27:16.936482+0000","last_active":"2024-09-10T06:27:16.936482+0000","last_peered":"2024-09-10T06:27:16.936482+0000","last_clean":"2024-09-10T06:27:16.936482+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:27:16.936482+0000","last_undegraded":"2024-09-10T06:27:16.936482+0000","last_fullsized":"2024-09-10T06:27:16.936482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.936302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:29.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.698416+0000","last_change":"2024-09-10T06:26:41.698211+0000","last_active":"2024-09-10T06:26:41.698416+0000","last_peered":"2024-09-10T06:26:41.698416+0000","last_clean":"2024-09-10T06:26:41.698416+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:26:41.698416+0000","last_undegraded":"2024-09-10T06:26:41.698416+0000","last_fullsized":"2024-09-10T06:26:41.698416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.698029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.247060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.306906+0000","last_change":"2024-09-10T06:26:37.306783+0000","last_active":"2024-09-10T06:26:37.306906+0000","last_peered":"2024-09-10T06:26:37.306906+0000","last_clean":"2024-09-10T06:26:37.306906+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:26:37.306906+0000","last_undegraded":"2024-09-10T06:26:37.306906+0000","last_fullsized":"2024-09-10T06:26:37.306906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.306607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:41.035747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.651045+0000","last_change":"2024-09-10T06:26:57.650913+0000","last_active":"2024-09-10T06:26:57.651045+0000","last_peered":"2024-09-10T06:26:57.651045+0000","last_clean":"2024-09-10T06:26:57.651045+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:26:57.651045+0000","last_undegraded":"2024-09-10T06:26:57.651045+0000","last_fullsized":"2024-09-10T06:26:57.651045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.650735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:08.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.712925+0000","last_change":"2024-09-10T06:22:37.853704+0000","last_active":"2024-09-10T06:26:17.712925+0000","last_peered":"2024-09-10T06:26:17.712925+0000","last_clean":"2024-09-10T06:26:17.712925+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:26:17.712925+0000","last_undegraded":"2024-09-10T06:26:17.712925+0000","last_fullsized":"2024-09-10T06:26:17.712925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.845272+0000","last_change":"2024-09-10T06:22:39.878735+0000","last_active":"2024-09-10T06:23:12.845272+0000","last_peered":"2024-09-10T06:23:12.845272+0000","last_clean":"2024-09-10T06:23:12.845272+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:23:12.845272+0000","last_undegraded":"2024-09-10T06:23:12.845272+0000","last_fullsized":"2024-09-10T06:23:12.845272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:24.216961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:42.874538+0000","last_change":"2024-09-10T06:22:41.861821+0000","last_active":"2024-09-10T06:24:42.874538+0000","last_peered":"2024-09-10T06:24:42.874538+0000","last_clean":"2024-09-10T06:24:42.874538+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:24:42.874538+0000","last_undegraded":"2024-09-10T06:24:42.874538+0000","last_fullsized":"2024-09-10T06:24:42.874538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.686921+0000","last_change":"2024-09-10T06:26:40.686734+0000","last_active":"2024-09-10T06:26:40.686921+0000","last_peered":"2024-09-10T06:26:40.686921+0000","last_clean":"2024-09-10T06:26:40.686921+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:26:40.686921+0000","last_undegraded":"2024-09-10T06:26:40.686921+0000","last_fullsized":"2024-09-10T06:26:40.686921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.686561+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:13.693128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.467698+0000","last_change":"2024-09-10T06:26:27.467698+0000","last_active":"2024-09-10T06:26:27.467698+0000","last_peered":"2024-09-10T06:26:27.467698+0000","last_clean":"2024-09-10T06:26:27.467698+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:26:27.467698+0000","last_undegraded":"2024-09-10T06:26:27.467698+0000","last_fullsized":"2024-09-10T06:26:27.467698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.467505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:10.628970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.402798+0000","last_change":"2024-09-10T06:27:14.402653+0000","last_active":"2024-09-10T06:27:14.402798+0000","last_peered":"2024-09-10T06:27:14.402798+0000","last_clean":"2024-09-10T06:27:14.402798+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:27:14.402798+0000","last_undegraded":"2024-09-10T06:27:14.402798+0000","last_fullsized":"2024-09-10T06:27:14.402798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.402479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:30.712632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.999318+0000","last_change":"2024-09-10T06:27:02.999232+0000","last_active":"2024-09-10T06:27:02.999318+0000","last_peered":"2024-09-10T06:27:02.999318+0000","last_clean":"2024-09-10T06:27:02.999318+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:27:02.999318+0000","last_undegraded":"2024-09-10T06:27:02.999318+0000","last_fullsized":"2024-09-10T06:27:02.999318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.999134+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:14.858999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.001609+0000","last_change":"2024-09-10T06:27:09.001426+0000","last_active":"2024-09-10T06:27:09.001609+0000","last_peered":"2024-09-10T06:27:09.001609+0000","last_clean":"2024-09-10T06:27:09.001609+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:27:09.001609+0000","last_undegraded":"2024-09-10T06:27:09.001609+0000","last_fullsized":"2024-09-10T06:27:09.001609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.001237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:24.656485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:00.152487+0000","last_change":"2024-09-10T06:22:41.882146+0000","last_active":"2024-09-10T06:24:00.152487+0000","last_peered":"2024-09-10T06:24:00.152487+0000","last_clean":"2024-09-10T06:24:00.152487+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:24:00.152487+0000","last_undegraded":"2024-09-10T06:24:00.152487+0000","last_fullsized":"2024-09-10T06:24:00.152487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:56.246604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.840752+0000","last_change":"2024-09-10T06:26:42.840670+0000","last_active":"2024-09-10T06:26:42.840752+0000","last_peered":"2024-09-10T06:26:42.840752+0000","last_clean":"2024-09-10T06:26:42.840752+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:26:42.840752+0000","last_undegraded":"2024-09-10T06:26:42.840752+0000","last_fullsized":"2024-09-10T06:26:42.840752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.840563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:01.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.412608+0000","last_change":"2024-09-10T06:26:30.412608+0000","last_active":"2024-09-10T06:26:30.412608+0000","last_peered":"2024-09-10T06:26:30.412608+0000","last_clean":"2024-09-10T06:26:30.412608+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:26:30.412608+0000","last_undegraded":"2024-09-10T06:26:30.412608+0000","last_fullsized":"2024-09-10T06:26:30.412608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.412443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:27.375871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.706963+0000","last_change":"2024-09-10T06:26:53.706775+0000","last_active":"2024-09-10T06:26:53.706963+0000","last_peered":"2024-09-10T06:26:53.706963+0000","last_clean":"2024-09-10T06:26:53.706963+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:26:53.706963+0000","last_undegraded":"2024-09-10T06:26:53.706963+0000","last_fullsized":"2024-09-10T06:26:53.706963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.706565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:21.763699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.868501+0000","last_change":"2024-09-10T06:26:55.868369+0000","last_active":"2024-09-10T06:26:55.868501+0000","last_peered":"2024-09-10T06:26:55.868501+0000","last_clean":"2024-09-10T06:26:55.868501+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:55.868501+0000","last_undegraded":"2024-09-10T06:26:55.868501+0000","last_fullsized":"2024-09-10T06:26:55.868501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.868167+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:51.332406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.805908+0000","last_change":"2024-09-10T06:27:12.805908+0000","last_active":"2024-09-10T06:27:12.805908+0000","last_peered":"2024-09-10T06:27:12.805908+0000","last_clean":"2024-09-10T06:27:12.805908+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:27:12.805908+0000","last_undegraded":"2024-09-10T06:27:12.805908+0000","last_fullsized":"2024-09-10T06:27:12.805908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.805731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.319488+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.319488+0000","last_peered":"2024-09-10T06:25:46.319488+0000","last_clean":"2024-09-10T06:25:46.319488+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.319488+0000","last_undegraded":"2024-09-10T06:25:46.319488+0000","last_fullsized":"2024-09-10T06:25:46.319488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:39.907112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.197383+0000","last_change":"2024-09-10T06:26:56.197236+0000","last_active":"2024-09-10T06:26:56.197383+0000","last_peered":"2024-09-10T06:26:56.197383+0000","last_clean":"2024-09-10T06:26:56.197383+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:26:56.197383+0000","last_undegraded":"2024-09-10T06:26:56.197383+0000","last_fullsized":"2024-09-10T06:26:56.197383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.197045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:27.788695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.483285+0000","last_change":"2024-09-10T06:26:24.483285+0000","last_active":"2024-09-10T06:26:24.483285+0000","last_peered":"2024-09-10T06:26:24.483285+0000","last_clean":"2024-09-10T06:26:24.483285+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:26:24.483285+0000","last_undegraded":"2024-09-10T06:26:24.483285+0000","last_fullsized":"2024-09-10T06:26:24.483285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.483039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:30.019052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.449473+0000","last_change":"2024-09-10T06:27:13.449345+0000","last_active":"2024-09-10T06:27:13.449473+0000","last_peered":"2024-09-10T06:27:13.449473+0000","last_clean":"2024-09-10T06:27:13.449473+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:27:13.449473+0000","last_undegraded":"2024-09-10T06:27:13.449473+0000","last_fullsized":"2024-09-10T06:27:13.449473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.449177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:41.642297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.921176+0000","last_change":"2024-09-10T06:27:01.921006+0000","last_active":"2024-09-10T06:27:01.921176+0000","last_peered":"2024-09-10T06:27:01.921176+0000","last_clean":"2024-09-10T06:27:01.921176+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:27:01.921176+0000","last_undegraded":"2024-09-10T06:27:01.921176+0000","last_fullsized":"2024-09-10T06:27:01.921176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.920831+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:20.056861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.983740+0000","last_change":"2024-09-10T06:27:07.983513+0000","last_active":"2024-09-10T06:27:07.983740+0000","last_peered":"2024-09-10T06:27:07.983740+0000","last_clean":"2024-09-10T06:27:07.983740+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:27:07.983740+0000","last_undegraded":"2024-09-10T06:27:07.983740+0000","last_fullsized":"2024-09-10T06:27:07.983740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.983266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.860758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.277414+0000","last_change":"2024-09-10T06:27:02.277414+0000","last_active":"2024-09-10T06:27:02.277414+0000","last_peered":"2024-09-10T06:27:02.277414+0000","last_clean":"2024-09-10T06:27:02.277414+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:27:02.277414+0000","last_undegraded":"2024-09-10T06:27:02.277414+0000","last_fullsized":"2024-09-10T06:27:02.277414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.277228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:05.739551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.321035+0000","last_change":"2024-09-10T06:26:38.321035+0000","last_active":"2024-09-10T06:26:38.321035+0000","last_peered":"2024-09-10T06:26:38.321035+0000","last_clean":"2024-09-10T06:26:38.321035+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:26:38.321035+0000","last_undegraded":"2024-09-10T06:26:38.321035+0000","last_fullsized":"2024-09-10T06:26:38.321035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.320842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:44.932697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.937445+0000","last_change":"2024-09-10T06:27:00.937445+0000","last_active":"2024-09-10T06:27:00.937445+0000","last_peered":"2024-09-10T06:27:00.937445+0000","last_clean":"2024-09-10T06:27:00.937445+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:27:00.937445+0000","last_undegraded":"2024-09-10T06:27:00.937445+0000","last_fullsized":"2024-09-10T06:27:00.937445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.937205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:38.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'65","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.901653+0000","last_change":"2024-09-10T06:26:58.901653+0000","last_active":"2024-09-10T06:26:58.901653+0000","last_peered":"2024-09-10T06:26:58.901653+0000","last_clean":"2024-09-10T06:26:58.901653+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:58.901653+0000","last_undegraded":"2024-09-10T06:26:58.901653+0000","last_fullsized":"2024-09-10T06:26:58.901653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.901461+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:22.299716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.993773+0000","last_change":"2024-09-10T06:27:09.993773+0000","last_active":"2024-09-10T06:27:09.993773+0000","last_peered":"2024-09-10T06:27:09.993773+0000","last_clean":"2024-09-10T06:27:09.993773+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:27:09.993773+0000","last_undegraded":"2024-09-10T06:27:09.993773+0000","last_fullsized":"2024-09-10T06:27:09.993773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.993589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:47.114955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.141443+0000","last_change":"2024-09-10T06:22:41.878148+0000","last_active":"2024-09-10T06:24:45.141443+0000","last_peered":"2024-09-10T06:24:45.141443+0000","last_clean":"2024-09-10T06:24:45.141443+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:24:45.141443+0000","last_undegraded":"2024-09-10T06:24:45.141443+0000","last_fullsized":"2024-09-10T06:24:45.141443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.985592+0000","last_change":"2024-09-10T06:26:33.985592+0000","last_active":"2024-09-10T06:26:33.985592+0000","last_peered":"2024-09-10T06:26:33.985592+0000","last_clean":"2024-09-10T06:26:33.985592+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:26:33.985592+0000","last_undegraded":"2024-09-10T06:26:33.985592+0000","last_fullsized":"2024-09-10T06:26:33.985592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.985394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.488251+0000","last_change":"2024-09-10T06:26:25.488251+0000","last_active":"2024-09-10T06:26:25.488251+0000","last_peered":"2024-09-10T06:26:25.488251+0000","last_clean":"2024-09-10T06:26:25.488251+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:26:25.488251+0000","last_undegraded":"2024-09-10T06:26:25.488251+0000","last_fullsized":"2024-09-10T06:26:25.488251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.488065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:13.168721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.813155+0000","last_change":"2024-09-10T06:26:56.813155+0000","last_active":"2024-09-10T06:26:56.813155+0000","last_peered":"2024-09-10T06:26:56.813155+0000","last_clean":"2024-09-10T06:26:56.813155+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:56.813155+0000","last_undegraded":"2024-09-10T06:26:56.813155+0000","last_fullsized":"2024-09-10T06:26:56.813155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.812957+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:18.279075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.592680+0000","last_change":"2024-09-10T06:22:37.859623+0000","last_active":"2024-09-10T06:26:17.592680+0000","last_peered":"2024-09-10T06:26:17.592680+0000","last_clean":"2024-09-10T06:26:17.592680+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:26:17.592680+0000","last_undegraded":"2024-09-10T06:26:17.592680+0000","last_fullsized":"2024-09-10T06:26:17.592680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.732512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.796522+0000","last_change":"2024-09-10T06:27:15.796522+0000","last_active":"2024-09-10T06:27:15.796522+0000","last_peered":"2024-09-10T06:27:15.796522+0000","last_clean":"2024-09-10T06:27:15.796522+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:27:15.796522+0000","last_undegraded":"2024-09-10T06:27:15.796522+0000","last_fullsized":"2024-09-10T06:27:15.796522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.796342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.065806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836193+0000","last_change":"2024-09-10T06:22:41.890034+0000","last_active":"2024-09-10T06:23:12.836193+0000","last_peered":"2024-09-10T06:23:12.836193+0000","last_clean":"2024-09-10T06:23:12.836193+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:23:12.836193+0000","last_undegraded":"2024-09-10T06:23:12.836193+0000","last_fullsized":"2024-09-10T06:23:12.836193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:09.793674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'16","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.308555+0000","last_change":"2024-09-10T06:27:01.308555+0000","last_active":"2024-09-10T06:27:01.308555+0000","last_peered":"2024-09-10T06:27:01.308555+0000","last_clean":"2024-09-10T06:27:01.308555+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:27:01.308555+0000","last_undegraded":"2024-09-10T06:27:01.308555+0000","last_fullsized":"2024-09-10T06:27:01.308555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.308357+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:22.145053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.472997+0000","last_change":"2024-09-10T06:26:26.472997+0000","last_active":"2024-09-10T06:26:26.472997+0000","last_peered":"2024-09-10T06:26:26.472997+0000","last_clean":"2024-09-10T06:26:26.472997+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:26:26.472997+0000","last_undegraded":"2024-09-10T06:26:26.472997+0000","last_fullsized":"2024-09-10T06:26:26.472997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.472822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:54.495647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.792297+0000","last_change":"2024-09-10T06:26:55.792297+0000","last_active":"2024-09-10T06:26:55.792297+0000","last_peered":"2024-09-10T06:26:55.792297+0000","last_clean":"2024-09-10T06:26:55.792297+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:26:55.792297+0000","last_undegraded":"2024-09-10T06:26:55.792297+0000","last_fullsized":"2024-09-10T06:26:55.792297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.792027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:33.611842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.936936+0000","last_change":"2024-09-10T06:26:59.936936+0000","last_active":"2024-09-10T06:26:59.936936+0000","last_peered":"2024-09-10T06:26:59.936936+0000","last_clean":"2024-09-10T06:26:59.936936+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:59.936936+0000","last_undegraded":"2024-09-10T06:26:59.936936+0000","last_fullsized":"2024-09-10T06:26:59.936936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.936687+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:55.426141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.067168+0000","last_change":"2024-09-10T06:27:15.067168+0000","last_active":"2024-09-10T06:27:15.067168+0000","last_peered":"2024-09-10T06:27:15.067168+0000","last_clean":"2024-09-10T06:27:15.067168+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:27:15.067168+0000","last_undegraded":"2024-09-10T06:27:15.067168+0000","last_fullsized":"2024-09-10T06:27:15.067168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.066985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:17.002362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.286206+0000","last_change":"2024-09-10T06:22:41.887327+0000","last_active":"2024-09-10T06:24:45.286206+0000","last_peered":"2024-09-10T06:24:45.286206+0000","last_clean":"2024-09-10T06:24:45.286206+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:24:45.286206+0000","last_undegraded":"2024-09-10T06:24:45.286206+0000","last_fullsized":"2024-09-10T06:24:45.286206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.845005+0000","last_change":"2024-09-10T06:26:41.845005+0000","last_active":"2024-09-10T06:26:41.845005+0000","last_peered":"2024-09-10T06:26:41.845005+0000","last_clean":"2024-09-10T06:26:41.845005+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:26:41.845005+0000","last_undegraded":"2024-09-10T06:26:41.845005+0000","last_fullsized":"2024-09-10T06:26:41.845005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.844823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:18.354085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.271903+0000","last_change":"2024-09-10T06:26:40.271903+0000","last_active":"2024-09-10T06:26:40.271903+0000","last_peered":"2024-09-10T06:26:40.271903+0000","last_clean":"2024-09-10T06:26:40.271903+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:26:40.271903+0000","last_undegraded":"2024-09-10T06:26:40.271903+0000","last_fullsized":"2024-09-10T06:26:40.271903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.271701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.922441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.747006+0000","last_change":"2024-09-10T06:27:03.747006+0000","last_active":"2024-09-10T06:27:03.747006+0000","last_peered":"2024-09-10T06:27:03.747006+0000","last_clean":"2024-09-10T06:27:03.747006+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:27:03.747006+0000","last_undegraded":"2024-09-10T06:27:03.747006+0000","last_fullsized":"2024-09-10T06:27:03.747006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.746826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.502760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:38.856277+0000","last_change":"2024-09-10T06:22:37.861773+0000","last_active":"2024-09-10T06:24:38.856277+0000","last_peered":"2024-09-10T06:24:38.856277+0000","last_clean":"2024-09-10T06:24:38.856277+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:24:38.856277+0000","last_undegraded":"2024-09-10T06:24:38.856277+0000","last_fullsized":"2024-09-10T06:24:38.856277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":432,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.961886+0000","last_change":"2024-09-10T06:27:10.961886+0000","last_active":"2024-09-10T06:27:10.961886+0000","last_peered":"2024-09-10T06:27:10.961886+0000","last_clean":"2024-09-10T06:27:10.961886+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:27:10.961886+0000","last_undegraded":"2024-09-10T06:27:10.961886+0000","last_fullsized":"2024-09-10T06:27:10.961886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.961678+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:56.160209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:45.290628+0000","last_change":"2024-09-10T06:22:41.885414+0000","last_active":"2024-09-10T06:24:45.290628+0000","last_peered":"2024-09-10T06:24:45.290628+0000","last_clean":"2024-09-10T06:24:45.290628+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:24:45.290628+0000","last_undegraded":"2024-09-10T06:24:45.290628+0000","last_fullsized":"2024-09-10T06:24:45.290628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:22.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.766249+0000","last_change":"2024-09-10T06:26:43.766249+0000","last_active":"2024-09-10T06:26:43.766249+0000","last_peered":"2024-09-10T06:26:43.766249+0000","last_clean":"2024-09-10T06:26:43.766249+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:26:43.766249+0000","last_undegraded":"2024-09-10T06:26:43.766249+0000","last_fullsized":"2024-09-10T06:26:43.766249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.766065+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:03.179883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.514686+0000","last_change":"2024-09-10T06:26:27.514686+0000","last_active":"2024-09-10T06:26:27.514686+0000","last_peered":"2024-09-10T06:26:27.514686+0000","last_clean":"2024-09-10T06:26:27.514686+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:26:27.514686+0000","last_undegraded":"2024-09-10T06:26:27.514686+0000","last_fullsized":"2024-09-10T06:26:27.514686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.514477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:51.644214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.735972+0000","last_change":"2024-09-10T06:27:00.735972+0000","last_active":"2024-09-10T06:27:00.735972+0000","last_peered":"2024-09-10T06:27:00.735972+0000","last_clean":"2024-09-10T06:27:00.735972+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:27:00.735972+0000","last_undegraded":"2024-09-10T06:27:00.735972+0000","last_fullsized":"2024-09-10T06:27:00.735972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.735767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:43.205771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'47","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.833538+0000","last_change":"2024-09-10T06:27:09.833538+0000","last_active":"2024-09-10T06:27:09.833538+0000","last_peered":"2024-09-10T06:27:09.833538+0000","last_clean":"2024-09-10T06:27:09.833538+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:27:09.833538+0000","last_undegraded":"2024-09-10T06:27:09.833538+0000","last_fullsized":"2024-09-10T06:27:09.833538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.833326+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:21.693191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.090734+0000","last_change":"2024-09-10T06:27:14.090734+0000","last_active":"2024-09-10T06:27:14.090734+0000","last_peered":"2024-09-10T06:27:14.090734+0000","last_clean":"2024-09-10T06:27:14.090734+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:27:14.090734+0000","last_undegraded":"2024-09-10T06:27:14.090734+0000","last_fullsized":"2024-09-10T06:27:14.090734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.090548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:13.867204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.862855+0000","last_change":"2024-09-10T06:22:41.880183+0000","last_active":"2024-09-10T06:23:12.862855+0000","last_peered":"2024-09-10T06:23:12.862855+0000","last_clean":"2024-09-10T06:23:12.862855+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:23:12.862855+0000","last_undegraded":"2024-09-10T06:23:12.862855+0000","last_fullsized":"2024-09-10T06:23:12.862855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:31.517305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.853350+0000","last_change":"2024-09-10T06:26:48.853350+0000","last_active":"2024-09-10T06:26:48.853350+0000","last_peered":"2024-09-10T06:26:48.853350+0000","last_clean":"2024-09-10T06:26:48.853350+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:26:48.853350+0000","last_undegraded":"2024-09-10T06:26:48.853350+0000","last_fullsized":"2024-09-10T06:26:48.853350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.853173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.980423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.320847+0000","last_change":"2024-09-10T06:26:39.320847+0000","last_active":"2024-09-10T06:26:39.320847+0000","last_peered":"2024-09-10T06:26:39.320847+0000","last_clean":"2024-09-10T06:26:39.320847+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:26:39.320847+0000","last_undegraded":"2024-09-10T06:26:39.320847+0000","last_fullsized":"2024-09-10T06:26:39.320847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.320667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:50.205168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.748950+0000","last_change":"2024-09-10T06:26:54.748950+0000","last_active":"2024-09-10T06:26:54.748950+0000","last_peered":"2024-09-10T06:26:54.748950+0000","last_clean":"2024-09-10T06:26:54.748950+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:26:54.748950+0000","last_undegraded":"2024-09-10T06:26:54.748950+0000","last_fullsized":"2024-09-10T06:26:54.748950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.748750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:36.180223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.954819+0000","last_change":"2024-09-10T06:27:01.954819+0000","last_active":"2024-09-10T06:27:01.954819+0000","last_peered":"2024-09-10T06:27:01.954819+0000","last_clean":"2024-09-10T06:27:01.954819+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:27:01.954819+0000","last_undegraded":"2024-09-10T06:27:01.954819+0000","last_fullsized":"2024-09-10T06:27:01.954819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.954628+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.462199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837377+0000","last_change":"2024-09-10T06:22:39.877988+0000","last_active":"2024-09-10T06:23:12.837377+0000","last_peered":"2024-09-10T06:23:12.837377+0000","last_clean":"2024-09-10T06:23:12.837377+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:23:12.837377+0000","last_undegraded":"2024-09-10T06:23:12.837377+0000","last_fullsized":"2024-09-10T06:23:12.837377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.292979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.837805+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:23:12.837805+0000","last_peered":"2024-09-10T06:23:12.837805+0000","last_clean":"2024-09-10T06:23:12.837805+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:23:12.837805+0000","last_undegraded":"2024-09-10T06:23:12.837805+0000","last_fullsized":"2024-09-10T06:23:12.837805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:33.479201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.265691+0000","last_change":"2024-09-10T06:27:00.265691+0000","last_active":"2024-09-10T06:27:00.265691+0000","last_peered":"2024-09-10T06:27:00.265691+0000","last_clean":"2024-09-10T06:27:00.265691+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:27:00.265691+0000","last_undegraded":"2024-09-10T06:27:00.265691+0000","last_fullsized":"2024-09-10T06:27:00.265691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.265499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:33.791297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.100568+0000","last_change":"2024-09-10T06:26:24.100296+0000","last_active":"2024-09-10T06:26:24.100568+0000","last_peered":"2024-09-10T06:26:24.100568+0000","last_clean":"2024-09-10T06:26:24.100568+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:26:24.100568+0000","last_undegraded":"2024-09-10T06:26:24.100568+0000","last_fullsized":"2024-09-10T06:26:24.100568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.100028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:50.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.731771+0000","last_change":"2024-09-10T06:26:59.731771+0000","last_active":"2024-09-10T06:26:59.731771+0000","last_peered":"2024-09-10T06:26:59.731771+0000","last_clean":"2024-09-10T06:26:59.731771+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:26:59.731771+0000","last_undegraded":"2024-09-10T06:26:59.731771+0000","last_fullsized":"2024-09-10T06:26:59.731771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.731593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:42.655477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.457971+0000","last_change":"2024-09-10T06:22:37.860127+0000","last_active":"2024-09-10T06:26:17.457971+0000","last_peered":"2024-09-10T06:26:17.457971+0000","last_clean":"2024-09-10T06:26:17.457971+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:26:17.457971+0000","last_undegraded":"2024-09-10T06:26:17.457971+0000","last_fullsized":"2024-09-10T06:26:17.457971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:23:12.836633+0000","last_change":"2024-09-10T06:22:39.877350+0000","last_active":"2024-09-10T06:23:12.836633+0000","last_peered":"2024-09-10T06:23:12.836633+0000","last_clean":"2024-09-10T06:23:12.836633+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:23:12.836633+0000","last_undegraded":"2024-09-10T06:23:12.836633+0000","last_fullsized":"2024-09-10T06:23:12.836633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:38.812352+0000","last_clean_scrub_stamp":"2024-09-10T06:22:38.812352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:17.373429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.296696+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:24:43.296696+0000","last_peered":"2024-09-10T06:24:43.296696+0000","last_clean":"2024-09-10T06:24:43.296696+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:24:43.296696+0000","last_undegraded":"2024-09-10T06:24:43.296696+0000","last_fullsized":"2024-09-10T06:24:43.296696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:25.956482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.677762+0000","last_change":"2024-09-10T06:26:40.677762+0000","last_active":"2024-09-10T06:26:40.677762+0000","last_peered":"2024-09-10T06:26:40.677762+0000","last_clean":"2024-09-10T06:26:40.677762+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:26:40.677762+0000","last_undegraded":"2024-09-10T06:26:40.677762+0000","last_fullsized":"2024-09-10T06:26:40.677762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.677546+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:35.665500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.482430+0000","last_change":"2024-09-10T06:26:28.482269+0000","last_active":"2024-09-10T06:26:28.482430+0000","last_peered":"2024-09-10T06:26:28.482430+0000","last_clean":"2024-09-10T06:26:28.482430+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:26:28.482430+0000","last_undegraded":"2024-09-10T06:26:28.482430+0000","last_fullsized":"2024-09-10T06:26:28.482430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.482098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:08.791707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.690671+0000","last_change":"2024-09-10T06:27:01.690671+0000","last_active":"2024-09-10T06:27:01.690671+0000","last_peered":"2024-09-10T06:27:01.690671+0000","last_clean":"2024-09-10T06:27:01.690671+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:27:01.690671+0000","last_undegraded":"2024-09-10T06:27:01.690671+0000","last_fullsized":"2024-09-10T06:27:01.690671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.690490+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:38.401842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:17.476533+0000","last_change":"2024-09-10T06:22:37.854413+0000","last_active":"2024-09-10T06:26:17.476533+0000","last_peered":"2024-09-10T06:26:17.476533+0000","last_clean":"2024-09-10T06:26:17.476533+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:26:17.476533+0000","last_undegraded":"2024-09-10T06:26:17.476533+0000","last_fullsized":"2024-09-10T06:26:17.476533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:36.797234+0000","last_clean_scrub_stamp":"2024-09-10T06:22:36.797234+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:44.078820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.112787+0000","last_change":"2024-09-10T06:27:10.112787+0000","last_active":"2024-09-10T06:27:10.112787+0000","last_peered":"2024-09-10T06:27:10.112787+0000","last_clean":"2024-09-10T06:27:10.112787+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:27:10.112787+0000","last_undegraded":"2024-09-10T06:27:10.112787+0000","last_fullsized":"2024-09-10T06:27:10.112787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.112602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:32.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:24:43.301241+0000","last_change":"2024-09-10T06:22:41.895723+0000","last_active":"2024-09-10T06:24:43.301241+0000","last_peered":"2024-09-10T06:24:43.301241+0000","last_clean":"2024-09-10T06:24:43.301241+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:24:43.301241+0000","last_undegraded":"2024-09-10T06:24:43.301241+0000","last_fullsized":"2024-09-10T06:24:43.301241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:54.620744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.779775+0000","last_change":"2024-09-10T06:26:43.779653+0000","last_active":"2024-09-10T06:26:43.779775+0000","last_peered":"2024-09-10T06:26:43.779775+0000","last_clean":"2024-09-10T06:26:43.779775+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:26:43.779775+0000","last_undegraded":"2024-09-10T06:26:43.779775+0000","last_fullsized":"2024-09-10T06:26:43.779775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.779476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:31.036552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.433609+0000","last_change":"2024-09-10T06:26:29.433336+0000","last_active":"2024-09-10T06:26:29.433609+0000","last_peered":"2024-09-10T06:26:29.433609+0000","last_clean":"2024-09-10T06:26:29.433609+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:26:29.433609+0000","last_undegraded":"2024-09-10T06:26:29.433609+0000","last_fullsized":"2024-09-10T06:26:29.433609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.433088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:15.744029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.839137+0000","last_change":"2024-09-10T06:26:45.838993+0000","last_active":"2024-09-10T06:26:45.839137+0000","last_peered":"2024-09-10T06:26:45.839137+0000","last_clean":"2024-09-10T06:26:45.839137+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:26:45.839137+0000","last_undegraded":"2024-09-10T06:26:45.839137+0000","last_fullsized":"2024-09-10T06:26:45.839137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.838814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:56.402021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.047162+0000","last_change":"2024-09-10T06:26:29.046913+0000","last_active":"2024-09-10T06:26:29.047162+0000","last_peered":"2024-09-10T06:26:29.047162+0000","last_clean":"2024-09-10T06:26:29.047162+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:26:29.047162+0000","last_undegraded":"2024-09-10T06:26:29.047162+0000","last_fullsized":"2024-09-10T06:26:29.047162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.046701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:29.715468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.781486+0000","last_change":"2024-09-10T06:26:44.781486+0000","last_active":"2024-09-10T06:26:44.781486+0000","last_peered":"2024-09-10T06:26:44.781486+0000","last_clean":"2024-09-10T06:26:44.781486+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:26:44.781486+0000","last_undegraded":"2024-09-10T06:26:44.781486+0000","last_fullsized":"2024-09-10T06:26:44.781486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.781299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:57.451138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.302408+0000","last_change":"2024-09-10T06:26:41.302121+0000","last_active":"2024-09-10T06:26:41.302408+0000","last_peered":"2024-09-10T06:26:41.302408+0000","last_clean":"2024-09-10T06:26:41.302408+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:26:41.302408+0000","last_undegraded":"2024-09-10T06:26:41.302408+0000","last_fullsized":"2024-09-10T06:26:41.302408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.301927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:41.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.808725+0000","last_change":"2024-09-10T06:26:46.808544+0000","last_active":"2024-09-10T06:26:46.808725+0000","last_peered":"2024-09-10T06:26:46.808725+0000","last_clean":"2024-09-10T06:26:46.808725+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:26:46.808725+0000","last_undegraded":"2024-09-10T06:26:46.808725+0000","last_fullsized":"2024-09-10T06:26:46.808725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.808370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:30.378145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.079366+0000","last_change":"2024-09-10T06:26:25.079186+0000","last_active":"2024-09-10T06:26:25.079366+0000","last_peered":"2024-09-10T06:26:25.079366+0000","last_clean":"2024-09-10T06:26:25.079366+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:26:25.079366+0000","last_undegraded":"2024-09-10T06:26:25.079366+0000","last_fullsized":"2024-09-10T06:26:25.079366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.079003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:58.821283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.891740+0000","last_change":"2024-09-10T06:26:40.891588+0000","last_active":"2024-09-10T06:26:40.891740+0000","last_peered":"2024-09-10T06:26:40.891740+0000","last_clean":"2024-09-10T06:26:40.891740+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:26:40.891740+0000","last_undegraded":"2024-09-10T06:26:40.891740+0000","last_fullsized":"2024-09-10T06:26:40.891740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.891412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:16.731907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.995214+0000","last_change":"2024-09-10T06:26:31.995009+0000","last_active":"2024-09-10T06:26:31.995214+0000","last_peered":"2024-09-10T06:26:31.995214+0000","last_clean":"2024-09-10T06:26:31.995214+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:26:31.995214+0000","last_undegraded":"2024-09-10T06:26:31.995214+0000","last_fullsized":"2024-09-10T06:26:31.995214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.994787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:49.297894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.735118+0000","last_change":"2024-09-10T06:26:42.734856+0000","last_active":"2024-09-10T06:26:42.735118+0000","last_peered":"2024-09-10T06:26:42.735118+0000","last_clean":"2024-09-10T06:26:42.735118+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:26:42.735118+0000","last_undegraded":"2024-09-10T06:26:42.735118+0000","last_fullsized":"2024-09-10T06:26:42.735118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.734628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:25.938010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.497928+0000","last_change":"2024-09-10T06:26:29.497669+0000","last_active":"2024-09-10T06:26:29.497928+0000","last_peered":"2024-09-10T06:26:29.497928+0000","last_clean":"2024-09-10T06:26:29.497928+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:26:29.497928+0000","last_undegraded":"2024-09-10T06:26:29.497928+0000","last_fullsized":"2024-09-10T06:26:29.497928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.497454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:45.426363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.888535+0000","last_change":"2024-09-10T06:26:43.888535+0000","last_active":"2024-09-10T06:26:43.888535+0000","last_peered":"2024-09-10T06:26:43.888535+0000","last_clean":"2024-09-10T06:26:43.888535+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:26:43.888535+0000","last_undegraded":"2024-09-10T06:26:43.888535+0000","last_fullsized":"2024-09-10T06:26:43.888535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.888359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:39.822929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.393901+0000","last_change":"2024-09-10T06:26:31.393760+0000","last_active":"2024-09-10T06:26:31.393901+0000","last_peered":"2024-09-10T06:26:31.393901+0000","last_clean":"2024-09-10T06:26:31.393901+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:26:31.393901+0000","last_undegraded":"2024-09-10T06:26:31.393901+0000","last_fullsized":"2024-09-10T06:26:31.393901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.393581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:26.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.725882+0000","last_change":"2024-09-10T06:26:41.725569+0000","last_active":"2024-09-10T06:26:41.725882+0000","last_peered":"2024-09-10T06:26:41.725882+0000","last_clean":"2024-09-10T06:26:41.725882+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:26:41.725882+0000","last_undegraded":"2024-09-10T06:26:41.725882+0000","last_fullsized":"2024-09-10T06:26:41.725882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.725350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:08.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.946847+0000","last_change":"2024-09-10T06:26:34.946711+0000","last_active":"2024-09-10T06:26:34.946847+0000","last_peered":"2024-09-10T06:26:34.946847+0000","last_clean":"2024-09-10T06:26:34.946847+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:26:34.946847+0000","last_undegraded":"2024-09-10T06:26:34.946847+0000","last_fullsized":"2024-09-10T06:26:34.946847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.946534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:24.024731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.735037+0000","last_change":"2024-09-10T06:26:48.734871+0000","last_active":"2024-09-10T06:26:48.735037+0000","last_peered":"2024-09-10T06:26:48.735037+0000","last_clean":"2024-09-10T06:26:48.735037+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:26:48.735037+0000","last_undegraded":"2024-09-10T06:26:48.735037+0000","last_fullsized":"2024-09-10T06:26:48.735037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.734684+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.243947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.259823+0000","last_change":"2024-09-10T06:26:42.259572+0000","last_active":"2024-09-10T06:26:42.259823+0000","last_peered":"2024-09-10T06:26:42.259823+0000","last_clean":"2024-09-10T06:26:42.259823+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:26:42.259823+0000","last_undegraded":"2024-09-10T06:26:42.259823+0000","last_fullsized":"2024-09-10T06:26:42.259823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.259331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:33.896423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.252229+0000","last_change":"2024-09-10T06:27:03.252022+0000","last_active":"2024-09-10T06:27:03.252229+0000","last_peered":"2024-09-10T06:27:03.252229+0000","last_clean":"2024-09-10T06:27:03.252229+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:27:03.252229+0000","last_undegraded":"2024-09-10T06:27:03.252229+0000","last_fullsized":"2024-09-10T06:27:03.252229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.251851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:40.452395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.928843+0000","last_change":"2024-09-10T06:26:39.928711+0000","last_active":"2024-09-10T06:26:39.928843+0000","last_peered":"2024-09-10T06:26:39.928843+0000","last_clean":"2024-09-10T06:26:39.928843+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:26:39.928843+0000","last_undegraded":"2024-09-10T06:26:39.928843+0000","last_fullsized":"2024-09-10T06:26:39.928843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.928507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:38.868895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.881242+0000","last_change":"2024-09-10T06:26:44.881074+0000","last_active":"2024-09-10T06:26:44.881242+0000","last_peered":"2024-09-10T06:26:44.881242+0000","last_clean":"2024-09-10T06:26:44.881242+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:26:44.881242+0000","last_undegraded":"2024-09-10T06:26:44.881242+0000","last_fullsized":"2024-09-10T06:26:44.881242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.880889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:04.889584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.509812+0000","last_change":"2024-09-10T06:26:30.509659+0000","last_active":"2024-09-10T06:26:30.509812+0000","last_peered":"2024-09-10T06:26:30.509812+0000","last_clean":"2024-09-10T06:26:30.509812+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:26:30.509812+0000","last_undegraded":"2024-09-10T06:26:30.509812+0000","last_fullsized":"2024-09-10T06:26:30.509812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.509470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:04.251749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.757313+0000","last_change":"2024-09-10T06:26:47.757058+0000","last_active":"2024-09-10T06:26:47.757313+0000","last_peered":"2024-09-10T06:26:47.757313+0000","last_clean":"2024-09-10T06:26:47.757313+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:26:47.757313+0000","last_undegraded":"2024-09-10T06:26:47.757313+0000","last_fullsized":"2024-09-10T06:26:47.757313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.756834+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:23.597329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.629425+0000","last_change":"2024-09-10T06:26:33.629278+0000","last_active":"2024-09-10T06:26:33.629425+0000","last_peered":"2024-09-10T06:26:33.629425+0000","last_clean":"2024-09-10T06:26:33.629425+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:26:33.629425+0000","last_undegraded":"2024-09-10T06:26:33.629425+0000","last_fullsized":"2024-09-10T06:26:33.629425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.629098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:15.221664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.753260+0000","last_change":"2024-09-10T06:26:46.753129+0000","last_active":"2024-09-10T06:26:46.753260+0000","last_peered":"2024-09-10T06:26:46.753260+0000","last_clean":"2024-09-10T06:26:46.753260+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:26:46.753260+0000","last_undegraded":"2024-09-10T06:26:46.753260+0000","last_fullsized":"2024-09-10T06:26:46.753260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.752953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:45.693341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.246133+0000","last_change":"2024-09-10T06:26:43.245879+0000","last_active":"2024-09-10T06:26:43.246133+0000","last_peered":"2024-09-10T06:26:43.246133+0000","last_clean":"2024-09-10T06:26:43.246133+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:26:43.246133+0000","last_undegraded":"2024-09-10T06:26:43.246133+0000","last_fullsized":"2024-09-10T06:26:43.246133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.245659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.348752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.746268+0000","last_change":"2024-09-10T06:26:45.746074+0000","last_active":"2024-09-10T06:26:45.746268+0000","last_peered":"2024-09-10T06:26:45.746268+0000","last_clean":"2024-09-10T06:26:45.746268+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:26:45.746268+0000","last_undegraded":"2024-09-10T06:26:45.746268+0000","last_fullsized":"2024-09-10T06:26:45.746268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.745895+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:13.731142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.219000+0000","last_change":"2024-09-10T06:26:44.218872+0000","last_active":"2024-09-10T06:26:44.219000+0000","last_peered":"2024-09-10T06:26:44.219000+0000","last_clean":"2024-09-10T06:26:44.219000+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:26:44.219000+0000","last_undegraded":"2024-09-10T06:26:44.219000+0000","last_fullsized":"2024-09-10T06:26:44.219000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.218685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:25.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.827937+0000","last_change":"2024-09-10T06:26:46.827937+0000","last_active":"2024-09-10T06:26:46.827937+0000","last_peered":"2024-09-10T06:26:46.827937+0000","last_clean":"2024-09-10T06:26:46.827937+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:26:46.827937+0000","last_undegraded":"2024-09-10T06:26:46.827937+0000","last_fullsized":"2024-09-10T06:26:46.827937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.827760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:10.751238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.549345+0000","last_change":"2024-09-10T06:26:36.549201+0000","last_active":"2024-09-10T06:26:36.549345+0000","last_peered":"2024-09-10T06:26:36.549345+0000","last_clean":"2024-09-10T06:26:36.549345+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:26:36.549345+0000","last_undegraded":"2024-09-10T06:26:36.549345+0000","last_fullsized":"2024-09-10T06:26:36.549345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.549021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:42.805736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.754846+0000","last_change":"2024-09-10T06:26:44.754694+0000","last_active":"2024-09-10T06:26:44.754846+0000","last_peered":"2024-09-10T06:26:44.754846+0000","last_clean":"2024-09-10T06:26:44.754846+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:26:44.754846+0000","last_undegraded":"2024-09-10T06:26:44.754846+0000","last_fullsized":"2024-09-10T06:26:44.754846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.754512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:05.065310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.239297+0000","last_change":"2024-09-10T06:26:45.239130+0000","last_active":"2024-09-10T06:26:45.239297+0000","last_peered":"2024-09-10T06:26:45.239297+0000","last_clean":"2024-09-10T06:26:45.239297+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:26:45.239297+0000","last_undegraded":"2024-09-10T06:26:45.239297+0000","last_fullsized":"2024-09-10T06:26:45.239297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.238956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:09.120153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.192359+0000","last_change":"2024-09-10T06:26:46.192191+0000","last_active":"2024-09-10T06:26:46.192359+0000","last_peered":"2024-09-10T06:26:46.192359+0000","last_clean":"2024-09-10T06:26:46.192359+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:26:46.192359+0000","last_undegraded":"2024-09-10T06:26:46.192359+0000","last_fullsized":"2024-09-10T06:26:46.192359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.192012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:04.479544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.752609+0000","last_change":"2024-09-10T06:26:51.752609+0000","last_active":"2024-09-10T06:26:51.752609+0000","last_peered":"2024-09-10T06:26:51.752609+0000","last_clean":"2024-09-10T06:26:51.752609+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:26:51.752609+0000","last_undegraded":"2024-09-10T06:26:51.752609+0000","last_fullsized":"2024-09-10T06:26:51.752609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.752428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:35.735944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.934803+0000","last_change":"2024-09-10T06:26:38.934649+0000","last_active":"2024-09-10T06:26:38.934803+0000","last_peered":"2024-09-10T06:26:38.934803+0000","last_clean":"2024-09-10T06:26:38.934803+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:26:38.934803+0000","last_undegraded":"2024-09-10T06:26:38.934803+0000","last_fullsized":"2024-09-10T06:26:38.934803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.934464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:06.919711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.648863+0000","last_change":"2024-09-10T06:26:52.648863+0000","last_active":"2024-09-10T06:26:52.648863+0000","last_peered":"2024-09-10T06:26:52.648863+0000","last_clean":"2024-09-10T06:26:52.648863+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:26:52.648863+0000","last_undegraded":"2024-09-10T06:26:52.648863+0000","last_fullsized":"2024-09-10T06:26:52.648863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.648684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:03.211891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1503,"ondisk_log_size":1503,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640319,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640321,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673024,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":724587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673025,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44080,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327760,"statfs":{"total":96636764160,"available":96591626240,"internally_reserved":0,"allocated":425984,"data_stored":135733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:27:23.714 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.715 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.715 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.715 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.716 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.716 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.716 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.717 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.717 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.717 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.717 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.718 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.718 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.719 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.719 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.719 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.720 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.720 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.720 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.721 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.721 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.722 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.722 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.722 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.723 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.723 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.723 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.724 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.724 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.724 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.725 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.725 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.725 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.726 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.726 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.726 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.727 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:22:38.812352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=38, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.727 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.727 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:22:36.797234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.727 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:23.729 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:27:43.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:27:43.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76c0c53640 1 Processor -- start 2024-09-10T06:27:43.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76c0c53640 1 -- start start 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76c0c53640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76bc12c190 0x7f76bc12c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76c0c53640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc073be0 con 0x7f76bc12cab0 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76c0c53640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc12bdd0 con 0x7f76bc12c190 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76bc12c190 0x7f76bc12c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76bc12c190 0x7f76bc12c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56166/0 (socket says 172.21.15.84:56166) 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76b9d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f76bc12cab0 0x7f76bc12f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33786/0 (socket says 172.21.15.84:33786) 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 -- 172.21.15.84:0/1841897369 learned_addr learned my addr 172.21.15.84:0/1841897369 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 -- 172.21.15.84:0/1841897369 >> v1:172.21.15.84:6789/0 conn(0x7f76bc12cab0 legacy=0x7f76bc12f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:43.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 -- 172.21.15.84:0/1841897369 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc070d40 con 0x7f76bc12c190 2024-09-10T06:27:43.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76ba59c640 1 --2- 172.21.15.84:0/1841897369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc12c570 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009e50 tx=0x7f76ac01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35a3608e1beb9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:43.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76b959a640 1 -- 172.21.15.84:0/1841897369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76ac009200 con 0x7f76bc12c190 2024-09-10T06:27:43.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76b959a640 1 -- 172.21.15.84:0/1841897369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac0a64f0 con 0x7f76bc12c190 2024-09-10T06:27:43.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.858+0000 7f76b959a640 1 -- 172.21.15.84:0/1841897369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76ac0a67f0 con 0x7f76bc12c190 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1841897369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 msgr2=0x7f76bc12c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1841897369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc12c570 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009e50 tx=0x7f76ac01c980 comp rx=0 tx=0).stop 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1841897369 shutdown_connections 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1841897369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc12c570 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1841897369 >> 172.21.15.84:0/1841897369 conn(0x7f76bc071e50 msgr2=0x7f76bc072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1841897369 shutdown_connections 2024-09-10T06:27:43.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1841897369 wait complete. 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 Processor -- start 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- start start 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc137a80 con 0x7f76bc12c190 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76ba59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76ba59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56168/0 (socket says 172.21.15.84:56168) 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76ba59c640 1 -- 172.21.15.84:0/1474490280 learned_addr learned my addr 172.21.15.84:0/1474490280 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:27:43.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76ba59c640 1 -- 172.21.15.84:0/1474490280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc117470 con 0x7f76bc12c190 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76ba59c640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009e50 tx=0x7f76ac019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76ac0a69e0 con 0x7f76bc12c190 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac0b5070 con 0x7f76bc12c190 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc129aa0 con 0x7f76bc12c190 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76ac0a6cf0 con 0x7f76bc12c190 2024-09-10T06:27:43.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc117e50 con 0x7f76bc12c190 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc12c570 con 0x7f76bc12c190 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76ac0c2060 con 0x7f76bc12c190 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.862+0000 7f76b2ffd640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 0x7f769c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.866+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f76ac0e9760 con 0x7f76bc12c190 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.866+0000 7f76b9d9b640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 0x7f769c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:27:43.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.866+0000 7f76b9d9b640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 0x7f769c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f76a4001640 tx=0x7f76a4007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:27:43.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:43.870+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f76ac016600 con 0x7f76bc12c190 2024-09-10T06:27:44.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.034+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76bc117ba0 con 0x7f769c03b1d0 2024-09-10T06:27:44.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.066+0000 7f76b2ffd640 1 -- 172.21.15.84:0/1474490280 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665842 (secure 0 0 0) 0x7f76bc117ba0 con 0x7f769c03b1d0 2024-09-10T06:27:44.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:27:44.083 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:27:44.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.070+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 msgr2=0x7f769c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:44.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.070+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 0x7f769c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f76a4001640 tx=0x7f76a4007a30 comp rx=0 tx=0).stop 2024-09-10T06:27:44.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 msgr2=0x7f76bc125030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009e50 tx=0x7f76ac019720 comp rx=0 tx=0).stop 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 shutdown_connections 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f769c03b1d0 0x7f769c03d690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 --2- 172.21.15.84:0/1474490280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76bc12c190 0x7f76bc125030 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 >> 172.21.15.84:0/1474490280 conn(0x7f76bc071e50 msgr2=0x7f76bc09b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 shutdown_connections 2024-09-10T06:27:44.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:27:44.074+0000 7f76c0c53640 1 -- 172.21.15.84:0/1474490280 wait complete. 2024-09-10T06:27:44.093 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T06:27:43.910981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":164992,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322368,"statfs":{"total":386547056640,"available":386378104832,"internally_reserved":0,"allocated":2883584,"data_stored":1722172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.466040+0000","last_change":"2024-09-10T06:26:34.465867+0000","last_active":"2024-09-10T06:26:34.466040+0000","last_peered":"2024-09-10T06:26:34.466040+0000","last_clean":"2024-09-10T06:26:34.466040+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:26:34.466040+0000","last_undegraded":"2024-09-10T06:26:34.466040+0000","last_fullsized":"2024-09-10T06:26:34.466040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.465683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:52.407098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.647059+0000","last_change":"2024-09-10T06:26:53.646909+0000","last_active":"2024-09-10T06:26:53.647059+0000","last_peered":"2024-09-10T06:26:53.647059+0000","last_clean":"2024-09-10T06:26:53.647059+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:26:53.647059+0000","last_undegraded":"2024-09-10T06:26:53.647059+0000","last_fullsized":"2024-09-10T06:26:53.647059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.646728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.216502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.020076+0000","last_change":"2024-09-10T06:26:31.019911+0000","last_active":"2024-09-10T06:26:31.020076+0000","last_peered":"2024-09-10T06:26:31.020076+0000","last_clean":"2024-09-10T06:26:31.020076+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:26:31.020076+0000","last_undegraded":"2024-09-10T06:26:31.020076+0000","last_fullsized":"2024-09-10T06:26:31.020076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.019720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.047991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.260266+0000","last_change":"2024-09-10T06:27:05.260098+0000","last_active":"2024-09-10T06:27:05.260266+0000","last_peered":"2024-09-10T06:27:05.260266+0000","last_clean":"2024-09-10T06:27:05.260266+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:27:05.260266+0000","last_undegraded":"2024-09-10T06:27:05.260266+0000","last_fullsized":"2024-09-10T06:27:05.260266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.259897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:58.244968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.163437+0000","last_change":"2024-09-10T06:26:51.163437+0000","last_active":"2024-09-10T06:26:51.163437+0000","last_peered":"2024-09-10T06:26:51.163437+0000","last_clean":"2024-09-10T06:26:51.163437+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:26:51.163437+0000","last_undegraded":"2024-09-10T06:26:51.163437+0000","last_fullsized":"2024-09-10T06:26:51.163437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.163242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:11.196431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.302010+0000","last_change":"2024-09-10T06:27:06.301843+0000","last_active":"2024-09-10T06:27:06.302010+0000","last_peered":"2024-09-10T06:27:06.302010+0000","last_clean":"2024-09-10T06:27:06.302010+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:27:06.302010+0000","last_undegraded":"2024-09-10T06:27:06.302010+0000","last_fullsized":"2024-09-10T06:27:06.302010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.301644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:48.919378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.746646+0000","last_change":"2024-09-10T06:26:42.746646+0000","last_active":"2024-09-10T06:26:42.746646+0000","last_peered":"2024-09-10T06:26:42.746646+0000","last_clean":"2024-09-10T06:26:42.746646+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:26:42.746646+0000","last_undegraded":"2024-09-10T06:26:42.746646+0000","last_fullsized":"2024-09-10T06:26:42.746646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.746449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:24.690631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.807804+0000","last_change":"2024-09-10T06:26:47.807804+0000","last_active":"2024-09-10T06:26:47.807804+0000","last_peered":"2024-09-10T06:26:47.807804+0000","last_clean":"2024-09-10T06:26:47.807804+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:26:47.807804+0000","last_undegraded":"2024-09-10T06:26:47.807804+0000","last_fullsized":"2024-09-10T06:26:47.807804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.807624+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:44.898834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.241631+0000","last_change":"2024-09-10T06:26:49.241472+0000","last_active":"2024-09-10T06:26:49.241631+0000","last_peered":"2024-09-10T06:26:49.241631+0000","last_clean":"2024-09-10T06:26:49.241631+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:26:49.241631+0000","last_undegraded":"2024-09-10T06:26:49.241631+0000","last_fullsized":"2024-09-10T06:26:49.241631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.241280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:21.798559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.669065+0000","last_change":"2024-09-10T06:26:54.669065+0000","last_active":"2024-09-10T06:26:54.669065+0000","last_peered":"2024-09-10T06:26:54.669065+0000","last_clean":"2024-09-10T06:26:54.669065+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:26:54.669065+0000","last_undegraded":"2024-09-10T06:26:54.669065+0000","last_fullsized":"2024-09-10T06:26:54.669065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.668892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:55.148303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.383844+0000","last_change":"2024-09-10T06:26:32.383694+0000","last_active":"2024-09-10T06:26:32.383844+0000","last_peered":"2024-09-10T06:26:32.383844+0000","last_clean":"2024-09-10T06:26:32.383844+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:26:32.383844+0000","last_undegraded":"2024-09-10T06:26:32.383844+0000","last_fullsized":"2024-09-10T06:26:32.383844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.383510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:41.546507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.392644+0000","last_change":"2024-09-10T06:27:08.392644+0000","last_active":"2024-09-10T06:27:08.392644+0000","last_peered":"2024-09-10T06:27:08.392644+0000","last_clean":"2024-09-10T06:27:08.392644+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:27:08.392644+0000","last_undegraded":"2024-09-10T06:27:08.392644+0000","last_fullsized":"2024-09-10T06:27:08.392644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.392426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:06.940408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.237117+0000","last_change":"2024-09-10T06:26:48.236984+0000","last_active":"2024-09-10T06:26:48.237117+0000","last_peered":"2024-09-10T06:26:48.237117+0000","last_clean":"2024-09-10T06:26:48.237117+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:26:48.237117+0000","last_undegraded":"2024-09-10T06:26:48.237117+0000","last_fullsized":"2024-09-10T06:26:48.237117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.236809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:50.855015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.767721+0000","last_change":"2024-09-10T06:26:50.767721+0000","last_active":"2024-09-10T06:26:50.767721+0000","last_peered":"2024-09-10T06:26:50.767721+0000","last_clean":"2024-09-10T06:26:50.767721+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:26:50.767721+0000","last_undegraded":"2024-09-10T06:26:50.767721+0000","last_fullsized":"2024-09-10T06:26:50.767721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.767440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:05.170562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.039641+0000","last_change":"2024-09-10T06:26:30.039477+0000","last_active":"2024-09-10T06:26:30.039641+0000","last_peered":"2024-09-10T06:26:30.039641+0000","last_clean":"2024-09-10T06:26:30.039641+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:26:30.039641+0000","last_undegraded":"2024-09-10T06:26:30.039641+0000","last_fullsized":"2024-09-10T06:26:30.039641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.039298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:00.637143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.805279+0000","last_change":"2024-09-10T06:26:49.805279+0000","last_active":"2024-09-10T06:26:49.805279+0000","last_peered":"2024-09-10T06:26:49.805279+0000","last_clean":"2024-09-10T06:26:49.805279+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:26:49.805279+0000","last_undegraded":"2024-09-10T06:26:49.805279+0000","last_fullsized":"2024-09-10T06:26:49.805279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.805098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.455068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.228333+0000","last_change":"2024-09-10T06:27:04.228183+0000","last_active":"2024-09-10T06:27:04.228333+0000","last_peered":"2024-09-10T06:27:04.228333+0000","last_clean":"2024-09-10T06:27:04.228333+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:27:04.228333+0000","last_undegraded":"2024-09-10T06:27:04.228333+0000","last_fullsized":"2024-09-10T06:27:04.228333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.227971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:12.018865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.659108+0000","last_change":"2024-09-10T06:26:34.658943+0000","last_active":"2024-09-10T06:26:34.659108+0000","last_peered":"2024-09-10T06:26:34.659108+0000","last_clean":"2024-09-10T06:26:34.659108+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:26:34.659108+0000","last_undegraded":"2024-09-10T06:26:34.659108+0000","last_fullsized":"2024-09-10T06:26:34.659108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.658763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:49.709576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.693896+0000","last_change":"2024-09-10T06:26:49.693724+0000","last_active":"2024-09-10T06:26:49.693896+0000","last_peered":"2024-09-10T06:26:49.693896+0000","last_clean":"2024-09-10T06:26:49.693896+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:26:49.693896+0000","last_undegraded":"2024-09-10T06:26:49.693896+0000","last_fullsized":"2024-09-10T06:26:49.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.693549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:08.446456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.418405+0000","last_change":"2024-09-10T06:26:33.418172+0000","last_active":"2024-09-10T06:26:33.418405+0000","last_peered":"2024-09-10T06:26:33.418405+0000","last_clean":"2024-09-10T06:26:33.418405+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:26:33.418405+0000","last_undegraded":"2024-09-10T06:26:33.418405+0000","last_fullsized":"2024-09-10T06:26:33.418405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.417943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:42.088360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.673426+0000","last_change":"2024-09-10T06:26:50.673252+0000","last_active":"2024-09-10T06:26:50.673426+0000","last_peered":"2024-09-10T06:26:50.673426+0000","last_clean":"2024-09-10T06:26:50.673426+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:26:50.673426+0000","last_undegraded":"2024-09-10T06:26:50.673426+0000","last_fullsized":"2024-09-10T06:26:50.673426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.673058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:46.607628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.556239+0000","last_change":"2024-09-10T06:26:31.556091+0000","last_active":"2024-09-10T06:26:31.556239+0000","last_peered":"2024-09-10T06:26:31.556239+0000","last_clean":"2024-09-10T06:26:31.556239+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:26:31.556239+0000","last_undegraded":"2024-09-10T06:26:31.556239+0000","last_fullsized":"2024-09-10T06:26:31.556239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.555912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:11.664445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.818087+0000","last_change":"2024-09-10T06:26:48.817945+0000","last_active":"2024-09-10T06:26:48.818087+0000","last_peered":"2024-09-10T06:26:48.818087+0000","last_clean":"2024-09-10T06:26:48.818087+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:26:48.818087+0000","last_undegraded":"2024-09-10T06:26:48.818087+0000","last_fullsized":"2024-09-10T06:26:48.818087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.817716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:47.841366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.598753+0000","last_change":"2024-09-10T06:26:32.598629+0000","last_active":"2024-09-10T06:26:32.598753+0000","last_peered":"2024-09-10T06:26:32.598753+0000","last_clean":"2024-09-10T06:26:32.598753+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:26:32.598753+0000","last_undegraded":"2024-09-10T06:26:32.598753+0000","last_fullsized":"2024-09-10T06:26:32.598753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.598449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:24.920243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.782267+0000","last_change":"2024-09-10T06:26:45.782106+0000","last_active":"2024-09-10T06:26:45.782267+0000","last_peered":"2024-09-10T06:26:45.782267+0000","last_clean":"2024-09-10T06:26:45.782267+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:26:45.782267+0000","last_undegraded":"2024-09-10T06:26:45.782267+0000","last_fullsized":"2024-09-10T06:26:45.782267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.781922+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:14.746365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.086867+0000","last_change":"2024-09-10T06:26:28.086704+0000","last_active":"2024-09-10T06:26:28.086867+0000","last_peered":"2024-09-10T06:26:28.086867+0000","last_clean":"2024-09-10T06:26:28.086867+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:26:28.086867+0000","last_undegraded":"2024-09-10T06:26:28.086867+0000","last_fullsized":"2024-09-10T06:26:28.086867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.086529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:43.137342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.670428+0000","last_change":"2024-09-10T06:26:51.670280+0000","last_active":"2024-09-10T06:26:51.670428+0000","last_peered":"2024-09-10T06:26:51.670428+0000","last_clean":"2024-09-10T06:26:51.670428+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:26:51.670428+0000","last_undegraded":"2024-09-10T06:26:51.670428+0000","last_fullsized":"2024-09-10T06:26:51.670428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.670102+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.678798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.234590+0000","last_change":"2024-09-10T06:26:47.234344+0000","last_active":"2024-09-10T06:26:47.234590+0000","last_peered":"2024-09-10T06:26:47.234590+0000","last_clean":"2024-09-10T06:26:47.234590+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:26:47.234590+0000","last_undegraded":"2024-09-10T06:26:47.234590+0000","last_fullsized":"2024-09-10T06:26:47.234590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.234129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:14.974750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.740565+0000","last_change":"2024-09-10T06:27:22.740411+0000","last_active":"2024-09-10T06:27:22.740565+0000","last_peered":"2024-09-10T06:27:22.740565+0000","last_clean":"2024-09-10T06:27:22.740565+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:27:22.740565+0000","last_undegraded":"2024-09-10T06:27:22.740565+0000","last_fullsized":"2024-09-10T06:27:22.740565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-10T06:27:22.740209+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-10T06:27:22.740209+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.740209+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:01.183177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.219740+0000","last_change":"2024-09-10T06:26:57.219569+0000","last_active":"2024-09-10T06:26:57.219740+0000","last_peered":"2024-09-10T06:26:57.219740+0000","last_clean":"2024-09-10T06:26:57.219740+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:26:57.219740+0000","last_undegraded":"2024-09-10T06:26:57.219740+0000","last_fullsized":"2024-09-10T06:26:57.219740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.219347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:08.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.269168+0000","last_change":"2024-09-10T06:26:36.268913+0000","last_active":"2024-09-10T06:26:36.269168+0000","last_peered":"2024-09-10T06:26:36.269168+0000","last_clean":"2024-09-10T06:26:36.269168+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:26:36.269168+0000","last_undegraded":"2024-09-10T06:26:36.269168+0000","last_fullsized":"2024-09-10T06:26:36.269168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.268668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:50.827972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.364833+0000","last_change":"2024-09-10T06:27:16.364666+0000","last_active":"2024-09-10T06:27:16.364833+0000","last_peered":"2024-09-10T06:27:16.364833+0000","last_clean":"2024-09-10T06:27:16.364833+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:27:16.364833+0000","last_undegraded":"2024-09-10T06:27:16.364833+0000","last_fullsized":"2024-09-10T06:27:16.364833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.364504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:38.523435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.480253+0000","last_change":"2024-09-10T06:27:24.480119+0000","last_active":"2024-09-10T06:27:24.480253+0000","last_peered":"2024-09-10T06:27:24.480253+0000","last_clean":"2024-09-10T06:27:24.480253+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:27:24.480253+0000","last_undegraded":"2024-09-10T06:27:24.480253+0000","last_fullsized":"2024-09-10T06:27:24.480253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:24.479928+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:24.479928+0000","last_clean_scrub_stamp":"2024-09-10T06:27:24.479928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:40.202330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.813832+0000","last_change":"2024-09-10T06:27:14.813696+0000","last_active":"2024-09-10T06:27:14.813832+0000","last_peered":"2024-09-10T06:27:14.813832+0000","last_clean":"2024-09-10T06:27:14.813832+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:27:14.813832+0000","last_undegraded":"2024-09-10T06:27:14.813832+0000","last_fullsized":"2024-09-10T06:27:14.813832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.813484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:20.583529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780119+0000","last_change":"2024-09-10T06:27:23.779925+0000","last_active":"2024-09-10T06:27:23.780119+0000","last_peered":"2024-09-10T06:27:23.780119+0000","last_clean":"2024-09-10T06:27:23.780119+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:27:23.780119+0000","last_undegraded":"2024-09-10T06:27:23.780119+0000","last_fullsized":"2024-09-10T06:27:23.780119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:23.779737+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:23.779737+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.779737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:56.178297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.246479+0000","last_change":"2024-09-10T06:26:58.246335+0000","last_active":"2024-09-10T06:26:58.246479+0000","last_peered":"2024-09-10T06:26:58.246479+0000","last_clean":"2024-09-10T06:26:58.246479+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:26:58.246479+0000","last_undegraded":"2024-09-10T06:26:58.246479+0000","last_fullsized":"2024-09-10T06:26:58.246479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.246124+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:23.180121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.454724+0000","last_change":"2024-09-10T06:26:28.454535+0000","last_active":"2024-09-10T06:26:28.454724+0000","last_peered":"2024-09-10T06:26:28.454724+0000","last_clean":"2024-09-10T06:26:28.454724+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:26:28.454724+0000","last_undegraded":"2024-09-10T06:26:28.454724+0000","last_fullsized":"2024-09-10T06:26:28.454724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.454354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:21.140529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.686119+0000","last_change":"2024-09-10T06:26:58.686119+0000","last_active":"2024-09-10T06:26:58.686119+0000","last_peered":"2024-09-10T06:26:58.686119+0000","last_clean":"2024-09-10T06:26:58.686119+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:26:58.686119+0000","last_undegraded":"2024-09-10T06:26:58.686119+0000","last_fullsized":"2024-09-10T06:26:58.686119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.685947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:42.669463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.809124+0000","last_change":"2024-09-10T06:27:08.808998+0000","last_active":"2024-09-10T06:27:08.809124+0000","last_peered":"2024-09-10T06:27:08.809124+0000","last_clean":"2024-09-10T06:27:08.809124+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:27:08.809124+0000","last_undegraded":"2024-09-10T06:27:08.809124+0000","last_fullsized":"2024-09-10T06:27:08.809124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.808779+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:45.316350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.797706+0000","last_change":"2024-09-10T06:27:13.797478+0000","last_active":"2024-09-10T06:27:13.797706+0000","last_peered":"2024-09-10T06:27:13.797706+0000","last_clean":"2024-09-10T06:27:13.797706+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:27:13.797706+0000","last_undegraded":"2024-09-10T06:27:13.797706+0000","last_fullsized":"2024-09-10T06:27:13.797706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:22.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.072405+0000","last_change":"2024-09-10T06:27:17.072279+0000","last_active":"2024-09-10T06:27:17.072405+0000","last_peered":"2024-09-10T06:27:17.072405+0000","last_clean":"2024-09-10T06:27:17.072405+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:27:17.072405+0000","last_undegraded":"2024-09-10T06:27:17.072405+0000","last_fullsized":"2024-09-10T06:27:17.072405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.072077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:49.470636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.272323+0000","last_change":"2024-09-10T06:26:59.272162+0000","last_active":"2024-09-10T06:26:59.272323+0000","last_peered":"2024-09-10T06:26:59.272323+0000","last_clean":"2024-09-10T06:26:59.272323+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:26:59.272323+0000","last_undegraded":"2024-09-10T06:26:59.272323+0000","last_fullsized":"2024-09-10T06:26:59.272323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.271973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:48.087167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.235278+0000","last_change":"2024-09-10T06:26:35.235143+0000","last_active":"2024-09-10T06:26:35.235278+0000","last_peered":"2024-09-10T06:26:35.235278+0000","last_clean":"2024-09-10T06:26:35.235278+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:26:35.235278+0000","last_undegraded":"2024-09-10T06:26:35.235278+0000","last_fullsized":"2024-09-10T06:26:35.235278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.234952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:53.200997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.835520+0000","last_change":"2024-09-10T06:26:56.835391+0000","last_active":"2024-09-10T06:26:56.835520+0000","last_peered":"2024-09-10T06:26:56.835520+0000","last_clean":"2024-09-10T06:26:56.835520+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:26:56.835520+0000","last_undegraded":"2024-09-10T06:26:56.835520+0000","last_fullsized":"2024-09-10T06:26:56.835520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.835182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:59.591116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.969782+0000","last_change":"2024-09-10T06:27:02.969630+0000","last_active":"2024-09-10T06:27:02.969782+0000","last_peered":"2024-09-10T06:27:02.969782+0000","last_clean":"2024-09-10T06:27:02.969782+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:27:02.969782+0000","last_undegraded":"2024-09-10T06:27:02.969782+0000","last_fullsized":"2024-09-10T06:27:02.969782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.969422+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:36.259987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":400,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:33.376496+0000","last_change":"2024-09-10T06:27:33.376321+0000","last_active":"2024-09-10T06:27:33.376496+0000","last_peered":"2024-09-10T06:27:33.376496+0000","last_clean":"2024-09-10T06:27:33.376496+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:27:33.376496+0000","last_undegraded":"2024-09-10T06:27:33.376496+0000","last_fullsized":"2024-09-10T06:27:33.376496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:33.376139+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:33.376139+0000","last_clean_scrub_stamp":"2024-09-10T06:27:33.376139+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.752496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.958875+0000","last_change":"2024-09-10T06:27:15.958875+0000","last_active":"2024-09-10T06:27:15.958875+0000","last_peered":"2024-09-10T06:27:15.958875+0000","last_clean":"2024-09-10T06:27:15.958875+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:27:15.958875+0000","last_undegraded":"2024-09-10T06:27:15.958875+0000","last_fullsized":"2024-09-10T06:27:15.958875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.958685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:29.946098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'22","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.942764+0000","last_change":"2024-09-10T06:26:36.942629+0000","last_active":"2024-09-10T06:26:36.942764+0000","last_peered":"2024-09-10T06:26:36.942764+0000","last_clean":"2024-09-10T06:26:36.942764+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:26:36.942764+0000","last_undegraded":"2024-09-10T06:26:36.942764+0000","last_fullsized":"2024-09-10T06:26:36.942764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.942444+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:24.199520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.456820+0000","last_change":"2024-09-10T06:26:23.456692+0000","last_active":"2024-09-10T06:26:23.456820+0000","last_peered":"2024-09-10T06:26:23.456820+0000","last_clean":"2024-09-10T06:26:23.456820+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:26:23.456820+0000","last_undegraded":"2024-09-10T06:26:23.456820+0000","last_fullsized":"2024-09-10T06:26:23.456820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.456509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:13.569641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.410459+0000","last_change":"2024-09-10T06:27:15.410327+0000","last_active":"2024-09-10T06:27:15.410459+0000","last_peered":"2024-09-10T06:27:15.410459+0000","last_clean":"2024-09-10T06:27:15.410459+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:27:15.410459+0000","last_undegraded":"2024-09-10T06:27:15.410459+0000","last_fullsized":"2024-09-10T06:27:15.410459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.410128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:40.645404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.934263+0000","last_change":"2024-09-10T06:27:03.934107+0000","last_active":"2024-09-10T06:27:03.934263+0000","last_peered":"2024-09-10T06:27:03.934263+0000","last_clean":"2024-09-10T06:27:03.934263+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:27:03.934263+0000","last_undegraded":"2024-09-10T06:27:03.934263+0000","last_fullsized":"2024-09-10T06:27:03.934263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.933915+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:45.925845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.073523+0000","last_change":"2024-09-10T06:27:11.073358+0000","last_active":"2024-09-10T06:27:11.073523+0000","last_peered":"2024-09-10T06:27:11.073523+0000","last_clean":"2024-09-10T06:27:11.073523+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:27:11.073523+0000","last_undegraded":"2024-09-10T06:27:11.073523+0000","last_fullsized":"2024-09-10T06:27:11.073523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.073173+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:26.420496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.179151+0000","last_change":"2024-09-10T06:26:53.179003+0000","last_active":"2024-09-10T06:26:53.179151+0000","last_peered":"2024-09-10T06:26:53.179151+0000","last_clean":"2024-09-10T06:26:53.179151+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:26:53.179151+0000","last_undegraded":"2024-09-10T06:26:53.179151+0000","last_fullsized":"2024-09-10T06:26:53.179151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.178832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:42.811475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.491722+0000","last_change":"2024-09-10T06:26:26.491509+0000","last_active":"2024-09-10T06:26:26.491722+0000","last_peered":"2024-09-10T06:26:26.491722+0000","last_clean":"2024-09-10T06:26:26.491722+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:26:26.491722+0000","last_undegraded":"2024-09-10T06:26:26.491722+0000","last_fullsized":"2024-09-10T06:26:26.491722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.491266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:02.267203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.635870+0000","last_change":"2024-09-10T06:26:55.635748+0000","last_active":"2024-09-10T06:26:55.635870+0000","last_peered":"2024-09-10T06:26:55.635870+0000","last_clean":"2024-09-10T06:26:55.635870+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:26:55.635870+0000","last_undegraded":"2024-09-10T06:26:55.635870+0000","last_fullsized":"2024-09-10T06:26:55.635870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.635574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:54.659225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.853113+0000","last_change":"2024-09-10T06:26:59.853113+0000","last_active":"2024-09-10T06:26:59.853113+0000","last_peered":"2024-09-10T06:26:59.853113+0000","last_clean":"2024-09-10T06:26:59.853113+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:59.853113+0000","last_undegraded":"2024-09-10T06:26:59.853113+0000","last_fullsized":"2024-09-10T06:26:59.853113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.852901+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:05.503788+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.142100+0000","last_change":"2024-09-10T06:27:09.141933+0000","last_active":"2024-09-10T06:27:09.142100+0000","last_peered":"2024-09-10T06:27:09.142100+0000","last_clean":"2024-09-10T06:27:09.142100+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:27:09.142100+0000","last_undegraded":"2024-09-10T06:27:09.142100+0000","last_fullsized":"2024-09-10T06:27:09.142100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.141754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:21.411218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.004387+0000","last_change":"2024-09-10T06:27:13.004387+0000","last_active":"2024-09-10T06:27:13.004387+0000","last_peered":"2024-09-10T06:27:13.004387+0000","last_clean":"2024-09-10T06:27:13.004387+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:27:13.004387+0000","last_undegraded":"2024-09-10T06:27:13.004387+0000","last_fullsized":"2024-09-10T06:27:13.004387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.004209+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:35.846831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.750907+0000","last_change":"2024-09-10T06:26:37.750761+0000","last_active":"2024-09-10T06:26:37.750907+0000","last_peered":"2024-09-10T06:26:37.750907+0000","last_clean":"2024-09-10T06:26:37.750907+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:26:37.750907+0000","last_undegraded":"2024-09-10T06:26:37.750907+0000","last_fullsized":"2024-09-10T06:26:37.750907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.750588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:21.168972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.466097+0000","last_change":"2024-09-10T06:26:25.465949+0000","last_active":"2024-09-10T06:26:25.466097+0000","last_peered":"2024-09-10T06:26:25.466097+0000","last_clean":"2024-09-10T06:26:25.466097+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:26:25.466097+0000","last_undegraded":"2024-09-10T06:26:25.466097+0000","last_fullsized":"2024-09-10T06:26:25.466097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.465745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:11.750138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.801096+0000","last_change":"2024-09-10T06:26:53.800884+0000","last_active":"2024-09-10T06:26:53.801096+0000","last_peered":"2024-09-10T06:26:53.801096+0000","last_clean":"2024-09-10T06:26:53.801096+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:26:53.801096+0000","last_undegraded":"2024-09-10T06:26:53.801096+0000","last_fullsized":"2024-09-10T06:26:53.801096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.800700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:36.270704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.491790+0000","last_change":"2024-09-10T06:27:22.491790+0000","last_active":"2024-09-10T06:27:22.491790+0000","last_peered":"2024-09-10T06:27:22.491790+0000","last_clean":"2024-09-10T06:27:22.491790+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:27:22.491790+0000","last_undegraded":"2024-09-10T06:27:22.491790+0000","last_fullsized":"2024-09-10T06:27:22.491790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:22.491604+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:22.491604+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.491604+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:19.805771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.112633+0000","last_change":"2024-09-10T06:27:12.112633+0000","last_active":"2024-09-10T06:27:12.112633+0000","last_peered":"2024-09-10T06:27:12.112633+0000","last_clean":"2024-09-10T06:27:12.112633+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:27:12.112633+0000","last_undegraded":"2024-09-10T06:27:12.112633+0000","last_fullsized":"2024-09-10T06:27:12.112633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.112450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:50.224384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.778437+0000","last_change":"2024-09-10T06:27:17.778437+0000","last_active":"2024-09-10T06:27:17.778437+0000","last_peered":"2024-09-10T06:27:17.778437+0000","last_clean":"2024-09-10T06:27:17.778437+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:27:17.778437+0000","last_undegraded":"2024-09-10T06:27:17.778437+0000","last_fullsized":"2024-09-10T06:27:17.778437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.778228+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:33.125552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.592620+0000","last_change":"2024-09-10T06:26:37.592443+0000","last_active":"2024-09-10T06:26:37.592620+0000","last_peered":"2024-09-10T06:26:37.592620+0000","last_clean":"2024-09-10T06:26:37.592620+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:26:37.592620+0000","last_undegraded":"2024-09-10T06:26:37.592620+0000","last_fullsized":"2024-09-10T06:26:37.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.592235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:10.519860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.222626+0000","last_change":"2024-09-10T06:26:34.222379+0000","last_active":"2024-09-10T06:26:34.222626+0000","last_peered":"2024-09-10T06:26:34.222626+0000","last_clean":"2024-09-10T06:26:34.222626+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:26:34.222626+0000","last_undegraded":"2024-09-10T06:26:34.222626+0000","last_fullsized":"2024-09-10T06:26:34.222626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.222107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:52.398385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.836789+0000","last_change":"2024-09-10T06:26:54.836508+0000","last_active":"2024-09-10T06:26:54.836789+0000","last_peered":"2024-09-10T06:26:54.836789+0000","last_clean":"2024-09-10T06:26:54.836789+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:26:54.836789+0000","last_undegraded":"2024-09-10T06:26:54.836789+0000","last_fullsized":"2024-09-10T06:26:54.836789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.836286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:31.547637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.432564+0000","last_change":"2024-09-10T06:27:20.432564+0000","last_active":"2024-09-10T06:27:20.432564+0000","last_peered":"2024-09-10T06:27:20.432564+0000","last_clean":"2024-09-10T06:27:20.432564+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:27:20.432564+0000","last_undegraded":"2024-09-10T06:27:20.432564+0000","last_fullsized":"2024-09-10T06:27:20.432564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-10T06:27:20.432343+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-10T06:27:20.432343+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.432343+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:48.527923+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.141755+0000","last_change":"2024-09-10T06:27:13.141755+0000","last_active":"2024-09-10T06:27:13.141755+0000","last_peered":"2024-09-10T06:27:13.141755+0000","last_clean":"2024-09-10T06:27:13.141755+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:27:13.141755+0000","last_undegraded":"2024-09-10T06:27:13.141755+0000","last_fullsized":"2024-09-10T06:27:13.141755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.141565+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.899954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.110762+0000","last_change":"2024-09-10T06:27:19.110762+0000","last_active":"2024-09-10T06:27:19.110762+0000","last_peered":"2024-09-10T06:27:19.110762+0000","last_clean":"2024-09-10T06:27:19.110762+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:27:19.110762+0000","last_undegraded":"2024-09-10T06:27:19.110762+0000","last_fullsized":"2024-09-10T06:27:19.110762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:19.110583+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:19.110583+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.110583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:11.937942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.631870+0000","last_change":"2024-09-10T06:26:38.631720+0000","last_active":"2024-09-10T06:26:38.631870+0000","last_peered":"2024-09-10T06:26:38.631870+0000","last_clean":"2024-09-10T06:26:38.631870+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:26:38.631870+0000","last_undegraded":"2024-09-10T06:26:38.631870+0000","last_fullsized":"2024-09-10T06:26:38.631870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.631513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:27.113368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.205169+0000","last_change":"2024-09-10T06:26:33.205009+0000","last_active":"2024-09-10T06:26:33.205169+0000","last_peered":"2024-09-10T06:26:33.205169+0000","last_clean":"2024-09-10T06:26:33.205169+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:26:33.205169+0000","last_undegraded":"2024-09-10T06:26:33.205169+0000","last_fullsized":"2024-09-10T06:26:33.205169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.204830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.417787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.807872+0000","last_change":"2024-09-10T06:26:49.807716+0000","last_active":"2024-09-10T06:26:49.807872+0000","last_peered":"2024-09-10T06:26:49.807872+0000","last_clean":"2024-09-10T06:26:49.807872+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:26:49.807872+0000","last_undegraded":"2024-09-10T06:26:49.807872+0000","last_fullsized":"2024-09-10T06:26:49.807872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:23.493668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.469172+0000","last_change":"2024-09-10T06:27:21.469172+0000","last_active":"2024-09-10T06:27:21.469172+0000","last_peered":"2024-09-10T06:27:21.469172+0000","last_clean":"2024-09-10T06:27:21.469172+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:27:21.469172+0000","last_undegraded":"2024-09-10T06:27:21.469172+0000","last_fullsized":"2024-09-10T06:27:21.469172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-10T06:27:21.468908+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-10T06:27:21.468908+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.468908+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:39.066879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.147438+0000","last_change":"2024-09-10T06:27:08.147438+0000","last_active":"2024-09-10T06:27:08.147438+0000","last_peered":"2024-09-10T06:27:08.147438+0000","last_clean":"2024-09-10T06:27:08.147438+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:27:08.147438+0000","last_undegraded":"2024-09-10T06:27:08.147438+0000","last_fullsized":"2024-09-10T06:27:08.147438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.147252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:13.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.163705+0000","last_change":"2024-09-10T06:27:20.163705+0000","last_active":"2024-09-10T06:27:20.163705+0000","last_peered":"2024-09-10T06:27:20.163705+0000","last_clean":"2024-09-10T06:27:20.163705+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:27:20.163705+0000","last_undegraded":"2024-09-10T06:27:20.163705+0000","last_fullsized":"2024-09-10T06:27:20.163705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-10T06:27:20.163437+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-10T06:27:20.163437+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.163437+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:17.246644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.681020+0000","last_change":"2024-09-10T06:26:39.680863+0000","last_active":"2024-09-10T06:26:39.681020+0000","last_peered":"2024-09-10T06:26:39.681020+0000","last_clean":"2024-09-10T06:26:39.681020+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:26:39.681020+0000","last_undegraded":"2024-09-10T06:26:39.681020+0000","last_fullsized":"2024-09-10T06:26:39.681020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.680672+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:43.246870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.091359+0000","last_change":"2024-09-10T06:26:23.091180+0000","last_active":"2024-09-10T06:26:23.091359+0000","last_peered":"2024-09-10T06:26:23.091359+0000","last_clean":"2024-09-10T06:26:23.091359+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:26:23.091359+0000","last_undegraded":"2024-09-10T06:26:23.091359+0000","last_fullsized":"2024-09-10T06:26:23.091359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.091001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:02.894224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.727201+0000","last_change":"2024-09-10T06:26:52.727049+0000","last_active":"2024-09-10T06:26:52.727201+0000","last_peered":"2024-09-10T06:26:52.727201+0000","last_clean":"2024-09-10T06:26:52.727201+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:26:52.727201+0000","last_undegraded":"2024-09-10T06:26:52.727201+0000","last_fullsized":"2024-09-10T06:26:52.727201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.726845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.812634+0000","last_change":"2024-09-10T06:27:06.812490+0000","last_active":"2024-09-10T06:27:06.812634+0000","last_peered":"2024-09-10T06:27:06.812634+0000","last_clean":"2024-09-10T06:27:06.812634+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:27:06.812634+0000","last_undegraded":"2024-09-10T06:27:06.812634+0000","last_fullsized":"2024-09-10T06:27:06.812634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.812279+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:02.301733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:35.419777+0000","last_change":"2024-09-10T06:27:35.419777+0000","last_active":"2024-09-10T06:27:35.419777+0000","last_peered":"2024-09-10T06:27:35.419777+0000","last_clean":"2024-09-10T06:27:35.419777+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:27:35.419777+0000","last_undegraded":"2024-09-10T06:27:35.419777+0000","last_fullsized":"2024-09-10T06:27:35.419777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:35.419600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:35.419600+0000","last_clean_scrub_stamp":"2024-09-10T06:27:35.419600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:56.537869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:37.461814+0000","last_change":"2024-09-10T06:27:37.461814+0000","last_active":"2024-09-10T06:27:37.461814+0000","last_peered":"2024-09-10T06:27:37.461814+0000","last_clean":"2024-09-10T06:27:37.461814+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:27:37.461814+0000","last_undegraded":"2024-09-10T06:27:37.461814+0000","last_fullsized":"2024-09-10T06:27:37.461814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:37.461626+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:37.461626+0000","last_clean_scrub_stamp":"2024-09-10T06:27:37.461626+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:02.340216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.209176+0000","last_change":"2024-09-10T06:26:55.209024+0000","last_active":"2024-09-10T06:26:55.209176+0000","last_peered":"2024-09-10T06:26:55.209176+0000","last_clean":"2024-09-10T06:26:55.209176+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:26:55.209176+0000","last_undegraded":"2024-09-10T06:26:55.209176+0000","last_fullsized":"2024-09-10T06:26:55.209176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.208816+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:39.866888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.181095+0000","last_change":"2024-09-10T06:26:32.180956+0000","last_active":"2024-09-10T06:26:32.181095+0000","last_peered":"2024-09-10T06:26:32.181095+0000","last_clean":"2024-09-10T06:26:32.181095+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:26:32.181095+0000","last_undegraded":"2024-09-10T06:26:32.181095+0000","last_fullsized":"2024-09-10T06:26:32.181095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.180772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:44.519421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.771357+0000","last_change":"2024-09-10T06:26:50.771226+0000","last_active":"2024-09-10T06:26:50.771357+0000","last_peered":"2024-09-10T06:26:50.771357+0000","last_clean":"2024-09-10T06:26:50.771357+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:26:50.771357+0000","last_undegraded":"2024-09-10T06:26:50.771357+0000","last_fullsized":"2024-09-10T06:26:50.771357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.771046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:01.764276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.886754+0000","last_change":"2024-09-10T06:27:00.886670+0000","last_active":"2024-09-10T06:27:00.886754+0000","last_peered":"2024-09-10T06:27:00.886754+0000","last_clean":"2024-09-10T06:27:00.886754+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:27:00.886754+0000","last_undegraded":"2024-09-10T06:27:00.886754+0000","last_fullsized":"2024-09-10T06:27:00.886754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.886552+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:20.328951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.950698+0000","last_change":"2024-09-10T06:27:06.950515+0000","last_active":"2024-09-10T06:27:06.950698+0000","last_peered":"2024-09-10T06:27:06.950698+0000","last_clean":"2024-09-10T06:27:06.950698+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:27:06.950698+0000","last_undegraded":"2024-09-10T06:27:06.950698+0000","last_fullsized":"2024-09-10T06:27:06.950698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.950332+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:45.058450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.048195+0000","last_change":"2024-09-10T06:27:16.048195+0000","last_active":"2024-09-10T06:27:16.048195+0000","last_peered":"2024-09-10T06:27:16.048195+0000","last_clean":"2024-09-10T06:27:16.048195+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:27:16.048195+0000","last_undegraded":"2024-09-10T06:27:16.048195+0000","last_fullsized":"2024-09-10T06:27:16.048195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.048009+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:54.490977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.678158+0000","last_change":"2024-09-10T06:26:39.678024+0000","last_active":"2024-09-10T06:26:39.678158+0000","last_peered":"2024-09-10T06:26:39.678158+0000","last_clean":"2024-09-10T06:26:39.678158+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:26:39.678158+0000","last_undegraded":"2024-09-10T06:26:39.678158+0000","last_fullsized":"2024-09-10T06:26:39.678158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.677842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:41.426578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.226344+0000","last_change":"2024-09-10T06:26:31.226136+0000","last_active":"2024-09-10T06:26:31.226344+0000","last_peered":"2024-09-10T06:26:31.226344+0000","last_clean":"2024-09-10T06:26:31.226344+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:26:31.226344+0000","last_undegraded":"2024-09-10T06:26:31.226344+0000","last_fullsized":"2024-09-10T06:26:31.226344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.225929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.623077+0000","last_change":"2024-09-10T06:26:56.622943+0000","last_active":"2024-09-10T06:26:56.623077+0000","last_peered":"2024-09-10T06:26:56.623077+0000","last_clean":"2024-09-10T06:26:56.623077+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:56.623077+0000","last_undegraded":"2024-09-10T06:26:56.623077+0000","last_fullsized":"2024-09-10T06:26:56.623077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.622754+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:30.308911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.492419+0000","last_change":"2024-09-10T06:27:23.492419+0000","last_active":"2024-09-10T06:27:23.492419+0000","last_peered":"2024-09-10T06:27:23.492419+0000","last_clean":"2024-09-10T06:27:23.492419+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:27:23.492419+0000","last_undegraded":"2024-09-10T06:27:23.492419+0000","last_fullsized":"2024-09-10T06:27:23.492419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:23.492227+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:23.492227+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.492227+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:30.078203+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.790722+0000","last_change":"2024-09-10T06:27:11.790567+0000","last_active":"2024-09-10T06:27:11.790722+0000","last_peered":"2024-09-10T06:27:11.790722+0000","last_clean":"2024-09-10T06:27:11.790722+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:27:11.790722+0000","last_undegraded":"2024-09-10T06:27:11.790722+0000","last_fullsized":"2024-09-10T06:27:11.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.790389+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:15.981073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.008058+0000","last_change":"2024-09-10T06:27:12.008058+0000","last_active":"2024-09-10T06:27:12.008058+0000","last_peered":"2024-09-10T06:27:12.008058+0000","last_clean":"2024-09-10T06:27:12.008058+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:27:12.008058+0000","last_undegraded":"2024-09-10T06:27:12.008058+0000","last_fullsized":"2024-09-10T06:27:12.008058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.007872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:58.932903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.706591+0000","last_change":"2024-09-10T06:26:38.706449+0000","last_active":"2024-09-10T06:26:38.706591+0000","last_peered":"2024-09-10T06:26:38.706591+0000","last_clean":"2024-09-10T06:26:38.706591+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:26:38.706591+0000","last_undegraded":"2024-09-10T06:26:38.706591+0000","last_fullsized":"2024-09-10T06:26:38.706591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.706224+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:22.987665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.163027+0000","last_change":"2024-09-10T06:26:29.162880+0000","last_active":"2024-09-10T06:26:29.163027+0000","last_peered":"2024-09-10T06:26:29.163027+0000","last_clean":"2024-09-10T06:26:29.163027+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:26:29.163027+0000","last_undegraded":"2024-09-10T06:26:29.163027+0000","last_fullsized":"2024-09-10T06:26:29.163027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.162701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:58.415388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.421200+0000","last_change":"2024-09-10T06:27:12.421200+0000","last_active":"2024-09-10T06:27:12.421200+0000","last_peered":"2024-09-10T06:27:12.421200+0000","last_clean":"2024-09-10T06:27:12.421200+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:27:12.421200+0000","last_undegraded":"2024-09-10T06:27:12.421200+0000","last_fullsized":"2024-09-10T06:27:12.421200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.421025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:07.088348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.793831+0000","last_change":"2024-09-10T06:27:07.793669+0000","last_active":"2024-09-10T06:27:07.793831+0000","last_peered":"2024-09-10T06:27:07.793831+0000","last_clean":"2024-09-10T06:27:07.793831+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:27:07.793831+0000","last_undegraded":"2024-09-10T06:27:07.793831+0000","last_fullsized":"2024-09-10T06:27:07.793831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.793475+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:45.277415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.913742+0000","last_change":"2024-09-10T06:27:05.913496+0000","last_active":"2024-09-10T06:27:05.913742+0000","last_peered":"2024-09-10T06:27:05.913742+0000","last_clean":"2024-09-10T06:27:05.913742+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:27:05.913742+0000","last_undegraded":"2024-09-10T06:27:05.913742+0000","last_fullsized":"2024-09-10T06:27:05.913742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.913303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:22.053524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.795898+0000","last_change":"2024-09-10T06:27:16.795898+0000","last_active":"2024-09-10T06:27:16.795898+0000","last_peered":"2024-09-10T06:27:16.795898+0000","last_clean":"2024-09-10T06:27:16.795898+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:27:16.795898+0000","last_undegraded":"2024-09-10T06:27:16.795898+0000","last_fullsized":"2024-09-10T06:27:16.795898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.795716+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:39.359169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.183922+0000","last_change":"2024-09-10T06:26:52.183922+0000","last_active":"2024-09-10T06:26:52.183922+0000","last_peered":"2024-09-10T06:26:52.183922+0000","last_clean":"2024-09-10T06:26:52.183922+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:26:52.183922+0000","last_undegraded":"2024-09-10T06:26:52.183922+0000","last_fullsized":"2024-09-10T06:26:52.183922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.183746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:24.557171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.430887+0000","last_change":"2024-09-10T06:26:21.430739+0000","last_active":"2024-09-10T06:26:21.430887+0000","last_peered":"2024-09-10T06:26:21.430887+0000","last_clean":"2024-09-10T06:26:21.430887+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:26:21.430887+0000","last_undegraded":"2024-09-10T06:26:21.430887+0000","last_fullsized":"2024-09-10T06:26:21.430887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.430530+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.906584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.133425+0000","last_change":"2024-09-10T06:26:25.133287+0000","last_active":"2024-09-10T06:26:25.133425+0000","last_peered":"2024-09-10T06:26:25.133425+0000","last_clean":"2024-09-10T06:26:25.133425+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:26:25.133425+0000","last_undegraded":"2024-09-10T06:26:25.133425+0000","last_fullsized":"2024-09-10T06:26:25.133425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.133112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:31.494004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.114495+0000","last_change":"2024-09-10T06:26:27.114356+0000","last_active":"2024-09-10T06:26:27.114495+0000","last_peered":"2024-09-10T06:26:27.114495+0000","last_clean":"2024-09-10T06:26:27.114495+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:26:27.114495+0000","last_undegraded":"2024-09-10T06:26:27.114495+0000","last_fullsized":"2024-09-10T06:26:27.114495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.114182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:12.450302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.706809+0000","last_change":"2024-09-10T06:27:02.706809+0000","last_active":"2024-09-10T06:27:02.706809+0000","last_peered":"2024-09-10T06:27:02.706809+0000","last_clean":"2024-09-10T06:27:02.706809+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:27:02.706809+0000","last_undegraded":"2024-09-10T06:27:02.706809+0000","last_fullsized":"2024-09-10T06:27:02.706809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.706627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:58.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.459814+0000","last_change":"2024-09-10T06:27:19.459814+0000","last_active":"2024-09-10T06:27:19.459814+0000","last_peered":"2024-09-10T06:27:19.459814+0000","last_clean":"2024-09-10T06:27:19.459814+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:27:19.459814+0000","last_undegraded":"2024-09-10T06:27:19.459814+0000","last_fullsized":"2024-09-10T06:27:19.459814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-10T06:27:19.459618+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-10T06:27:19.459618+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.459618+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:53.674058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.133402+0000","last_change":"2024-09-10T06:27:07.133402+0000","last_active":"2024-09-10T06:27:07.133402+0000","last_peered":"2024-09-10T06:27:07.133402+0000","last_clean":"2024-09-10T06:27:07.133402+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:27:07.133402+0000","last_undegraded":"2024-09-10T06:27:07.133402+0000","last_fullsized":"2024-09-10T06:27:07.133402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.133224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:15.988185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.982002+0000","last_change":"2024-09-10T06:27:13.982002+0000","last_active":"2024-09-10T06:27:13.982002+0000","last_peered":"2024-09-10T06:27:13.982002+0000","last_clean":"2024-09-10T06:27:13.982002+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:27:13.982002+0000","last_undegraded":"2024-09-10T06:27:13.982002+0000","last_fullsized":"2024-09-10T06:27:13.982002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.981774+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:13.403816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.220282+0000","last_change":"2024-09-10T06:26:54.220282+0000","last_active":"2024-09-10T06:26:54.220282+0000","last_peered":"2024-09-10T06:26:54.220282+0000","last_clean":"2024-09-10T06:26:54.220282+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:26:54.220282+0000","last_undegraded":"2024-09-10T06:26:54.220282+0000","last_fullsized":"2024-09-10T06:26:54.220282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.220103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:38.687973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.062353+0000","last_change":"2024-09-10T06:26:23.062225+0000","last_active":"2024-09-10T06:26:23.062353+0000","last_peered":"2024-09-10T06:26:23.062353+0000","last_clean":"2024-09-10T06:26:23.062353+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:26:23.062353+0000","last_undegraded":"2024-09-10T06:26:23.062353+0000","last_fullsized":"2024-09-10T06:26:23.062353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.062051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:53.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.133509+0000","last_change":"2024-09-10T06:26:27.133378+0000","last_active":"2024-09-10T06:26:27.133509+0000","last_peered":"2024-09-10T06:26:27.133509+0000","last_clean":"2024-09-10T06:26:27.133509+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:26:27.133509+0000","last_undegraded":"2024-09-10T06:26:27.133509+0000","last_fullsized":"2024-09-10T06:26:27.133509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.133202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.725768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.373888+0000","last_change":"2024-09-10T06:27:11.373888+0000","last_active":"2024-09-10T06:27:11.373888+0000","last_peered":"2024-09-10T06:27:11.373888+0000","last_clean":"2024-09-10T06:27:11.373888+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:27:11.373888+0000","last_undegraded":"2024-09-10T06:27:11.373888+0000","last_fullsized":"2024-09-10T06:27:11.373888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.373710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:50.802747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":522,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.787324+0000","last_change":"2024-09-10T06:27:05.787324+0000","last_active":"2024-09-10T06:27:05.787324+0000","last_peered":"2024-09-10T06:27:05.787324+0000","last_clean":"2024-09-10T06:27:05.787324+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:27:05.787324+0000","last_undegraded":"2024-09-10T06:27:05.787324+0000","last_fullsized":"2024-09-10T06:27:05.787324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.787116+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:29.185370+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:29.415683+0000","last_change":"2024-09-10T06:27:29.415683+0000","last_active":"2024-09-10T06:27:29.415683+0000","last_peered":"2024-09-10T06:27:29.415683+0000","last_clean":"2024-09-10T06:27:29.415683+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:27:29.415683+0000","last_undegraded":"2024-09-10T06:27:29.415683+0000","last_fullsized":"2024-09-10T06:27:29.415683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:29.415507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:29.415507+0000","last_clean_scrub_stamp":"2024-09-10T06:27:29.415507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:37.164265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.729857+0000","last_change":"2024-09-10T06:27:18.729857+0000","last_active":"2024-09-10T06:27:18.729857+0000","last_peered":"2024-09-10T06:27:18.729857+0000","last_clean":"2024-09-10T06:27:18.729857+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:27:18.729857+0000","last_undegraded":"2024-09-10T06:27:18.729857+0000","last_fullsized":"2024-09-10T06:27:18.729857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:18.729674+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:18.729674+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.729674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:56.841608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.938954+0000","last_change":"2024-09-10T06:26:37.938819+0000","last_active":"2024-09-10T06:26:37.938954+0000","last_peered":"2024-09-10T06:26:37.938954+0000","last_clean":"2024-09-10T06:26:37.938954+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:26:37.938954+0000","last_undegraded":"2024-09-10T06:26:37.938954+0000","last_fullsized":"2024-09-10T06:26:37.938954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.938636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:58.249435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.534176+0000","last_change":"2024-09-10T06:26:22.533999+0000","last_active":"2024-09-10T06:26:22.534176+0000","last_peered":"2024-09-10T06:26:22.534176+0000","last_clean":"2024-09-10T06:26:22.534176+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:26:22.534176+0000","last_undegraded":"2024-09-10T06:26:22.534176+0000","last_fullsized":"2024-09-10T06:26:22.534176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.533815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:40.223076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.986222+0000","last_change":"2024-09-10T06:26:32.986222+0000","last_active":"2024-09-10T06:26:32.986222+0000","last_peered":"2024-09-10T06:26:32.986222+0000","last_clean":"2024-09-10T06:26:32.986222+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:26:32.986222+0000","last_undegraded":"2024-09-10T06:26:32.986222+0000","last_fullsized":"2024-09-10T06:26:32.986222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.986038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:36.552236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.774001+0000","last_change":"2024-09-10T06:26:51.773755+0000","last_active":"2024-09-10T06:26:51.774001+0000","last_peered":"2024-09-10T06:26:51.774001+0000","last_clean":"2024-09-10T06:26:51.774001+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:26:51.774001+0000","last_undegraded":"2024-09-10T06:26:51.774001+0000","last_fullsized":"2024-09-10T06:26:51.774001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.773529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:00.851784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.865605+0000","last_change":"2024-09-10T06:26:57.865605+0000","last_active":"2024-09-10T06:26:57.865605+0000","last_peered":"2024-09-10T06:26:57.865605+0000","last_clean":"2024-09-10T06:26:57.865605+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:26:57.865605+0000","last_undegraded":"2024-09-10T06:26:57.865605+0000","last_fullsized":"2024-09-10T06:26:57.865605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.865375+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:00.148660+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.048056+0000","last_change":"2024-09-10T06:27:05.048056+0000","last_active":"2024-09-10T06:27:05.048056+0000","last_peered":"2024-09-10T06:27:05.048056+0000","last_clean":"2024-09-10T06:27:05.048056+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:27:05.048056+0000","last_undegraded":"2024-09-10T06:27:05.048056+0000","last_fullsized":"2024-09-10T06:27:05.048056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.047881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:09.238565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:38.486349+0000","last_change":"2024-09-10T06:27:38.486349+0000","last_active":"2024-09-10T06:27:38.486349+0000","last_peered":"2024-09-10T06:27:38.486349+0000","last_clean":"2024-09-10T06:27:38.486349+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:27:38.486349+0000","last_undegraded":"2024-09-10T06:27:38.486349+0000","last_fullsized":"2024-09-10T06:27:38.486349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:38.486166+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:38.486166+0000","last_clean_scrub_stamp":"2024-09-10T06:27:38.486166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:22.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.937901+0000","last_change":"2024-09-10T06:26:35.937768+0000","last_active":"2024-09-10T06:26:35.937901+0000","last_peered":"2024-09-10T06:26:35.937901+0000","last_clean":"2024-09-10T06:26:35.937901+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:26:35.937901+0000","last_undegraded":"2024-09-10T06:26:35.937901+0000","last_fullsized":"2024-09-10T06:26:35.937901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.937562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:19.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.110596+0000","last_change":"2024-09-10T06:26:24.110300+0000","last_active":"2024-09-10T06:26:24.110596+0000","last_peered":"2024-09-10T06:26:24.110596+0000","last_clean":"2024-09-10T06:26:24.110596+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:26:24.110596+0000","last_undegraded":"2024-09-10T06:26:24.110596+0000","last_fullsized":"2024-09-10T06:26:24.110596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.110079+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:06.285600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.521768+0000","last_change":"2024-09-10T06:26:23.521588+0000","last_active":"2024-09-10T06:26:23.521768+0000","last_peered":"2024-09-10T06:26:23.521768+0000","last_clean":"2024-09-10T06:26:23.521768+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:26:23.521768+0000","last_undegraded":"2024-09-10T06:26:23.521768+0000","last_fullsized":"2024-09-10T06:26:23.521768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.521400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.804217+0000","last_change":"2024-09-10T06:26:47.804089+0000","last_active":"2024-09-10T06:26:47.804217+0000","last_peered":"2024-09-10T06:26:47.804217+0000","last_clean":"2024-09-10T06:26:47.804217+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:26:47.804217+0000","last_undegraded":"2024-09-10T06:26:47.804217+0000","last_fullsized":"2024-09-10T06:26:47.804217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.803914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:48.283325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.438193+0000","last_change":"2024-09-10T06:27:18.438193+0000","last_active":"2024-09-10T06:27:18.438193+0000","last_peered":"2024-09-10T06:27:18.438193+0000","last_clean":"2024-09-10T06:27:18.438193+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:27:18.438193+0000","last_undegraded":"2024-09-10T06:27:18.438193+0000","last_fullsized":"2024-09-10T06:27:18.438193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.437997+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:56.198406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:30.399446+0000","last_change":"2024-09-10T06:27:30.399446+0000","last_active":"2024-09-10T06:27:30.399446+0000","last_peered":"2024-09-10T06:27:30.399446+0000","last_clean":"2024-09-10T06:27:30.399446+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:27:30.399446+0000","last_undegraded":"2024-09-10T06:27:30.399446+0000","last_fullsized":"2024-09-10T06:27:30.399446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:30.399207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:30.399207+0000","last_clean_scrub_stamp":"2024-09-10T06:27:30.399207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:58.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.691447+0000","last_change":"2024-09-10T06:27:19.691447+0000","last_active":"2024-09-10T06:27:19.691447+0000","last_peered":"2024-09-10T06:27:19.691447+0000","last_clean":"2024-09-10T06:27:19.691447+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:27:19.691447+0000","last_undegraded":"2024-09-10T06:27:19.691447+0000","last_fullsized":"2024-09-10T06:27:19.691447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:19.691241+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:19.691241+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.691241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:15.449630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.689351+0000","last_change":"2024-09-10T06:26:35.689163+0000","last_active":"2024-09-10T06:26:35.689351+0000","last_peered":"2024-09-10T06:26:35.689351+0000","last_clean":"2024-09-10T06:26:35.689351+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:26:35.689351+0000","last_undegraded":"2024-09-10T06:26:35.689351+0000","last_fullsized":"2024-09-10T06:26:35.689351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.688987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:31.604105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.490317+0000","last_change":"2024-09-10T06:26:24.490106+0000","last_active":"2024-09-10T06:26:24.490317+0000","last_peered":"2024-09-10T06:26:24.490317+0000","last_clean":"2024-09-10T06:26:24.490317+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:26:24.490317+0000","last_undegraded":"2024-09-10T06:26:24.490317+0000","last_fullsized":"2024-09-10T06:26:24.490317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.489901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:12.908340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.051982+0000","last_change":"2024-09-10T06:26:22.051863+0000","last_active":"2024-09-10T06:26:22.051982+0000","last_peered":"2024-09-10T06:26:22.051982+0000","last_clean":"2024-09-10T06:26:22.051982+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:26:22.051982+0000","last_undegraded":"2024-09-10T06:26:22.051982+0000","last_fullsized":"2024-09-10T06:26:22.051982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.051670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:16.319555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.777642+0000","last_change":"2024-09-10T06:26:52.777642+0000","last_active":"2024-09-10T06:26:52.777642+0000","last_peered":"2024-09-10T06:26:52.777642+0000","last_clean":"2024-09-10T06:26:52.777642+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:26:52.777642+0000","last_undegraded":"2024-09-10T06:26:52.777642+0000","last_fullsized":"2024-09-10T06:26:52.777642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.777465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:35.701349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.890446+0000","last_change":"2024-09-10T06:26:57.890446+0000","last_active":"2024-09-10T06:26:57.890446+0000","last_peered":"2024-09-10T06:26:57.890446+0000","last_clean":"2024-09-10T06:26:57.890446+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:57.890446+0000","last_undegraded":"2024-09-10T06:26:57.890446+0000","last_fullsized":"2024-09-10T06:26:57.890446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.890180+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:20.654790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.912572+0000","last_change":"2024-09-10T06:27:04.912572+0000","last_active":"2024-09-10T06:27:04.912572+0000","last_peered":"2024-09-10T06:27:04.912572+0000","last_clean":"2024-09-10T06:27:04.912572+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:27:04.912572+0000","last_undegraded":"2024-09-10T06:27:04.912572+0000","last_fullsized":"2024-09-10T06:27:04.912572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.912401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:17.835171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.161827+0000","last_change":"2024-09-10T06:27:22.161827+0000","last_active":"2024-09-10T06:27:22.161827+0000","last_peered":"2024-09-10T06:27:22.161827+0000","last_clean":"2024-09-10T06:27:22.161827+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:27:22.161827+0000","last_undegraded":"2024-09-10T06:27:22.161827+0000","last_fullsized":"2024-09-10T06:27:22.161827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-10T06:27:22.161636+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-10T06:27:22.161636+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.161636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:05.740437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.722988+0000","last_change":"2024-09-10T06:26:36.722846+0000","last_active":"2024-09-10T06:26:36.722988+0000","last_peered":"2024-09-10T06:26:36.722988+0000","last_clean":"2024-09-10T06:26:36.722988+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:26:36.722988+0000","last_undegraded":"2024-09-10T06:26:36.722988+0000","last_fullsized":"2024-09-10T06:26:36.722988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.722678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:48.489772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.119809+0000","last_change":"2024-09-10T06:26:26.119665+0000","last_active":"2024-09-10T06:26:26.119809+0000","last_peered":"2024-09-10T06:26:26.119809+0000","last_clean":"2024-09-10T06:26:26.119809+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:26:26.119809+0000","last_undegraded":"2024-09-10T06:26:26.119809+0000","last_fullsized":"2024-09-10T06:26:26.119809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.119470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:37.159096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.160188+0000","last_change":"2024-09-10T06:26:26.160035+0000","last_active":"2024-09-10T06:26:26.160188+0000","last_peered":"2024-09-10T06:26:26.160188+0000","last_clean":"2024-09-10T06:26:26.160188+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:26:26.160188+0000","last_undegraded":"2024-09-10T06:26:26.160188+0000","last_fullsized":"2024-09-10T06:26:26.160188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.159855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:31.433358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'2","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.403837+0000","last_change":"2024-09-10T06:27:10.403837+0000","last_active":"2024-09-10T06:27:10.403837+0000","last_peered":"2024-09-10T06:27:10.403837+0000","last_clean":"2024-09-10T06:27:10.403837+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:27:10.403837+0000","last_undegraded":"2024-09-10T06:27:10.403837+0000","last_fullsized":"2024-09-10T06:27:10.403837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.403652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:32.480460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.796424+0000","last_change":"2024-09-10T06:27:04.796424+0000","last_active":"2024-09-10T06:27:04.796424+0000","last_peered":"2024-09-10T06:27:04.796424+0000","last_clean":"2024-09-10T06:27:04.796424+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:27:04.796424+0000","last_undegraded":"2024-09-10T06:27:04.796424+0000","last_fullsized":"2024-09-10T06:27:04.796424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.796219+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:27.560828+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.790398+0000","last_change":"2024-09-10T06:27:10.790398+0000","last_active":"2024-09-10T06:27:10.790398+0000","last_peered":"2024-09-10T06:27:10.790398+0000","last_clean":"2024-09-10T06:27:10.790398+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:27:10.790398+0000","last_undegraded":"2024-09-10T06:27:10.790398+0000","last_fullsized":"2024-09-10T06:27:10.790398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.790197+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:52.737759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:39.500049+0000","last_change":"2024-09-10T06:27:39.500049+0000","last_active":"2024-09-10T06:27:39.500049+0000","last_peered":"2024-09-10T06:27:39.500049+0000","last_clean":"2024-09-10T06:27:39.500049+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:27:39.500049+0000","last_undegraded":"2024-09-10T06:27:39.500049+0000","last_fullsized":"2024-09-10T06:27:39.500049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:27:39.499865+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:27:39.499865+0000","last_clean_scrub_stamp":"2024-09-10T06:27:39.499865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:36.600493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.209654+0000","last_change":"2024-09-10T06:26:50.209654+0000","last_active":"2024-09-10T06:26:50.209654+0000","last_peered":"2024-09-10T06:26:50.209654+0000","last_clean":"2024-09-10T06:26:50.209654+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:26:50.209654+0000","last_undegraded":"2024-09-10T06:26:50.209654+0000","last_fullsized":"2024-09-10T06:26:50.209654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.209478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:06.513527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.188162+0000","last_change":"2024-09-10T06:26:30.188003+0000","last_active":"2024-09-10T06:26:30.188162+0000","last_peered":"2024-09-10T06:26:30.188162+0000","last_clean":"2024-09-10T06:26:30.188162+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:26:30.188162+0000","last_undegraded":"2024-09-10T06:26:30.188162+0000","last_fullsized":"2024-09-10T06:26:30.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.187831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:12.704769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.007778+0000","last_change":"2024-09-10T06:26:21.007725+0000","last_active":"2024-09-10T06:26:21.007778+0000","last_peered":"2024-09-10T06:26:21.007778+0000","last_clean":"2024-09-10T06:26:21.007778+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:26:21.007778+0000","last_undegraded":"2024-09-10T06:26:21.007778+0000","last_fullsized":"2024-09-10T06:26:21.007778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.007653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:45.011060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.355791+0000","last_change":"2024-09-10T06:27:09.355791+0000","last_active":"2024-09-10T06:27:09.355791+0000","last_peered":"2024-09-10T06:27:09.355791+0000","last_clean":"2024-09-10T06:27:09.355791+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:27:09.355791+0000","last_undegraded":"2024-09-10T06:27:09.355791+0000","last_fullsized":"2024-09-10T06:27:09.355791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.355613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:07.390539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.420797+0000","last_change":"2024-09-10T06:27:17.420797+0000","last_active":"2024-09-10T06:27:17.420797+0000","last_peered":"2024-09-10T06:27:17.420797+0000","last_clean":"2024-09-10T06:27:17.420797+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:27:17.420797+0000","last_undegraded":"2024-09-10T06:27:17.420797+0000","last_fullsized":"2024-09-10T06:27:17.420797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.420603+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:02.195942+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.048731+0000","last_change":"2024-09-10T06:27:04.048731+0000","last_active":"2024-09-10T06:27:04.048731+0000","last_peered":"2024-09-10T06:27:04.048731+0000","last_clean":"2024-09-10T06:27:04.048731+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:27:04.048731+0000","last_undegraded":"2024-09-10T06:27:04.048731+0000","last_fullsized":"2024-09-10T06:27:04.048731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.048546+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:45.996107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.664065+0000","last_change":"2024-09-10T06:27:20.664065+0000","last_active":"2024-09-10T06:27:20.664065+0000","last_peered":"2024-09-10T06:27:20.664065+0000","last_clean":"2024-09-10T06:27:20.664065+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:27:20.664065+0000","last_undegraded":"2024-09-10T06:27:20.664065+0000","last_fullsized":"2024-09-10T06:27:20.664065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-10T06:27:20.663869+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-10T06:27:20.663869+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.663869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:20.440525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.502161+0000","last_change":"2024-09-10T06:26:35.501999+0000","last_active":"2024-09-10T06:26:35.502161+0000","last_peered":"2024-09-10T06:26:35.502161+0000","last_clean":"2024-09-10T06:26:35.502161+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:26:35.502161+0000","last_undegraded":"2024-09-10T06:26:35.502161+0000","last_fullsized":"2024-09-10T06:26:35.502161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.501822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:29.856717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.433328+0000","last_change":"2024-09-10T06:26:22.433192+0000","last_active":"2024-09-10T06:26:22.433328+0000","last_peered":"2024-09-10T06:26:22.433328+0000","last_clean":"2024-09-10T06:26:22.433328+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:26:22.433328+0000","last_undegraded":"2024-09-10T06:26:22.433328+0000","last_fullsized":"2024-09-10T06:26:22.433328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.433009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.297315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.163161+0000","last_change":"2024-09-10T06:26:28.163027+0000","last_active":"2024-09-10T06:26:28.163161+0000","last_peered":"2024-09-10T06:26:28.163161+0000","last_clean":"2024-09-10T06:26:28.163161+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:26:28.163161+0000","last_undegraded":"2024-09-10T06:26:28.163161+0000","last_fullsized":"2024-09-10T06:26:28.163161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.162858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:23.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.345259+0000","last_change":"2024-09-10T06:27:07.345259+0000","last_active":"2024-09-10T06:27:07.345259+0000","last_peered":"2024-09-10T06:27:07.345259+0000","last_clean":"2024-09-10T06:27:07.345259+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:27:07.345259+0000","last_undegraded":"2024-09-10T06:27:07.345259+0000","last_fullsized":"2024-09-10T06:27:07.345259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.345085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.226244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'99","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.822092+0000","last_change":"2024-09-10T06:26:58.822092+0000","last_active":"2024-09-10T06:26:58.822092+0000","last_peered":"2024-09-10T06:26:58.822092+0000","last_clean":"2024-09-10T06:26:58.822092+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:58.822092+0000","last_undegraded":"2024-09-10T06:26:58.822092+0000","last_fullsized":"2024-09-10T06:26:58.822092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.821871+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:30.069598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.089281+0000","last_change":"2024-09-10T06:27:06.089281+0000","last_active":"2024-09-10T06:27:06.089281+0000","last_peered":"2024-09-10T06:27:06.089281+0000","last_clean":"2024-09-10T06:27:06.089281+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:27:06.089281+0000","last_undegraded":"2024-09-10T06:27:06.089281+0000","last_fullsized":"2024-09-10T06:27:06.089281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.089099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:07.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.993365+0000","last_change":"2024-09-10T06:27:14.993365+0000","last_active":"2024-09-10T06:27:14.993365+0000","last_peered":"2024-09-10T06:27:14.993365+0000","last_clean":"2024-09-10T06:27:14.993365+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:27:14.993365+0000","last_undegraded":"2024-09-10T06:27:14.993365+0000","last_fullsized":"2024-09-10T06:27:14.993365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.993162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:56.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.936482+0000","last_change":"2024-09-10T06:27:16.936482+0000","last_active":"2024-09-10T06:27:16.936482+0000","last_peered":"2024-09-10T06:27:16.936482+0000","last_clean":"2024-09-10T06:27:16.936482+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:27:16.936482+0000","last_undegraded":"2024-09-10T06:27:16.936482+0000","last_fullsized":"2024-09-10T06:27:16.936482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.936302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:29.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.698416+0000","last_change":"2024-09-10T06:26:41.698211+0000","last_active":"2024-09-10T06:26:41.698416+0000","last_peered":"2024-09-10T06:26:41.698416+0000","last_clean":"2024-09-10T06:26:41.698416+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:26:41.698416+0000","last_undegraded":"2024-09-10T06:26:41.698416+0000","last_fullsized":"2024-09-10T06:26:41.698416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.698029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.247060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.306906+0000","last_change":"2024-09-10T06:26:37.306783+0000","last_active":"2024-09-10T06:26:37.306906+0000","last_peered":"2024-09-10T06:26:37.306906+0000","last_clean":"2024-09-10T06:26:37.306906+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:26:37.306906+0000","last_undegraded":"2024-09-10T06:26:37.306906+0000","last_fullsized":"2024-09-10T06:26:37.306906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.306607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:41.035747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.651045+0000","last_change":"2024-09-10T06:26:57.650913+0000","last_active":"2024-09-10T06:26:57.651045+0000","last_peered":"2024-09-10T06:26:57.651045+0000","last_clean":"2024-09-10T06:26:57.651045+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:26:57.651045+0000","last_undegraded":"2024-09-10T06:26:57.651045+0000","last_fullsized":"2024-09-10T06:26:57.651045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.650735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:08.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:32.375155+0000","last_change":"2024-09-10T06:27:32.375155+0000","last_active":"2024-09-10T06:27:32.375155+0000","last_peered":"2024-09-10T06:27:32.375155+0000","last_clean":"2024-09-10T06:27:32.375155+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:27:32.375155+0000","last_undegraded":"2024-09-10T06:27:32.375155+0000","last_fullsized":"2024-09-10T06:27:32.375155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:32.374922+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:32.374922+0000","last_clean_scrub_stamp":"2024-09-10T06:27:32.374922+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:05.701290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:31.385277+0000","last_change":"2024-09-10T06:27:31.385277+0000","last_active":"2024-09-10T06:27:31.385277+0000","last_peered":"2024-09-10T06:27:31.385277+0000","last_clean":"2024-09-10T06:27:31.385277+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:27:31.385277+0000","last_undegraded":"2024-09-10T06:27:31.385277+0000","last_fullsized":"2024-09-10T06:27:31.385277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:31.385092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:31.385092+0000","last_clean_scrub_stamp":"2024-09-10T06:27:31.385092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:43.558550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.118082+0000","last_change":"2024-09-10T06:27:23.118082+0000","last_active":"2024-09-10T06:27:23.118082+0000","last_peered":"2024-09-10T06:27:23.118082+0000","last_clean":"2024-09-10T06:27:23.118082+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:27:23.118082+0000","last_undegraded":"2024-09-10T06:27:23.118082+0000","last_fullsized":"2024-09-10T06:27:23.118082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:23.117913+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:23.117913+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.117913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:32.325145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.686921+0000","last_change":"2024-09-10T06:26:40.686734+0000","last_active":"2024-09-10T06:26:40.686921+0000","last_peered":"2024-09-10T06:26:40.686921+0000","last_clean":"2024-09-10T06:26:40.686921+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:26:40.686921+0000","last_undegraded":"2024-09-10T06:26:40.686921+0000","last_fullsized":"2024-09-10T06:26:40.686921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.686561+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:13.693128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.467865+0000","last_change":"2024-09-10T06:26:27.467698+0000","last_active":"2024-09-10T06:26:27.467865+0000","last_peered":"2024-09-10T06:26:27.467865+0000","last_clean":"2024-09-10T06:26:27.467865+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:26:27.467865+0000","last_undegraded":"2024-09-10T06:26:27.467865+0000","last_fullsized":"2024-09-10T06:26:27.467865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.467505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:10.628970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.402798+0000","last_change":"2024-09-10T06:27:14.402653+0000","last_active":"2024-09-10T06:27:14.402798+0000","last_peered":"2024-09-10T06:27:14.402798+0000","last_clean":"2024-09-10T06:27:14.402798+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:27:14.402798+0000","last_undegraded":"2024-09-10T06:27:14.402798+0000","last_fullsized":"2024-09-10T06:27:14.402798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.402479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:30.712632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.999318+0000","last_change":"2024-09-10T06:27:02.999232+0000","last_active":"2024-09-10T06:27:02.999318+0000","last_peered":"2024-09-10T06:27:02.999318+0000","last_clean":"2024-09-10T06:27:02.999318+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:27:02.999318+0000","last_undegraded":"2024-09-10T06:27:02.999318+0000","last_fullsized":"2024-09-10T06:27:02.999318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.999134+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:14.858999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.001609+0000","last_change":"2024-09-10T06:27:09.001426+0000","last_active":"2024-09-10T06:27:09.001609+0000","last_peered":"2024-09-10T06:27:09.001609+0000","last_clean":"2024-09-10T06:27:09.001609+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:27:09.001609+0000","last_undegraded":"2024-09-10T06:27:09.001609+0000","last_fullsized":"2024-09-10T06:27:09.001609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.001237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:24.656485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.205524+0000","last_change":"2024-09-10T06:27:21.205339+0000","last_active":"2024-09-10T06:27:21.205524+0000","last_peered":"2024-09-10T06:27:21.205524+0000","last_clean":"2024-09-10T06:27:21.205524+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:27:21.205524+0000","last_undegraded":"2024-09-10T06:27:21.205524+0000","last_fullsized":"2024-09-10T06:27:21.205524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:21.205145+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:21.205145+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.205145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:59.013920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.840752+0000","last_change":"2024-09-10T06:26:42.840670+0000","last_active":"2024-09-10T06:26:42.840752+0000","last_peered":"2024-09-10T06:26:42.840752+0000","last_clean":"2024-09-10T06:26:42.840752+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:26:42.840752+0000","last_undegraded":"2024-09-10T06:26:42.840752+0000","last_fullsized":"2024-09-10T06:26:42.840752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.840563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:01.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.412780+0000","last_change":"2024-09-10T06:26:30.412608+0000","last_active":"2024-09-10T06:26:30.412780+0000","last_peered":"2024-09-10T06:26:30.412780+0000","last_clean":"2024-09-10T06:26:30.412780+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:26:30.412780+0000","last_undegraded":"2024-09-10T06:26:30.412780+0000","last_fullsized":"2024-09-10T06:26:30.412780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.412443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:27.375871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.706963+0000","last_change":"2024-09-10T06:26:53.706775+0000","last_active":"2024-09-10T06:26:53.706963+0000","last_peered":"2024-09-10T06:26:53.706963+0000","last_clean":"2024-09-10T06:26:53.706963+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:26:53.706963+0000","last_undegraded":"2024-09-10T06:26:53.706963+0000","last_fullsized":"2024-09-10T06:26:53.706963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.706565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:21.763699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.868501+0000","last_change":"2024-09-10T06:26:55.868369+0000","last_active":"2024-09-10T06:26:55.868501+0000","last_peered":"2024-09-10T06:26:55.868501+0000","last_clean":"2024-09-10T06:26:55.868501+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:55.868501+0000","last_undegraded":"2024-09-10T06:26:55.868501+0000","last_fullsized":"2024-09-10T06:26:55.868501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.868167+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:51.332406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.806036+0000","last_change":"2024-09-10T06:27:12.805908+0000","last_active":"2024-09-10T06:27:12.806036+0000","last_peered":"2024-09-10T06:27:12.806036+0000","last_clean":"2024-09-10T06:27:12.806036+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:27:12.806036+0000","last_undegraded":"2024-09-10T06:27:12.806036+0000","last_fullsized":"2024-09-10T06:27:12.806036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.805731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:46.334617+0000","last_change":"2024-09-10T06:22:41.895373+0000","last_active":"2024-09-10T06:25:46.334617+0000","last_peered":"2024-09-10T06:25:46.334617+0000","last_clean":"2024-09-10T06:25:46.334617+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:25:46.334617+0000","last_undegraded":"2024-09-10T06:25:46.334617+0000","last_fullsized":"2024-09-10T06:25:46.334617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.197383+0000","last_change":"2024-09-10T06:26:56.197236+0000","last_active":"2024-09-10T06:26:56.197383+0000","last_peered":"2024-09-10T06:26:56.197383+0000","last_clean":"2024-09-10T06:26:56.197383+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:26:56.197383+0000","last_undegraded":"2024-09-10T06:26:56.197383+0000","last_fullsized":"2024-09-10T06:26:56.197383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.197045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:27.788695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.483548+0000","last_change":"2024-09-10T06:26:24.483285+0000","last_active":"2024-09-10T06:26:24.483548+0000","last_peered":"2024-09-10T06:26:24.483548+0000","last_clean":"2024-09-10T06:26:24.483548+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:26:24.483548+0000","last_undegraded":"2024-09-10T06:26:24.483548+0000","last_fullsized":"2024-09-10T06:26:24.483548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.483039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:30.019052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.449473+0000","last_change":"2024-09-10T06:27:13.449345+0000","last_active":"2024-09-10T06:27:13.449473+0000","last_peered":"2024-09-10T06:27:13.449473+0000","last_clean":"2024-09-10T06:27:13.449473+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:27:13.449473+0000","last_undegraded":"2024-09-10T06:27:13.449473+0000","last_fullsized":"2024-09-10T06:27:13.449473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.449177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:41.642297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.921176+0000","last_change":"2024-09-10T06:27:01.921006+0000","last_active":"2024-09-10T06:27:01.921176+0000","last_peered":"2024-09-10T06:27:01.921176+0000","last_clean":"2024-09-10T06:27:01.921176+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:27:01.921176+0000","last_undegraded":"2024-09-10T06:27:01.921176+0000","last_fullsized":"2024-09-10T06:27:01.921176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.920831+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:20.056861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.983740+0000","last_change":"2024-09-10T06:27:07.983513+0000","last_active":"2024-09-10T06:27:07.983740+0000","last_peered":"2024-09-10T06:27:07.983740+0000","last_clean":"2024-09-10T06:27:07.983740+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:27:07.983740+0000","last_undegraded":"2024-09-10T06:27:07.983740+0000","last_fullsized":"2024-09-10T06:27:07.983740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.983266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.860758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.277414+0000","last_change":"2024-09-10T06:27:02.277414+0000","last_active":"2024-09-10T06:27:02.277414+0000","last_peered":"2024-09-10T06:27:02.277414+0000","last_clean":"2024-09-10T06:27:02.277414+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:27:02.277414+0000","last_undegraded":"2024-09-10T06:27:02.277414+0000","last_fullsized":"2024-09-10T06:27:02.277414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.277228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:05.739551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.321180+0000","last_change":"2024-09-10T06:26:38.321035+0000","last_active":"2024-09-10T06:26:38.321180+0000","last_peered":"2024-09-10T06:26:38.321180+0000","last_clean":"2024-09-10T06:26:38.321180+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:26:38.321180+0000","last_undegraded":"2024-09-10T06:26:38.321180+0000","last_fullsized":"2024-09-10T06:26:38.321180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.320842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:44.932697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.937445+0000","last_change":"2024-09-10T06:27:00.937445+0000","last_active":"2024-09-10T06:27:00.937445+0000","last_peered":"2024-09-10T06:27:00.937445+0000","last_clean":"2024-09-10T06:27:00.937445+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:27:00.937445+0000","last_undegraded":"2024-09-10T06:27:00.937445+0000","last_fullsized":"2024-09-10T06:27:00.937445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.937205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:38.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'65","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.901835+0000","last_change":"2024-09-10T06:26:58.901653+0000","last_active":"2024-09-10T06:26:58.901835+0000","last_peered":"2024-09-10T06:26:58.901835+0000","last_clean":"2024-09-10T06:26:58.901835+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:58.901835+0000","last_undegraded":"2024-09-10T06:26:58.901835+0000","last_fullsized":"2024-09-10T06:26:58.901835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.901461+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:22.299716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.993938+0000","last_change":"2024-09-10T06:27:09.993773+0000","last_active":"2024-09-10T06:27:09.993938+0000","last_peered":"2024-09-10T06:27:09.993938+0000","last_clean":"2024-09-10T06:27:09.993938+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:27:09.993938+0000","last_undegraded":"2024-09-10T06:27:09.993938+0000","last_fullsized":"2024-09-10T06:27:09.993938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.993589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:47.114955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.114573+0000","last_change":"2024-09-10T06:27:18.114433+0000","last_active":"2024-09-10T06:27:18.114573+0000","last_peered":"2024-09-10T06:27:18.114573+0000","last_clean":"2024-09-10T06:27:18.114573+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:27:18.114573+0000","last_undegraded":"2024-09-10T06:27:18.114573+0000","last_fullsized":"2024-09-10T06:27:18.114573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:27:18.114233+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:27:18.114233+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.114233+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:21.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.985592+0000","last_change":"2024-09-10T06:26:33.985592+0000","last_active":"2024-09-10T06:26:33.985592+0000","last_peered":"2024-09-10T06:26:33.985592+0000","last_clean":"2024-09-10T06:26:33.985592+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:26:33.985592+0000","last_undegraded":"2024-09-10T06:26:33.985592+0000","last_fullsized":"2024-09-10T06:26:33.985592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.985394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.488405+0000","last_change":"2024-09-10T06:26:25.488251+0000","last_active":"2024-09-10T06:26:25.488405+0000","last_peered":"2024-09-10T06:26:25.488405+0000","last_clean":"2024-09-10T06:26:25.488405+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:26:25.488405+0000","last_undegraded":"2024-09-10T06:26:25.488405+0000","last_fullsized":"2024-09-10T06:26:25.488405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.488065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:13.168721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.813155+0000","last_change":"2024-09-10T06:26:56.813155+0000","last_active":"2024-09-10T06:26:56.813155+0000","last_peered":"2024-09-10T06:26:56.813155+0000","last_clean":"2024-09-10T06:26:56.813155+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:56.813155+0000","last_undegraded":"2024-09-10T06:26:56.813155+0000","last_fullsized":"2024-09-10T06:26:56.813155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.812957+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:18.279075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:27.487988+0000","last_change":"2024-09-10T06:27:27.487856+0000","last_active":"2024-09-10T06:27:27.487988+0000","last_peered":"2024-09-10T06:27:27.487988+0000","last_clean":"2024-09-10T06:27:27.487988+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:27:27.487988+0000","last_undegraded":"2024-09-10T06:27:27.487988+0000","last_fullsized":"2024-09-10T06:27:27.487988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-10T06:27:27.487666+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-10T06:27:27.487666+0000","last_clean_scrub_stamp":"2024-09-10T06:27:27.487666+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:04.623090+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.796664+0000","last_change":"2024-09-10T06:27:15.796522+0000","last_active":"2024-09-10T06:27:15.796664+0000","last_peered":"2024-09-10T06:27:15.796664+0000","last_clean":"2024-09-10T06:27:15.796664+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:27:15.796664+0000","last_undegraded":"2024-09-10T06:27:15.796664+0000","last_fullsized":"2024-09-10T06:27:15.796664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.796342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.065806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:42.547709+0000","last_change":"2024-09-10T06:27:42.547709+0000","last_active":"2024-09-10T06:27:42.547709+0000","last_peered":"2024-09-10T06:27:42.547709+0000","last_clean":"2024-09-10T06:27:42.547709+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:27:42.547709+0000","last_undegraded":"2024-09-10T06:27:42.547709+0000","last_fullsized":"2024-09-10T06:27:42.547709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:42.547505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:42.547505+0000","last_clean_scrub_stamp":"2024-09-10T06:27:42.547505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:26:21.257127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'16","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.308720+0000","last_change":"2024-09-10T06:27:01.308555+0000","last_active":"2024-09-10T06:27:01.308720+0000","last_peered":"2024-09-10T06:27:01.308720+0000","last_clean":"2024-09-10T06:27:01.308720+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:27:01.308720+0000","last_undegraded":"2024-09-10T06:27:01.308720+0000","last_fullsized":"2024-09-10T06:27:01.308720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.308357+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:22.145053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.473124+0000","last_change":"2024-09-10T06:26:26.472997+0000","last_active":"2024-09-10T06:26:26.473124+0000","last_peered":"2024-09-10T06:26:26.473124+0000","last_clean":"2024-09-10T06:26:26.473124+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:26:26.473124+0000","last_undegraded":"2024-09-10T06:26:26.473124+0000","last_fullsized":"2024-09-10T06:26:26.473124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.472822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:54.495647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.792520+0000","last_change":"2024-09-10T06:26:55.792297+0000","last_active":"2024-09-10T06:26:55.792520+0000","last_peered":"2024-09-10T06:26:55.792520+0000","last_clean":"2024-09-10T06:26:55.792520+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:26:55.792520+0000","last_undegraded":"2024-09-10T06:26:55.792520+0000","last_fullsized":"2024-09-10T06:26:55.792520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.792027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:33.611842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.936936+0000","last_change":"2024-09-10T06:26:59.936936+0000","last_active":"2024-09-10T06:26:59.936936+0000","last_peered":"2024-09-10T06:26:59.936936+0000","last_clean":"2024-09-10T06:26:59.936936+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:59.936936+0000","last_undegraded":"2024-09-10T06:26:59.936936+0000","last_fullsized":"2024-09-10T06:26:59.936936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.936687+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:55.426141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.067168+0000","last_change":"2024-09-10T06:27:15.067168+0000","last_active":"2024-09-10T06:27:15.067168+0000","last_peered":"2024-09-10T06:27:15.067168+0000","last_clean":"2024-09-10T06:27:15.067168+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:27:15.067168+0000","last_undegraded":"2024-09-10T06:27:15.067168+0000","last_fullsized":"2024-09-10T06:27:15.067168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.066985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:17.002362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:41.508745+0000","last_change":"2024-09-10T06:27:41.508745+0000","last_active":"2024-09-10T06:27:41.508745+0000","last_peered":"2024-09-10T06:27:41.508745+0000","last_clean":"2024-09-10T06:27:41.508745+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:27:41.508745+0000","last_undegraded":"2024-09-10T06:27:41.508745+0000","last_fullsized":"2024-09-10T06:27:41.508745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:41.508561+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:41.508561+0000","last_clean_scrub_stamp":"2024-09-10T06:27:41.508561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.845164+0000","last_change":"2024-09-10T06:26:41.845005+0000","last_active":"2024-09-10T06:26:41.845164+0000","last_peered":"2024-09-10T06:26:41.845164+0000","last_clean":"2024-09-10T06:26:41.845164+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:26:41.845164+0000","last_undegraded":"2024-09-10T06:26:41.845164+0000","last_fullsized":"2024-09-10T06:26:41.845164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.844823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:18.354085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.272054+0000","last_change":"2024-09-10T06:26:40.271903+0000","last_active":"2024-09-10T06:26:40.272054+0000","last_peered":"2024-09-10T06:26:40.272054+0000","last_clean":"2024-09-10T06:26:40.272054+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:26:40.272054+0000","last_undegraded":"2024-09-10T06:26:40.272054+0000","last_fullsized":"2024-09-10T06:26:40.272054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.271701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.922441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.747156+0000","last_change":"2024-09-10T06:27:03.747006+0000","last_active":"2024-09-10T06:27:03.747156+0000","last_peered":"2024-09-10T06:27:03.747156+0000","last_clean":"2024-09-10T06:27:03.747156+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:27:03.747156+0000","last_undegraded":"2024-09-10T06:27:03.747156+0000","last_fullsized":"2024-09-10T06:27:03.747156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.746826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.502760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:28.444051+0000","last_change":"2024-09-10T06:27:28.444051+0000","last_active":"2024-09-10T06:27:28.444051+0000","last_peered":"2024-09-10T06:27:28.444051+0000","last_clean":"2024-09-10T06:27:28.444051+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:27:28.444051+0000","last_undegraded":"2024-09-10T06:27:28.444051+0000","last_fullsized":"2024-09-10T06:27:28.444051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-10T06:27:28.443831+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-10T06:27:28.443831+0000","last_clean_scrub_stamp":"2024-09-10T06:27:28.443831+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:14.033657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":432,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.961886+0000","last_change":"2024-09-10T06:27:10.961886+0000","last_active":"2024-09-10T06:27:10.961886+0000","last_peered":"2024-09-10T06:27:10.961886+0000","last_clean":"2024-09-10T06:27:10.961886+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:27:10.961886+0000","last_undegraded":"2024-09-10T06:27:10.961886+0000","last_fullsized":"2024-09-10T06:27:10.961886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.961678+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:56.160209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:40.536955+0000","last_change":"2024-09-10T06:27:40.536955+0000","last_active":"2024-09-10T06:27:40.536955+0000","last_peered":"2024-09-10T06:27:40.536955+0000","last_clean":"2024-09-10T06:27:40.536955+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:27:40.536955+0000","last_undegraded":"2024-09-10T06:27:40.536955+0000","last_fullsized":"2024-09-10T06:27:40.536955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:40.536770+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:40.536770+0000","last_clean_scrub_stamp":"2024-09-10T06:27:40.536770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:17.276384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.766439+0000","last_change":"2024-09-10T06:26:43.766249+0000","last_active":"2024-09-10T06:26:43.766439+0000","last_peered":"2024-09-10T06:26:43.766439+0000","last_clean":"2024-09-10T06:26:43.766439+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:26:43.766439+0000","last_undegraded":"2024-09-10T06:26:43.766439+0000","last_fullsized":"2024-09-10T06:26:43.766439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.766065+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:03.179883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.514821+0000","last_change":"2024-09-10T06:26:27.514686+0000","last_active":"2024-09-10T06:26:27.514821+0000","last_peered":"2024-09-10T06:26:27.514821+0000","last_clean":"2024-09-10T06:26:27.514821+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:26:27.514821+0000","last_undegraded":"2024-09-10T06:26:27.514821+0000","last_fullsized":"2024-09-10T06:26:27.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.514477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:51.644214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.736111+0000","last_change":"2024-09-10T06:27:00.735972+0000","last_active":"2024-09-10T06:27:00.736111+0000","last_peered":"2024-09-10T06:27:00.736111+0000","last_clean":"2024-09-10T06:27:00.736111+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:27:00.736111+0000","last_undegraded":"2024-09-10T06:27:00.736111+0000","last_fullsized":"2024-09-10T06:27:00.736111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.735767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:43.205771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'47","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.833705+0000","last_change":"2024-09-10T06:27:09.833538+0000","last_active":"2024-09-10T06:27:09.833705+0000","last_peered":"2024-09-10T06:27:09.833705+0000","last_clean":"2024-09-10T06:27:09.833705+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:27:09.833705+0000","last_undegraded":"2024-09-10T06:27:09.833705+0000","last_fullsized":"2024-09-10T06:27:09.833705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.833326+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:21.693191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.090894+0000","last_change":"2024-09-10T06:27:14.090734+0000","last_active":"2024-09-10T06:27:14.090894+0000","last_peered":"2024-09-10T06:27:14.090894+0000","last_clean":"2024-09-10T06:27:14.090894+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:27:14.090894+0000","last_undegraded":"2024-09-10T06:27:14.090894+0000","last_fullsized":"2024-09-10T06:27:14.090894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.090548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:13.867204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.700085+0000","last_change":"2024-09-10T06:27:21.699967+0000","last_active":"2024-09-10T06:27:21.700085+0000","last_peered":"2024-09-10T06:27:21.700085+0000","last_clean":"2024-09-10T06:27:21.700085+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:27:21.700085+0000","last_undegraded":"2024-09-10T06:27:21.700085+0000","last_fullsized":"2024-09-10T06:27:21.700085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:21.699787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:21.699787+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.699787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:23.635164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.853525+0000","last_change":"2024-09-10T06:26:48.853350+0000","last_active":"2024-09-10T06:26:48.853525+0000","last_peered":"2024-09-10T06:26:48.853525+0000","last_clean":"2024-09-10T06:26:48.853525+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:26:48.853525+0000","last_undegraded":"2024-09-10T06:26:48.853525+0000","last_fullsized":"2024-09-10T06:26:48.853525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.853173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.980423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.320984+0000","last_change":"2024-09-10T06:26:39.320847+0000","last_active":"2024-09-10T06:26:39.320984+0000","last_peered":"2024-09-10T06:26:39.320984+0000","last_clean":"2024-09-10T06:26:39.320984+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:26:39.320984+0000","last_undegraded":"2024-09-10T06:26:39.320984+0000","last_fullsized":"2024-09-10T06:26:39.320984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.320667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:50.205168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.749093+0000","last_change":"2024-09-10T06:26:54.748950+0000","last_active":"2024-09-10T06:26:54.749093+0000","last_peered":"2024-09-10T06:26:54.749093+0000","last_clean":"2024-09-10T06:26:54.749093+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:26:54.749093+0000","last_undegraded":"2024-09-10T06:26:54.749093+0000","last_fullsized":"2024-09-10T06:26:54.749093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.748750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:36.180223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.954965+0000","last_change":"2024-09-10T06:27:01.954819+0000","last_active":"2024-09-10T06:27:01.954965+0000","last_peered":"2024-09-10T06:27:01.954965+0000","last_clean":"2024-09-10T06:27:01.954965+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:27:01.954965+0000","last_undegraded":"2024-09-10T06:27:01.954965+0000","last_fullsized":"2024-09-10T06:27:01.954965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.954628+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.462199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:34.419137+0000","last_change":"2024-09-10T06:27:34.419137+0000","last_active":"2024-09-10T06:27:34.419137+0000","last_peered":"2024-09-10T06:27:34.419137+0000","last_clean":"2024-09-10T06:27:34.419137+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:27:34.419137+0000","last_undegraded":"2024-09-10T06:27:34.419137+0000","last_fullsized":"2024-09-10T06:27:34.419137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:34.418958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:34.418958+0000","last_clean_scrub_stamp":"2024-09-10T06:27:34.418958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:59.933728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:08.864372+0000","last_change":"2024-09-10T06:22:41.894504+0000","last_active":"2024-09-10T06:25:08.864372+0000","last_peered":"2024-09-10T06:25:08.864372+0000","last_clean":"2024-09-10T06:25:08.864372+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:25:08.864372+0000","last_undegraded":"2024-09-10T06:25:08.864372+0000","last_fullsized":"2024-09-10T06:25:08.864372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.265847+0000","last_change":"2024-09-10T06:27:00.265691+0000","last_active":"2024-09-10T06:27:00.265847+0000","last_peered":"2024-09-10T06:27:00.265847+0000","last_clean":"2024-09-10T06:27:00.265847+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:27:00.265847+0000","last_undegraded":"2024-09-10T06:27:00.265847+0000","last_fullsized":"2024-09-10T06:27:00.265847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.265499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:33.791297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.100568+0000","last_change":"2024-09-10T06:26:24.100296+0000","last_active":"2024-09-10T06:26:24.100568+0000","last_peered":"2024-09-10T06:26:24.100568+0000","last_clean":"2024-09-10T06:26:24.100568+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:26:24.100568+0000","last_undegraded":"2024-09-10T06:26:24.100568+0000","last_fullsized":"2024-09-10T06:26:24.100568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.100028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:50.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.731922+0000","last_change":"2024-09-10T06:26:59.731771+0000","last_active":"2024-09-10T06:26:59.731922+0000","last_peered":"2024-09-10T06:26:59.731922+0000","last_clean":"2024-09-10T06:26:59.731922+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:26:59.731922+0000","last_undegraded":"2024-09-10T06:26:59.731922+0000","last_fullsized":"2024-09-10T06:26:59.731922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.731593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:42.655477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'32","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:26.470500+0000","last_change":"2024-09-10T06:27:26.470330+0000","last_active":"2024-09-10T06:27:26.470500+0000","last_peered":"2024-09-10T06:27:26.470500+0000","last_clean":"2024-09-10T06:27:26.470500+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:27:26.470500+0000","last_undegraded":"2024-09-10T06:27:26.470500+0000","last_fullsized":"2024-09-10T06:27:26.470500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-09-10T06:27:26.470147+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-09-10T06:27:26.470147+0000","last_clean_scrub_stamp":"2024-09-10T06:27:26.470147+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:41.832598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:36.431561+0000","last_change":"2024-09-10T06:27:36.431400+0000","last_active":"2024-09-10T06:27:36.431561+0000","last_peered":"2024-09-10T06:27:36.431561+0000","last_clean":"2024-09-10T06:27:36.431561+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:27:36.431561+0000","last_undegraded":"2024-09-10T06:27:36.431561+0000","last_fullsized":"2024-09-10T06:27:36.431561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:36.431202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:36.431202+0000","last_clean_scrub_stamp":"2024-09-10T06:27:36.431202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:34.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:25:08.864319+0000","last_change":"2024-09-10T06:22:41.895177+0000","last_active":"2024-09-10T06:25:08.864319+0000","last_peered":"2024-09-10T06:25:08.864319+0000","last_clean":"2024-09-10T06:25:08.864319+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:25:08.864319+0000","last_undegraded":"2024-09-10T06:25:08.864319+0000","last_fullsized":"2024-09-10T06:25:08.864319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:22:40.829232+0000","last_clean_scrub_stamp":"2024-09-10T06:22:40.829232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.677926+0000","last_change":"2024-09-10T06:26:40.677762+0000","last_active":"2024-09-10T06:26:40.677926+0000","last_peered":"2024-09-10T06:26:40.677926+0000","last_clean":"2024-09-10T06:26:40.677926+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:26:40.677926+0000","last_undegraded":"2024-09-10T06:26:40.677926+0000","last_fullsized":"2024-09-10T06:26:40.677926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.677546+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:35.665500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.482430+0000","last_change":"2024-09-10T06:26:28.482269+0000","last_active":"2024-09-10T06:26:28.482430+0000","last_peered":"2024-09-10T06:26:28.482430+0000","last_clean":"2024-09-10T06:26:28.482430+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:26:28.482430+0000","last_undegraded":"2024-09-10T06:26:28.482430+0000","last_fullsized":"2024-09-10T06:26:28.482430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.482098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:08.791707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.690811+0000","last_change":"2024-09-10T06:27:01.690671+0000","last_active":"2024-09-10T06:27:01.690811+0000","last_peered":"2024-09-10T06:27:01.690811+0000","last_clean":"2024-09-10T06:27:01.690811+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:27:01.690811+0000","last_undegraded":"2024-09-10T06:27:01.690811+0000","last_fullsized":"2024-09-10T06:27:01.690811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.690490+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:38.401842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.507743+0000","last_change":"2024-09-10T06:27:25.507599+0000","last_active":"2024-09-10T06:27:25.507743+0000","last_peered":"2024-09-10T06:27:25.507743+0000","last_clean":"2024-09-10T06:27:25.507743+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:27:25.507743+0000","last_undegraded":"2024-09-10T06:27:25.507743+0000","last_fullsized":"2024-09-10T06:27:25.507743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:25.507393+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:25.507393+0000","last_clean_scrub_stamp":"2024-09-10T06:27:25.507393+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:47.341354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.112954+0000","last_change":"2024-09-10T06:27:10.112787+0000","last_active":"2024-09-10T06:27:10.112954+0000","last_peered":"2024-09-10T06:27:10.112954+0000","last_clean":"2024-09-10T06:27:10.112954+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:27:10.112954+0000","last_undegraded":"2024-09-10T06:27:10.112954+0000","last_fullsized":"2024-09-10T06:27:10.112954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.112602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:32.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:43.552995+0000","last_change":"2024-09-10T06:27:43.552995+0000","last_active":"2024-09-10T06:27:43.552995+0000","last_peered":"2024-09-10T06:27:43.552995+0000","last_clean":"2024-09-10T06:27:43.552995+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:27:43.552995+0000","last_undegraded":"2024-09-10T06:27:43.552995+0000","last_fullsized":"2024-09-10T06:27:43.552995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:43.552824+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:43.552824+0000","last_clean_scrub_stamp":"2024-09-10T06:27:43.552824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:34.623496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.779775+0000","last_change":"2024-09-10T06:26:43.779653+0000","last_active":"2024-09-10T06:26:43.779775+0000","last_peered":"2024-09-10T06:26:43.779775+0000","last_clean":"2024-09-10T06:26:43.779775+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:26:43.779775+0000","last_undegraded":"2024-09-10T06:26:43.779775+0000","last_fullsized":"2024-09-10T06:26:43.779775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.779476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:31.036552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.433609+0000","last_change":"2024-09-10T06:26:29.433336+0000","last_active":"2024-09-10T06:26:29.433609+0000","last_peered":"2024-09-10T06:26:29.433609+0000","last_clean":"2024-09-10T06:26:29.433609+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:26:29.433609+0000","last_undegraded":"2024-09-10T06:26:29.433609+0000","last_fullsized":"2024-09-10T06:26:29.433609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.433088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:15.744029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.839137+0000","last_change":"2024-09-10T06:26:45.838993+0000","last_active":"2024-09-10T06:26:45.839137+0000","last_peered":"2024-09-10T06:26:45.839137+0000","last_clean":"2024-09-10T06:26:45.839137+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:26:45.839137+0000","last_undegraded":"2024-09-10T06:26:45.839137+0000","last_fullsized":"2024-09-10T06:26:45.839137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.838814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:56.402021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.047162+0000","last_change":"2024-09-10T06:26:29.046913+0000","last_active":"2024-09-10T06:26:29.047162+0000","last_peered":"2024-09-10T06:26:29.047162+0000","last_clean":"2024-09-10T06:26:29.047162+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:26:29.047162+0000","last_undegraded":"2024-09-10T06:26:29.047162+0000","last_fullsized":"2024-09-10T06:26:29.047162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.046701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:29.715468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.781650+0000","last_change":"2024-09-10T06:26:44.781486+0000","last_active":"2024-09-10T06:26:44.781650+0000","last_peered":"2024-09-10T06:26:44.781650+0000","last_clean":"2024-09-10T06:26:44.781650+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:26:44.781650+0000","last_undegraded":"2024-09-10T06:26:44.781650+0000","last_fullsized":"2024-09-10T06:26:44.781650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.781299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:57.451138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.302408+0000","last_change":"2024-09-10T06:26:41.302121+0000","last_active":"2024-09-10T06:26:41.302408+0000","last_peered":"2024-09-10T06:26:41.302408+0000","last_clean":"2024-09-10T06:26:41.302408+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:26:41.302408+0000","last_undegraded":"2024-09-10T06:26:41.302408+0000","last_fullsized":"2024-09-10T06:26:41.302408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.301927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:41.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.808725+0000","last_change":"2024-09-10T06:26:46.808544+0000","last_active":"2024-09-10T06:26:46.808725+0000","last_peered":"2024-09-10T06:26:46.808725+0000","last_clean":"2024-09-10T06:26:46.808725+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:26:46.808725+0000","last_undegraded":"2024-09-10T06:26:46.808725+0000","last_fullsized":"2024-09-10T06:26:46.808725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.808370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:30.378145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.079366+0000","last_change":"2024-09-10T06:26:25.079186+0000","last_active":"2024-09-10T06:26:25.079366+0000","last_peered":"2024-09-10T06:26:25.079366+0000","last_clean":"2024-09-10T06:26:25.079366+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:26:25.079366+0000","last_undegraded":"2024-09-10T06:26:25.079366+0000","last_fullsized":"2024-09-10T06:26:25.079366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.079003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:58.821283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.891740+0000","last_change":"2024-09-10T06:26:40.891588+0000","last_active":"2024-09-10T06:26:40.891740+0000","last_peered":"2024-09-10T06:26:40.891740+0000","last_clean":"2024-09-10T06:26:40.891740+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:26:40.891740+0000","last_undegraded":"2024-09-10T06:26:40.891740+0000","last_fullsized":"2024-09-10T06:26:40.891740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.891412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:16.731907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.995214+0000","last_change":"2024-09-10T06:26:31.995009+0000","last_active":"2024-09-10T06:26:31.995214+0000","last_peered":"2024-09-10T06:26:31.995214+0000","last_clean":"2024-09-10T06:26:31.995214+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:26:31.995214+0000","last_undegraded":"2024-09-10T06:26:31.995214+0000","last_fullsized":"2024-09-10T06:26:31.995214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.994787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:49.297894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.735118+0000","last_change":"2024-09-10T06:26:42.734856+0000","last_active":"2024-09-10T06:26:42.735118+0000","last_peered":"2024-09-10T06:26:42.735118+0000","last_clean":"2024-09-10T06:26:42.735118+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:26:42.735118+0000","last_undegraded":"2024-09-10T06:26:42.735118+0000","last_fullsized":"2024-09-10T06:26:42.735118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.734628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:25.938010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.497928+0000","last_change":"2024-09-10T06:26:29.497669+0000","last_active":"2024-09-10T06:26:29.497928+0000","last_peered":"2024-09-10T06:26:29.497928+0000","last_clean":"2024-09-10T06:26:29.497928+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:26:29.497928+0000","last_undegraded":"2024-09-10T06:26:29.497928+0000","last_fullsized":"2024-09-10T06:26:29.497928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.497454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:45.426363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.888535+0000","last_change":"2024-09-10T06:26:43.888535+0000","last_active":"2024-09-10T06:26:43.888535+0000","last_peered":"2024-09-10T06:26:43.888535+0000","last_clean":"2024-09-10T06:26:43.888535+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:26:43.888535+0000","last_undegraded":"2024-09-10T06:26:43.888535+0000","last_fullsized":"2024-09-10T06:26:43.888535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.888359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:39.822929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.393901+0000","last_change":"2024-09-10T06:26:31.393760+0000","last_active":"2024-09-10T06:26:31.393901+0000","last_peered":"2024-09-10T06:26:31.393901+0000","last_clean":"2024-09-10T06:26:31.393901+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:26:31.393901+0000","last_undegraded":"2024-09-10T06:26:31.393901+0000","last_fullsized":"2024-09-10T06:26:31.393901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.393581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:26.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.725882+0000","last_change":"2024-09-10T06:26:41.725569+0000","last_active":"2024-09-10T06:26:41.725882+0000","last_peered":"2024-09-10T06:26:41.725882+0000","last_clean":"2024-09-10T06:26:41.725882+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:26:41.725882+0000","last_undegraded":"2024-09-10T06:26:41.725882+0000","last_fullsized":"2024-09-10T06:26:41.725882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.725350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:08.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.946847+0000","last_change":"2024-09-10T06:26:34.946711+0000","last_active":"2024-09-10T06:26:34.946847+0000","last_peered":"2024-09-10T06:26:34.946847+0000","last_clean":"2024-09-10T06:26:34.946847+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:26:34.946847+0000","last_undegraded":"2024-09-10T06:26:34.946847+0000","last_fullsized":"2024-09-10T06:26:34.946847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.946534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:24.024731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.735037+0000","last_change":"2024-09-10T06:26:48.734871+0000","last_active":"2024-09-10T06:26:48.735037+0000","last_peered":"2024-09-10T06:26:48.735037+0000","last_clean":"2024-09-10T06:26:48.735037+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:26:48.735037+0000","last_undegraded":"2024-09-10T06:26:48.735037+0000","last_fullsized":"2024-09-10T06:26:48.735037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.734684+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.243947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.259823+0000","last_change":"2024-09-10T06:26:42.259572+0000","last_active":"2024-09-10T06:26:42.259823+0000","last_peered":"2024-09-10T06:26:42.259823+0000","last_clean":"2024-09-10T06:26:42.259823+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:26:42.259823+0000","last_undegraded":"2024-09-10T06:26:42.259823+0000","last_fullsized":"2024-09-10T06:26:42.259823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.259331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:33.896423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.252229+0000","last_change":"2024-09-10T06:27:03.252022+0000","last_active":"2024-09-10T06:27:03.252229+0000","last_peered":"2024-09-10T06:27:03.252229+0000","last_clean":"2024-09-10T06:27:03.252229+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:27:03.252229+0000","last_undegraded":"2024-09-10T06:27:03.252229+0000","last_fullsized":"2024-09-10T06:27:03.252229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.251851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:40.452395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.928843+0000","last_change":"2024-09-10T06:26:39.928711+0000","last_active":"2024-09-10T06:26:39.928843+0000","last_peered":"2024-09-10T06:26:39.928843+0000","last_clean":"2024-09-10T06:26:39.928843+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:26:39.928843+0000","last_undegraded":"2024-09-10T06:26:39.928843+0000","last_fullsized":"2024-09-10T06:26:39.928843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.928507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:38.868895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.881242+0000","last_change":"2024-09-10T06:26:44.881074+0000","last_active":"2024-09-10T06:26:44.881242+0000","last_peered":"2024-09-10T06:26:44.881242+0000","last_clean":"2024-09-10T06:26:44.881242+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:26:44.881242+0000","last_undegraded":"2024-09-10T06:26:44.881242+0000","last_fullsized":"2024-09-10T06:26:44.881242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.880889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:04.889584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.509812+0000","last_change":"2024-09-10T06:26:30.509659+0000","last_active":"2024-09-10T06:26:30.509812+0000","last_peered":"2024-09-10T06:26:30.509812+0000","last_clean":"2024-09-10T06:26:30.509812+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:26:30.509812+0000","last_undegraded":"2024-09-10T06:26:30.509812+0000","last_fullsized":"2024-09-10T06:26:30.509812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.509470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:04.251749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.757313+0000","last_change":"2024-09-10T06:26:47.757058+0000","last_active":"2024-09-10T06:26:47.757313+0000","last_peered":"2024-09-10T06:26:47.757313+0000","last_clean":"2024-09-10T06:26:47.757313+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:26:47.757313+0000","last_undegraded":"2024-09-10T06:26:47.757313+0000","last_fullsized":"2024-09-10T06:26:47.757313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.756834+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:23.597329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.629425+0000","last_change":"2024-09-10T06:26:33.629278+0000","last_active":"2024-09-10T06:26:33.629425+0000","last_peered":"2024-09-10T06:26:33.629425+0000","last_clean":"2024-09-10T06:26:33.629425+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:26:33.629425+0000","last_undegraded":"2024-09-10T06:26:33.629425+0000","last_fullsized":"2024-09-10T06:26:33.629425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.629098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:15.221664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.753260+0000","last_change":"2024-09-10T06:26:46.753129+0000","last_active":"2024-09-10T06:26:46.753260+0000","last_peered":"2024-09-10T06:26:46.753260+0000","last_clean":"2024-09-10T06:26:46.753260+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:26:46.753260+0000","last_undegraded":"2024-09-10T06:26:46.753260+0000","last_fullsized":"2024-09-10T06:26:46.753260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.752953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:45.693341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.246133+0000","last_change":"2024-09-10T06:26:43.245879+0000","last_active":"2024-09-10T06:26:43.246133+0000","last_peered":"2024-09-10T06:26:43.246133+0000","last_clean":"2024-09-10T06:26:43.246133+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:26:43.246133+0000","last_undegraded":"2024-09-10T06:26:43.246133+0000","last_fullsized":"2024-09-10T06:26:43.246133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.245659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.348752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.746268+0000","last_change":"2024-09-10T06:26:45.746074+0000","last_active":"2024-09-10T06:26:45.746268+0000","last_peered":"2024-09-10T06:26:45.746268+0000","last_clean":"2024-09-10T06:26:45.746268+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:26:45.746268+0000","last_undegraded":"2024-09-10T06:26:45.746268+0000","last_fullsized":"2024-09-10T06:26:45.746268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.745895+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:13.731142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.219000+0000","last_change":"2024-09-10T06:26:44.218872+0000","last_active":"2024-09-10T06:26:44.219000+0000","last_peered":"2024-09-10T06:26:44.219000+0000","last_clean":"2024-09-10T06:26:44.219000+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:26:44.219000+0000","last_undegraded":"2024-09-10T06:26:44.219000+0000","last_fullsized":"2024-09-10T06:26:44.219000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.218685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:25.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.827937+0000","last_change":"2024-09-10T06:26:46.827937+0000","last_active":"2024-09-10T06:26:46.827937+0000","last_peered":"2024-09-10T06:26:46.827937+0000","last_clean":"2024-09-10T06:26:46.827937+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:26:46.827937+0000","last_undegraded":"2024-09-10T06:26:46.827937+0000","last_fullsized":"2024-09-10T06:26:46.827937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.827760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:10.751238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.549345+0000","last_change":"2024-09-10T06:26:36.549201+0000","last_active":"2024-09-10T06:26:36.549345+0000","last_peered":"2024-09-10T06:26:36.549345+0000","last_clean":"2024-09-10T06:26:36.549345+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:26:36.549345+0000","last_undegraded":"2024-09-10T06:26:36.549345+0000","last_fullsized":"2024-09-10T06:26:36.549345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.549021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:42.805736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.754846+0000","last_change":"2024-09-10T06:26:44.754694+0000","last_active":"2024-09-10T06:26:44.754846+0000","last_peered":"2024-09-10T06:26:44.754846+0000","last_clean":"2024-09-10T06:26:44.754846+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:26:44.754846+0000","last_undegraded":"2024-09-10T06:26:44.754846+0000","last_fullsized":"2024-09-10T06:26:44.754846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.754512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:05.065310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.239297+0000","last_change":"2024-09-10T06:26:45.239130+0000","last_active":"2024-09-10T06:26:45.239297+0000","last_peered":"2024-09-10T06:26:45.239297+0000","last_clean":"2024-09-10T06:26:45.239297+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:26:45.239297+0000","last_undegraded":"2024-09-10T06:26:45.239297+0000","last_fullsized":"2024-09-10T06:26:45.239297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.238956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:09.120153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.192359+0000","last_change":"2024-09-10T06:26:46.192191+0000","last_active":"2024-09-10T06:26:46.192359+0000","last_peered":"2024-09-10T06:26:46.192359+0000","last_clean":"2024-09-10T06:26:46.192359+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:26:46.192359+0000","last_undegraded":"2024-09-10T06:26:46.192359+0000","last_fullsized":"2024-09-10T06:26:46.192359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.192012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:04.479544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.752748+0000","last_change":"2024-09-10T06:26:51.752609+0000","last_active":"2024-09-10T06:26:51.752748+0000","last_peered":"2024-09-10T06:26:51.752748+0000","last_clean":"2024-09-10T06:26:51.752748+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:26:51.752748+0000","last_undegraded":"2024-09-10T06:26:51.752748+0000","last_fullsized":"2024-09-10T06:26:51.752748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.752428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:35.735944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.934803+0000","last_change":"2024-09-10T06:26:38.934649+0000","last_active":"2024-09-10T06:26:38.934803+0000","last_peered":"2024-09-10T06:26:38.934803+0000","last_clean":"2024-09-10T06:26:38.934803+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:26:38.934803+0000","last_undegraded":"2024-09-10T06:26:38.934803+0000","last_fullsized":"2024-09-10T06:26:38.934803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.934464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:06.919711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.649018+0000","last_change":"2024-09-10T06:26:52.648863+0000","last_active":"2024-09-10T06:26:52.649018+0000","last_peered":"2024-09-10T06:26:52.649018+0000","last_clean":"2024-09-10T06:26:52.649018+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:26:52.649018+0000","last_undegraded":"2024-09-10T06:26:52.649018+0000","last_fullsized":"2024-09-10T06:26:52.649018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.648684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:03.211891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640325,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":724587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673030,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44080,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327760,"statfs":{"total":96636764160,"available":96591626240,"internally_reserved":0,"allocated":425984,"data_stored":135733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:27:44.105 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:44.105 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:44.105 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:22:40.829232+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=22, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:27:44.106 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:28:04.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:28:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.238+0000 7f4cc92fc640 1 Processor -- start 2024-09-10T06:28:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.238+0000 7f4cc92fc640 1 -- start start 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.238+0000 7f4cc92fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cc412f1a0 0x7f4cc412f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc92fc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc4115530 con 0x7f4cc41162e0 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc92fc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc4116c40 con 0x7f4cc412f1a0 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc2ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cc412f1a0 0x7f4cc412f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cba7fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4cc41162e0 0x7f4cc4125480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47238/0 (socket says 172.21.15.84:47238) 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cba7fc640 1 -- 172.21.15.84:0/1819087197 learned_addr learned my addr 172.21.15.84:0/1819087197 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc2ffd640 1 -- 172.21.15.84:0/1819087197 >> v1:172.21.15.84:6789/0 conn(0x7f4cc41162e0 legacy=0x7f4cc4125480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc2ffd640 1 -- 172.21.15.84:0/1819087197 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc4073760 con 0x7f4cc412f1a0 2024-09-10T06:28:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc2ffd640 1 --2- 172.21.15.84:0/1819087197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc412f1a0 0x7f4cc412f580 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009740 tx=0x7f4cb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddecaa9241b5b9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc27fc640 1 -- 172.21.15.84:0/1819087197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb40b0070 con 0x7f4cc412f1a0 2024-09-10T06:28:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc27fc640 1 -- 172.21.15.84:0/1819087197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40ab530 con 0x7f4cc412f1a0 2024-09-10T06:28:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.242+0000 7f4cc27fc640 1 -- 172.21.15.84:0/1819087197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb40ab830 con 0x7f4cc412f1a0 2024-09-10T06:28:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/1819087197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc412f1a0 msgr2=0x7f4cc412f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/1819087197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc412f1a0 0x7f4cc412f580 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009740 tx=0x7f4cb401c370 comp rx=0 tx=0).stop 2024-09-10T06:28:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/1819087197 shutdown_connections 2024-09-10T06:28:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/1819087197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc412f1a0 0x7f4cc412f580 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/1819087197 >> 172.21.15.84:0/1819087197 conn(0x7f4cc406f380 msgr2=0x7f4cc40717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:28:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/1819087197 shutdown_connections 2024-09-10T06:28:04.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/1819087197 wait complete. 2024-09-10T06:28:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 Processor -- start 2024-09-10T06:28:04.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- start start 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4137b80 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58334/0 (socket says 172.21.15.84:58334) 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc2ffd640 1 -- 172.21.15.84:0/2974105289 learned_addr learned my addr 172.21.15.84:0/2974105289 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc2ffd640 1 -- 172.21.15.84:0/2974105289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc4134860 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc2ffd640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40ae040 tx=0x7f4cb4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb40b8020 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40b4410 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc4117320 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb40b0040 con 0x7f4cc41162e0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41329a0 con 0x7f4cc41162e0 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc4133bf0 con 0x7f4cc41162e0 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4cb40bb020 con 0x7f4cc41162e0 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 0x7f4ca403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.246+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4cb40e94a0 con 0x7f4cc41162e0 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.250+0000 7f4cba7fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 0x7f4ca403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.250+0000 7f4cba7fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 0x7f4ca403d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4cac005890 tx=0x7f4cac007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.254+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4cb40c2030 con 0x7f4cc41162e0 2024-09-10T06:28:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.418+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 --> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cc4134c00 con 0x7f4ca403b1d0 2024-09-10T06:28:04.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.446+0000 7f4cbbfff640 1 -- 172.21.15.84:0/2974105289 <== mgr.4100 v2:172.21.15.117:6824/1600442043 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665957 (secure 0 0 0) 0x7f4cc4134c00 con 0x7f4ca403b1d0 2024-09-10T06:28:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T06:28:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 msgr2=0x7f4ca403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 0x7f4ca403d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4cac005890 tx=0x7f4cac007ab0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 msgr2=0x7f4cc4132460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40ae040 tx=0x7f4cb4019110 comp rx=0 tx=0).stop 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 shutdown_connections 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7f4ca403b1d0 0x7f4ca403d690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 --2- 172.21.15.84:0/2974105289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cc41162e0 0x7f4cc4132460 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 >> 172.21.15.84:0/2974105289 conn(0x7f4cc406f380 msgr2=0x7f4cc41284c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:28:04.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 shutdown_connections 2024-09-10T06:28:04.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.454+0000 7f4cc92fc640 1 -- 172.21.15.84:0/2974105289 wait complete. 2024-09-10T06:28:04.471 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-10T06:28:03.921178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4678,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4194740,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":164992,"kb_used_data":2816,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322368,"statfs":{"total":386547056640,"available":386378104832,"internally_reserved":0,"allocated":2883584,"data_stored":1722172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005716"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.466040+0000","last_change":"2024-09-10T06:26:34.465867+0000","last_active":"2024-09-10T06:26:34.466040+0000","last_peered":"2024-09-10T06:26:34.466040+0000","last_clean":"2024-09-10T06:26:34.466040+0000","last_became_active":"2024-09-10T06:22:31.829977+0000","last_became_peered":"2024-09-10T06:22:31.829977+0000","last_unstale":"2024-09-10T06:26:34.466040+0000","last_undegraded":"2024-09-10T06:26:34.466040+0000","last_fullsized":"2024-09-10T06:26:34.466040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.465683+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.465683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:52.407098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.647059+0000","last_change":"2024-09-10T06:26:53.646909+0000","last_active":"2024-09-10T06:26:53.647059+0000","last_peered":"2024-09-10T06:26:53.647059+0000","last_clean":"2024-09-10T06:26:53.647059+0000","last_became_active":"2024-09-10T06:22:33.828886+0000","last_became_peered":"2024-09-10T06:22:33.828886+0000","last_unstale":"2024-09-10T06:26:53.647059+0000","last_undegraded":"2024-09-10T06:26:53.647059+0000","last_fullsized":"2024-09-10T06:26:53.647059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:53.646728+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.646728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:37.216502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.020076+0000","last_change":"2024-09-10T06:26:31.019911+0000","last_active":"2024-09-10T06:26:31.020076+0000","last_peered":"2024-09-10T06:26:31.020076+0000","last_clean":"2024-09-10T06:26:31.020076+0000","last_became_active":"2024-09-10T06:22:31.815213+0000","last_became_peered":"2024-09-10T06:22:31.815213+0000","last_unstale":"2024-09-10T06:26:31.020076+0000","last_undegraded":"2024-09-10T06:26:31.020076+0000","last_fullsized":"2024-09-10T06:26:31.020076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.019720+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.019720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:17.047991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.260266+0000","last_change":"2024-09-10T06:27:05.260098+0000","last_active":"2024-09-10T06:27:05.260266+0000","last_peered":"2024-09-10T06:27:05.260266+0000","last_clean":"2024-09-10T06:27:05.260266+0000","last_became_active":"2024-09-10T06:22:33.842000+0000","last_became_peered":"2024-09-10T06:22:33.842000+0000","last_unstale":"2024-09-10T06:27:05.260266+0000","last_undegraded":"2024-09-10T06:27:05.260266+0000","last_fullsized":"2024-09-10T06:27:05.260266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:05.259897+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.259897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:58.244968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.163437+0000","last_change":"2024-09-10T06:26:51.163437+0000","last_active":"2024-09-10T06:26:51.163437+0000","last_peered":"2024-09-10T06:26:51.163437+0000","last_clean":"2024-09-10T06:26:51.163437+0000","last_became_active":"2024-09-10T06:22:31.832651+0000","last_became_peered":"2024-09-10T06:22:31.832651+0000","last_unstale":"2024-09-10T06:26:51.163437+0000","last_undegraded":"2024-09-10T06:26:51.163437+0000","last_fullsized":"2024-09-10T06:26:51.163437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:51.163242+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.163242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:11.196431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.302010+0000","last_change":"2024-09-10T06:27:06.301843+0000","last_active":"2024-09-10T06:27:06.302010+0000","last_peered":"2024-09-10T06:27:06.302010+0000","last_clean":"2024-09-10T06:27:06.302010+0000","last_became_active":"2024-09-10T06:22:33.842332+0000","last_became_peered":"2024-09-10T06:22:33.842332+0000","last_unstale":"2024-09-10T06:27:06.302010+0000","last_undegraded":"2024-09-10T06:27:06.302010+0000","last_fullsized":"2024-09-10T06:27:06.302010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:06.301644+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.301644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:48.919378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.746646+0000","last_change":"2024-09-10T06:26:42.746646+0000","last_active":"2024-09-10T06:26:42.746646+0000","last_peered":"2024-09-10T06:26:42.746646+0000","last_clean":"2024-09-10T06:26:42.746646+0000","last_became_active":"2024-09-10T06:22:31.806593+0000","last_became_peered":"2024-09-10T06:22:31.806593+0000","last_unstale":"2024-09-10T06:26:42.746646+0000","last_undegraded":"2024-09-10T06:26:42.746646+0000","last_fullsized":"2024-09-10T06:26:42.746646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:42.746449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.746449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:24.690631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.807804+0000","last_change":"2024-09-10T06:26:47.807804+0000","last_active":"2024-09-10T06:26:47.807804+0000","last_peered":"2024-09-10T06:26:47.807804+0000","last_clean":"2024-09-10T06:26:47.807804+0000","last_became_active":"2024-09-10T06:23:12.852790+0000","last_became_peered":"2024-09-10T06:23:12.852790+0000","last_unstale":"2024-09-10T06:26:47.807804+0000","last_undegraded":"2024-09-10T06:26:47.807804+0000","last_fullsized":"2024-09-10T06:26:47.807804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:47.807624+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.807624+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:44.898834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.241631+0000","last_change":"2024-09-10T06:26:49.241472+0000","last_active":"2024-09-10T06:26:49.241631+0000","last_peered":"2024-09-10T06:26:49.241631+0000","last_clean":"2024-09-10T06:26:49.241631+0000","last_became_active":"2024-09-10T06:22:31.822560+0000","last_became_peered":"2024-09-10T06:22:31.822560+0000","last_unstale":"2024-09-10T06:26:49.241631+0000","last_undegraded":"2024-09-10T06:26:49.241631+0000","last_fullsized":"2024-09-10T06:26:49.241631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:49.241280+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.241280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:21.798559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.669065+0000","last_change":"2024-09-10T06:26:54.669065+0000","last_active":"2024-09-10T06:26:54.669065+0000","last_peered":"2024-09-10T06:26:54.669065+0000","last_clean":"2024-09-10T06:26:54.669065+0000","last_became_active":"2024-09-10T06:22:33.810881+0000","last_became_peered":"2024-09-10T06:22:33.810881+0000","last_unstale":"2024-09-10T06:26:54.669065+0000","last_undegraded":"2024-09-10T06:26:54.669065+0000","last_fullsized":"2024-09-10T06:26:54.669065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:54.668892+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.668892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:55.148303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.383844+0000","last_change":"2024-09-10T06:26:32.383694+0000","last_active":"2024-09-10T06:26:32.383844+0000","last_peered":"2024-09-10T06:26:32.383844+0000","last_clean":"2024-09-10T06:26:32.383844+0000","last_became_active":"2024-09-10T06:22:31.808690+0000","last_became_peered":"2024-09-10T06:22:31.808690+0000","last_unstale":"2024-09-10T06:26:32.383844+0000","last_undegraded":"2024-09-10T06:26:32.383844+0000","last_fullsized":"2024-09-10T06:26:32.383844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:32.383510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.383510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:41.546507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.392644+0000","last_change":"2024-09-10T06:27:08.392644+0000","last_active":"2024-09-10T06:27:08.392644+0000","last_peered":"2024-09-10T06:27:08.392644+0000","last_clean":"2024-09-10T06:27:08.392644+0000","last_became_active":"2024-09-10T06:22:33.829806+0000","last_became_peered":"2024-09-10T06:22:33.829806+0000","last_unstale":"2024-09-10T06:27:08.392644+0000","last_undegraded":"2024-09-10T06:27:08.392644+0000","last_fullsized":"2024-09-10T06:27:08.392644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.392426+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.392426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:06.940408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.237117+0000","last_change":"2024-09-10T06:26:48.236984+0000","last_active":"2024-09-10T06:26:48.237117+0000","last_peered":"2024-09-10T06:26:48.237117+0000","last_clean":"2024-09-10T06:26:48.237117+0000","last_became_active":"2024-09-10T06:22:31.826795+0000","last_became_peered":"2024-09-10T06:22:31.826795+0000","last_unstale":"2024-09-10T06:26:48.237117+0000","last_undegraded":"2024-09-10T06:26:48.237117+0000","last_fullsized":"2024-09-10T06:26:48.237117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:48.236809+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.236809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:50.855015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.767721+0000","last_change":"2024-09-10T06:26:50.767721+0000","last_active":"2024-09-10T06:26:50.767721+0000","last_peered":"2024-09-10T06:26:50.767721+0000","last_clean":"2024-09-10T06:26:50.767721+0000","last_became_active":"2024-09-10T06:22:33.841026+0000","last_became_peered":"2024-09-10T06:22:33.841026+0000","last_unstale":"2024-09-10T06:26:50.767721+0000","last_undegraded":"2024-09-10T06:26:50.767721+0000","last_fullsized":"2024-09-10T06:26:50.767721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:50.767440+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.767440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:05.170562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.039641+0000","last_change":"2024-09-10T06:26:30.039477+0000","last_active":"2024-09-10T06:26:30.039641+0000","last_peered":"2024-09-10T06:26:30.039641+0000","last_clean":"2024-09-10T06:26:30.039641+0000","last_became_active":"2024-09-10T06:23:12.868591+0000","last_became_peered":"2024-09-10T06:23:12.868591+0000","last_unstale":"2024-09-10T06:26:30.039641+0000","last_undegraded":"2024-09-10T06:26:30.039641+0000","last_fullsized":"2024-09-10T06:26:30.039641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:30.039298+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.039298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:00.637143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.805279+0000","last_change":"2024-09-10T06:26:49.805279+0000","last_active":"2024-09-10T06:26:49.805279+0000","last_peered":"2024-09-10T06:26:49.805279+0000","last_clean":"2024-09-10T06:26:49.805279+0000","last_became_active":"2024-09-10T06:23:12.857001+0000","last_became_peered":"2024-09-10T06:23:12.857001+0000","last_unstale":"2024-09-10T06:26:49.805279+0000","last_undegraded":"2024-09-10T06:26:49.805279+0000","last_fullsized":"2024-09-10T06:26:49.805279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:49.805098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.805098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.455068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.228333+0000","last_change":"2024-09-10T06:27:04.228183+0000","last_active":"2024-09-10T06:27:04.228333+0000","last_peered":"2024-09-10T06:27:04.228333+0000","last_clean":"2024-09-10T06:27:04.228333+0000","last_became_active":"2024-09-10T06:22:33.842383+0000","last_became_peered":"2024-09-10T06:22:33.842383+0000","last_unstale":"2024-09-10T06:27:04.228333+0000","last_undegraded":"2024-09-10T06:27:04.228333+0000","last_fullsized":"2024-09-10T06:27:04.228333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:04.227971+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.227971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:12.018865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.659108+0000","last_change":"2024-09-10T06:26:34.658943+0000","last_active":"2024-09-10T06:26:34.659108+0000","last_peered":"2024-09-10T06:26:34.659108+0000","last_clean":"2024-09-10T06:26:34.659108+0000","last_became_active":"2024-09-10T06:22:31.831508+0000","last_became_peered":"2024-09-10T06:22:31.831508+0000","last_unstale":"2024-09-10T06:26:34.659108+0000","last_undegraded":"2024-09-10T06:26:34.659108+0000","last_fullsized":"2024-09-10T06:26:34.659108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.658763+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.658763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:49.709576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.693896+0000","last_change":"2024-09-10T06:26:49.693724+0000","last_active":"2024-09-10T06:26:49.693896+0000","last_peered":"2024-09-10T06:26:49.693896+0000","last_clean":"2024-09-10T06:26:49.693896+0000","last_became_active":"2024-09-10T06:22:33.844671+0000","last_became_peered":"2024-09-10T06:22:33.844671+0000","last_unstale":"2024-09-10T06:26:49.693896+0000","last_undegraded":"2024-09-10T06:26:49.693896+0000","last_fullsized":"2024-09-10T06:26:49.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:49.693549+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.693549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:08.446456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.418405+0000","last_change":"2024-09-10T06:26:33.418172+0000","last_active":"2024-09-10T06:26:33.418405+0000","last_peered":"2024-09-10T06:26:33.418405+0000","last_clean":"2024-09-10T06:26:33.418405+0000","last_became_active":"2024-09-10T06:22:31.832231+0000","last_became_peered":"2024-09-10T06:22:31.832231+0000","last_unstale":"2024-09-10T06:26:33.418405+0000","last_undegraded":"2024-09-10T06:26:33.418405+0000","last_fullsized":"2024-09-10T06:26:33.418405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.417943+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.417943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:42.088360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.673426+0000","last_change":"2024-09-10T06:26:50.673252+0000","last_active":"2024-09-10T06:26:50.673426+0000","last_peered":"2024-09-10T06:26:50.673426+0000","last_clean":"2024-09-10T06:26:50.673426+0000","last_became_active":"2024-09-10T06:22:33.841265+0000","last_became_peered":"2024-09-10T06:22:33.841265+0000","last_unstale":"2024-09-10T06:26:50.673426+0000","last_undegraded":"2024-09-10T06:26:50.673426+0000","last_fullsized":"2024-09-10T06:26:50.673426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.673058+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.673058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:46.607628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.556239+0000","last_change":"2024-09-10T06:26:31.556091+0000","last_active":"2024-09-10T06:26:31.556239+0000","last_peered":"2024-09-10T06:26:31.556239+0000","last_clean":"2024-09-10T06:26:31.556239+0000","last_became_active":"2024-09-10T06:22:31.827585+0000","last_became_peered":"2024-09-10T06:22:31.827585+0000","last_unstale":"2024-09-10T06:26:31.556239+0000","last_undegraded":"2024-09-10T06:26:31.556239+0000","last_fullsized":"2024-09-10T06:26:31.556239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.555912+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.555912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:11.664445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.818087+0000","last_change":"2024-09-10T06:26:48.817945+0000","last_active":"2024-09-10T06:26:48.818087+0000","last_peered":"2024-09-10T06:26:48.818087+0000","last_clean":"2024-09-10T06:26:48.818087+0000","last_became_active":"2024-09-10T06:22:33.822125+0000","last_became_peered":"2024-09-10T06:22:33.822125+0000","last_unstale":"2024-09-10T06:26:48.818087+0000","last_undegraded":"2024-09-10T06:26:48.818087+0000","last_fullsized":"2024-09-10T06:26:48.818087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.817716+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.817716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:47.841366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.598753+0000","last_change":"2024-09-10T06:26:32.598629+0000","last_active":"2024-09-10T06:26:32.598753+0000","last_peered":"2024-09-10T06:26:32.598753+0000","last_clean":"2024-09-10T06:26:32.598753+0000","last_became_active":"2024-09-10T06:22:31.800343+0000","last_became_peered":"2024-09-10T06:22:31.800343+0000","last_unstale":"2024-09-10T06:26:32.598753+0000","last_undegraded":"2024-09-10T06:26:32.598753+0000","last_fullsized":"2024-09-10T06:26:32.598753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.598449+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.598449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:24.920243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'12","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.782267+0000","last_change":"2024-09-10T06:26:45.782106+0000","last_active":"2024-09-10T06:26:45.782267+0000","last_peered":"2024-09-10T06:26:45.782267+0000","last_clean":"2024-09-10T06:26:45.782267+0000","last_became_active":"2024-09-10T06:22:33.841035+0000","last_became_peered":"2024-09-10T06:22:33.841035+0000","last_unstale":"2024-09-10T06:26:45.782267+0000","last_undegraded":"2024-09-10T06:26:45.782267+0000","last_fullsized":"2024-09-10T06:26:45.782267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:45.781922+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.781922+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:14.746365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.086867+0000","last_change":"2024-09-10T06:26:28.086704+0000","last_active":"2024-09-10T06:26:28.086867+0000","last_peered":"2024-09-10T06:26:28.086867+0000","last_clean":"2024-09-10T06:26:28.086867+0000","last_became_active":"2024-09-10T06:22:31.813918+0000","last_became_peered":"2024-09-10T06:22:31.813918+0000","last_unstale":"2024-09-10T06:26:28.086867+0000","last_undegraded":"2024-09-10T06:26:28.086867+0000","last_fullsized":"2024-09-10T06:26:28.086867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.086529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.086529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:43.137342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'26","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.670428+0000","last_change":"2024-09-10T06:26:51.670280+0000","last_active":"2024-09-10T06:26:51.670428+0000","last_peered":"2024-09-10T06:26:51.670428+0000","last_clean":"2024-09-10T06:26:51.670428+0000","last_became_active":"2024-09-10T06:22:33.817580+0000","last_became_peered":"2024-09-10T06:22:33.817580+0000","last_unstale":"2024-09-10T06:26:51.670428+0000","last_undegraded":"2024-09-10T06:26:51.670428+0000","last_fullsized":"2024-09-10T06:26:51.670428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-09-10T06:26:51.670102+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.670102+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.678798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":101,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.234590+0000","last_change":"2024-09-10T06:26:47.234344+0000","last_active":"2024-09-10T06:26:47.234590+0000","last_peered":"2024-09-10T06:26:47.234590+0000","last_clean":"2024-09-10T06:26:47.234590+0000","last_became_active":"2024-09-10T06:22:31.822841+0000","last_became_peered":"2024-09-10T06:22:31.822841+0000","last_unstale":"2024-09-10T06:26:47.234590+0000","last_undegraded":"2024-09-10T06:26:47.234590+0000","last_fullsized":"2024-09-10T06:26:47.234590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:47.234129+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.234129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:14.974750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.740565+0000","last_change":"2024-09-10T06:27:22.740411+0000","last_active":"2024-09-10T06:27:22.740565+0000","last_peered":"2024-09-10T06:27:22.740565+0000","last_clean":"2024-09-10T06:27:22.740565+0000","last_became_active":"2024-09-10T06:22:41.890737+0000","last_became_peered":"2024-09-10T06:22:41.890737+0000","last_unstale":"2024-09-10T06:27:22.740565+0000","last_undegraded":"2024-09-10T06:27:22.740565+0000","last_fullsized":"2024-09-10T06:27:22.740565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-09-10T06:27:22.740209+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-09-10T06:27:22.740209+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.740209+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:01.183177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.219740+0000","last_change":"2024-09-10T06:26:57.219569+0000","last_active":"2024-09-10T06:26:57.219740+0000","last_peered":"2024-09-10T06:26:57.219740+0000","last_clean":"2024-09-10T06:26:57.219740+0000","last_became_active":"2024-09-10T06:22:33.811026+0000","last_became_peered":"2024-09-10T06:22:33.811026+0000","last_unstale":"2024-09-10T06:26:57.219740+0000","last_undegraded":"2024-09-10T06:26:57.219740+0000","last_fullsized":"2024-09-10T06:26:57.219740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:57.219347+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.219347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:08.456249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.269168+0000","last_change":"2024-09-10T06:26:36.268913+0000","last_active":"2024-09-10T06:26:36.269168+0000","last_peered":"2024-09-10T06:26:36.269168+0000","last_clean":"2024-09-10T06:26:36.269168+0000","last_became_active":"2024-09-10T06:22:31.826748+0000","last_became_peered":"2024-09-10T06:22:31.826748+0000","last_unstale":"2024-09-10T06:26:36.269168+0000","last_undegraded":"2024-09-10T06:26:36.269168+0000","last_fullsized":"2024-09-10T06:26:36.269168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:36.268668+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.268668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:50.827972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.364833+0000","last_change":"2024-09-10T06:27:16.364666+0000","last_active":"2024-09-10T06:27:16.364833+0000","last_peered":"2024-09-10T06:27:16.364833+0000","last_clean":"2024-09-10T06:27:16.364833+0000","last_became_active":"2024-09-10T06:22:35.829259+0000","last_became_peered":"2024-09-10T06:22:35.829259+0000","last_unstale":"2024-09-10T06:27:16.364833+0000","last_undegraded":"2024-09-10T06:27:16.364833+0000","last_fullsized":"2024-09-10T06:27:16.364833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.364504+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.364504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:38.523435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.480253+0000","last_change":"2024-09-10T06:27:24.480119+0000","last_active":"2024-09-10T06:27:24.480253+0000","last_peered":"2024-09-10T06:27:24.480253+0000","last_clean":"2024-09-10T06:27:24.480253+0000","last_became_active":"2024-09-10T06:22:37.859053+0000","last_became_peered":"2024-09-10T06:22:37.859053+0000","last_unstale":"2024-09-10T06:27:24.480253+0000","last_undegraded":"2024-09-10T06:27:24.480253+0000","last_fullsized":"2024-09-10T06:27:24.480253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:24.479928+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:24.479928+0000","last_clean_scrub_stamp":"2024-09-10T06:27:24.479928+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:40.202330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.813832+0000","last_change":"2024-09-10T06:27:14.813696+0000","last_active":"2024-09-10T06:27:14.813832+0000","last_peered":"2024-09-10T06:27:14.813832+0000","last_clean":"2024-09-10T06:27:14.813832+0000","last_became_active":"2024-09-10T06:22:39.873924+0000","last_became_peered":"2024-09-10T06:22:39.873924+0000","last_unstale":"2024-09-10T06:27:14.813832+0000","last_undegraded":"2024-09-10T06:27:14.813832+0000","last_fullsized":"2024-09-10T06:27:14.813832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.813484+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.813484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:20.583529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780119+0000","last_change":"2024-09-10T06:27:23.779925+0000","last_active":"2024-09-10T06:27:23.780119+0000","last_peered":"2024-09-10T06:27:23.780119+0000","last_clean":"2024-09-10T06:27:23.780119+0000","last_became_active":"2024-09-10T06:22:41.889714+0000","last_became_peered":"2024-09-10T06:22:41.889714+0000","last_unstale":"2024-09-10T06:27:23.780119+0000","last_undegraded":"2024-09-10T06:27:23.780119+0000","last_fullsized":"2024-09-10T06:27:23.780119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:23.779737+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:23.779737+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.779737+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:56.178297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'16","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.246479+0000","last_change":"2024-09-10T06:26:58.246335+0000","last_active":"2024-09-10T06:26:58.246479+0000","last_peered":"2024-09-10T06:26:58.246479+0000","last_clean":"2024-09-10T06:26:58.246479+0000","last_became_active":"2024-09-10T06:22:33.816292+0000","last_became_peered":"2024-09-10T06:22:33.816292+0000","last_unstale":"2024-09-10T06:26:58.246479+0000","last_undegraded":"2024-09-10T06:26:58.246479+0000","last_fullsized":"2024-09-10T06:26:58.246479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:58.246124+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.246124+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:23.180121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":49,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.454724+0000","last_change":"2024-09-10T06:26:28.454535+0000","last_active":"2024-09-10T06:26:28.454724+0000","last_peered":"2024-09-10T06:26:28.454724+0000","last_clean":"2024-09-10T06:26:28.454724+0000","last_became_active":"2024-09-10T06:23:12.868688+0000","last_became_peered":"2024-09-10T06:23:12.868688+0000","last_unstale":"2024-09-10T06:26:28.454724+0000","last_undegraded":"2024-09-10T06:26:28.454724+0000","last_fullsized":"2024-09-10T06:26:28.454724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:28.454354+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.454354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:21.140529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.686254+0000","last_change":"2024-09-10T06:26:58.686119+0000","last_active":"2024-09-10T06:26:58.686254+0000","last_peered":"2024-09-10T06:26:58.686254+0000","last_clean":"2024-09-10T06:26:58.686254+0000","last_became_active":"2024-09-10T06:23:12.863779+0000","last_became_peered":"2024-09-10T06:23:12.863779+0000","last_unstale":"2024-09-10T06:26:58.686254+0000","last_undegraded":"2024-09-10T06:26:58.686254+0000","last_fullsized":"2024-09-10T06:26:58.686254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:58.685947+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.685947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:42.669463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.809124+0000","last_change":"2024-09-10T06:27:08.808998+0000","last_active":"2024-09-10T06:27:08.809124+0000","last_peered":"2024-09-10T06:27:08.809124+0000","last_clean":"2024-09-10T06:27:08.809124+0000","last_became_active":"2024-09-10T06:22:37.839697+0000","last_became_peered":"2024-09-10T06:22:37.839697+0000","last_unstale":"2024-09-10T06:27:08.809124+0000","last_undegraded":"2024-09-10T06:27:08.809124+0000","last_fullsized":"2024-09-10T06:27:08.809124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:27:08.808779+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.808779+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:45.316350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.797706+0000","last_change":"2024-09-10T06:27:13.797478+0000","last_active":"2024-09-10T06:27:13.797706+0000","last_peered":"2024-09-10T06:27:13.797706+0000","last_clean":"2024-09-10T06:27:13.797706+0000","last_became_active":"2024-09-10T06:22:39.855956+0000","last_became_peered":"2024-09-10T06:22:39.855956+0000","last_unstale":"2024-09-10T06:27:13.797706+0000","last_undegraded":"2024-09-10T06:27:13.797706+0000","last_fullsized":"2024-09-10T06:27:13.797706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.797251+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:22.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.072405+0000","last_change":"2024-09-10T06:27:17.072279+0000","last_active":"2024-09-10T06:27:17.072405+0000","last_peered":"2024-09-10T06:27:17.072405+0000","last_clean":"2024-09-10T06:27:17.072405+0000","last_became_active":"2024-09-10T06:22:41.881275+0000","last_became_peered":"2024-09-10T06:22:41.881275+0000","last_unstale":"2024-09-10T06:27:17.072405+0000","last_undegraded":"2024-09-10T06:27:17.072405+0000","last_fullsized":"2024-09-10T06:27:17.072405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:27:17.072077+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.072077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:49.470636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.272323+0000","last_change":"2024-09-10T06:26:59.272162+0000","last_active":"2024-09-10T06:26:59.272323+0000","last_peered":"2024-09-10T06:26:59.272323+0000","last_clean":"2024-09-10T06:26:59.272323+0000","last_became_active":"2024-09-10T06:22:33.816595+0000","last_became_peered":"2024-09-10T06:22:33.816595+0000","last_unstale":"2024-09-10T06:26:59.272323+0000","last_undegraded":"2024-09-10T06:26:59.272323+0000","last_fullsized":"2024-09-10T06:26:59.272323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:59.271973+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.271973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:48.087167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.235278+0000","last_change":"2024-09-10T06:26:35.235143+0000","last_active":"2024-09-10T06:26:35.235278+0000","last_peered":"2024-09-10T06:26:35.235278+0000","last_clean":"2024-09-10T06:26:35.235278+0000","last_became_active":"2024-09-10T06:22:31.819890+0000","last_became_peered":"2024-09-10T06:22:31.819890+0000","last_unstale":"2024-09-10T06:26:35.235278+0000","last_undegraded":"2024-09-10T06:26:35.235278+0000","last_fullsized":"2024-09-10T06:26:35.235278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.234952+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.234952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:53.200997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.835520+0000","last_change":"2024-09-10T06:26:56.835391+0000","last_active":"2024-09-10T06:26:56.835520+0000","last_peered":"2024-09-10T06:26:56.835520+0000","last_clean":"2024-09-10T06:26:56.835520+0000","last_became_active":"2024-09-10T06:22:35.835521+0000","last_became_peered":"2024-09-10T06:22:35.835521+0000","last_unstale":"2024-09-10T06:26:56.835520+0000","last_undegraded":"2024-09-10T06:26:56.835520+0000","last_fullsized":"2024-09-10T06:26:56.835520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:56.835182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.835182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:59.591116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.969782+0000","last_change":"2024-09-10T06:27:02.969630+0000","last_active":"2024-09-10T06:27:02.969782+0000","last_peered":"2024-09-10T06:27:02.969782+0000","last_clean":"2024-09-10T06:27:02.969782+0000","last_became_active":"2024-09-10T06:22:37.829448+0000","last_became_peered":"2024-09-10T06:22:37.829448+0000","last_unstale":"2024-09-10T06:27:02.969782+0000","last_undegraded":"2024-09-10T06:27:02.969782+0000","last_fullsized":"2024-09-10T06:27:02.969782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:02.969422+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.969422+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:36.259987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":400,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:33.376496+0000","last_change":"2024-09-10T06:27:33.376321+0000","last_active":"2024-09-10T06:27:33.376496+0000","last_peered":"2024-09-10T06:27:33.376496+0000","last_clean":"2024-09-10T06:27:33.376496+0000","last_became_active":"2024-09-10T06:22:39.877192+0000","last_became_peered":"2024-09-10T06:22:39.877192+0000","last_unstale":"2024-09-10T06:27:33.376496+0000","last_undegraded":"2024-09-10T06:27:33.376496+0000","last_fullsized":"2024-09-10T06:27:33.376496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:33.376139+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:33.376139+0000","last_clean_scrub_stamp":"2024-09-10T06:27:33.376139+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.752496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.959026+0000","last_change":"2024-09-10T06:27:15.958875+0000","last_active":"2024-09-10T06:27:15.959026+0000","last_peered":"2024-09-10T06:27:15.959026+0000","last_clean":"2024-09-10T06:27:15.959026+0000","last_became_active":"2024-09-10T06:22:41.875595+0000","last_became_peered":"2024-09-10T06:22:41.875595+0000","last_unstale":"2024-09-10T06:27:15.959026+0000","last_undegraded":"2024-09-10T06:27:15.959026+0000","last_fullsized":"2024-09-10T06:27:15.959026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:15.958685+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.958685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:29.946098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'22","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.942764+0000","last_change":"2024-09-10T06:26:36.942629+0000","last_active":"2024-09-10T06:26:36.942764+0000","last_peered":"2024-09-10T06:26:36.942764+0000","last_clean":"2024-09-10T06:26:36.942764+0000","last_became_active":"2024-09-10T06:22:33.835904+0000","last_became_peered":"2024-09-10T06:22:33.835904+0000","last_unstale":"2024-09-10T06:26:36.942764+0000","last_undegraded":"2024-09-10T06:26:36.942764+0000","last_fullsized":"2024-09-10T06:26:36.942764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-09-10T06:26:36.942444+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.942444+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:24.199520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.456820+0000","last_change":"2024-09-10T06:26:23.456692+0000","last_active":"2024-09-10T06:26:23.456820+0000","last_peered":"2024-09-10T06:26:23.456820+0000","last_clean":"2024-09-10T06:26:23.456820+0000","last_became_active":"2024-09-10T06:22:31.827432+0000","last_became_peered":"2024-09-10T06:22:31.827432+0000","last_unstale":"2024-09-10T06:26:23.456820+0000","last_undegraded":"2024-09-10T06:26:23.456820+0000","last_fullsized":"2024-09-10T06:26:23.456820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.456509+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.456509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:13.569641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.410459+0000","last_change":"2024-09-10T06:27:15.410327+0000","last_active":"2024-09-10T06:27:15.410459+0000","last_peered":"2024-09-10T06:27:15.410459+0000","last_clean":"2024-09-10T06:27:15.410459+0000","last_became_active":"2024-09-10T06:22:35.825843+0000","last_became_peered":"2024-09-10T06:22:35.825843+0000","last_unstale":"2024-09-10T06:27:15.410459+0000","last_undegraded":"2024-09-10T06:27:15.410459+0000","last_fullsized":"2024-09-10T06:27:15.410459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.410128+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.410128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:40.645404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.934263+0000","last_change":"2024-09-10T06:27:03.934107+0000","last_active":"2024-09-10T06:27:03.934263+0000","last_peered":"2024-09-10T06:27:03.934263+0000","last_clean":"2024-09-10T06:27:03.934263+0000","last_became_active":"2024-09-10T06:22:37.853425+0000","last_became_peered":"2024-09-10T06:22:37.853425+0000","last_unstale":"2024-09-10T06:27:03.934263+0000","last_undegraded":"2024-09-10T06:27:03.934263+0000","last_fullsized":"2024-09-10T06:27:03.934263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:03.933915+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.933915+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:45.925845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'286","reported_seq":416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.073523+0000","last_change":"2024-09-10T06:27:11.073358+0000","last_active":"2024-09-10T06:27:11.073523+0000","last_peered":"2024-09-10T06:27:11.073523+0000","last_clean":"2024-09-10T06:27:11.073523+0000","last_became_active":"2024-09-10T06:22:39.848356+0000","last_became_peered":"2024-09-10T06:22:39.848356+0000","last_unstale":"2024-09-10T06:27:11.073523+0000","last_undegraded":"2024-09-10T06:27:11.073523+0000","last_fullsized":"2024-09-10T06:27:11.073523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.073173+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.073173+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:26.420496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.179151+0000","last_change":"2024-09-10T06:26:53.179003+0000","last_active":"2024-09-10T06:26:53.179151+0000","last_peered":"2024-09-10T06:26:53.179151+0000","last_clean":"2024-09-10T06:26:53.179151+0000","last_became_active":"2024-09-10T06:22:33.836165+0000","last_became_peered":"2024-09-10T06:22:33.836165+0000","last_unstale":"2024-09-10T06:26:53.179151+0000","last_undegraded":"2024-09-10T06:26:53.179151+0000","last_fullsized":"2024-09-10T06:26:53.179151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.178832+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.178832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:42.811475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.491722+0000","last_change":"2024-09-10T06:26:26.491509+0000","last_active":"2024-09-10T06:26:26.491722+0000","last_peered":"2024-09-10T06:26:26.491722+0000","last_clean":"2024-09-10T06:26:26.491722+0000","last_became_active":"2024-09-10T06:22:31.804279+0000","last_became_peered":"2024-09-10T06:22:31.804279+0000","last_unstale":"2024-09-10T06:26:26.491722+0000","last_undegraded":"2024-09-10T06:26:26.491722+0000","last_fullsized":"2024-09-10T06:26:26.491722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.491266+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.491266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:02.267203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.635870+0000","last_change":"2024-09-10T06:26:55.635748+0000","last_active":"2024-09-10T06:26:55.635870+0000","last_peered":"2024-09-10T06:26:55.635870+0000","last_clean":"2024-09-10T06:26:55.635870+0000","last_became_active":"2024-09-10T06:22:35.833996+0000","last_became_peered":"2024-09-10T06:22:35.833996+0000","last_unstale":"2024-09-10T06:26:55.635870+0000","last_undegraded":"2024-09-10T06:26:55.635870+0000","last_fullsized":"2024-09-10T06:26:55.635870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.635574+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.635574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:54.659225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'52","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.853113+0000","last_change":"2024-09-10T06:26:59.853113+0000","last_active":"2024-09-10T06:26:59.853113+0000","last_peered":"2024-09-10T06:26:59.853113+0000","last_clean":"2024-09-10T06:26:59.853113+0000","last_became_active":"2024-09-10T06:22:37.841668+0000","last_became_peered":"2024-09-10T06:22:37.841668+0000","last_unstale":"2024-09-10T06:26:59.853113+0000","last_undegraded":"2024-09-10T06:26:59.853113+0000","last_fullsized":"2024-09-10T06:26:59.853113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-09-10T06:26:59.852901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.852901+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:05.503788+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.142100+0000","last_change":"2024-09-10T06:27:09.141933+0000","last_active":"2024-09-10T06:27:09.142100+0000","last_peered":"2024-09-10T06:27:09.142100+0000","last_clean":"2024-09-10T06:27:09.142100+0000","last_became_active":"2024-09-10T06:22:39.848301+0000","last_became_peered":"2024-09-10T06:22:39.848301+0000","last_unstale":"2024-09-10T06:27:09.142100+0000","last_undegraded":"2024-09-10T06:27:09.142100+0000","last_fullsized":"2024-09-10T06:27:09.142100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.141754+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.141754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:21.411218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.004387+0000","last_change":"2024-09-10T06:27:13.004387+0000","last_active":"2024-09-10T06:27:13.004387+0000","last_peered":"2024-09-10T06:27:13.004387+0000","last_clean":"2024-09-10T06:27:13.004387+0000","last_became_active":"2024-09-10T06:22:41.882583+0000","last_became_peered":"2024-09-10T06:22:41.882583+0000","last_unstale":"2024-09-10T06:27:13.004387+0000","last_undegraded":"2024-09-10T06:27:13.004387+0000","last_fullsized":"2024-09-10T06:27:13.004387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:13.004209+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.004209+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:35.846831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.750907+0000","last_change":"2024-09-10T06:26:37.750761+0000","last_active":"2024-09-10T06:26:37.750907+0000","last_peered":"2024-09-10T06:26:37.750907+0000","last_clean":"2024-09-10T06:26:37.750907+0000","last_became_active":"2024-09-10T06:22:33.817150+0000","last_became_peered":"2024-09-10T06:22:33.817150+0000","last_unstale":"2024-09-10T06:26:37.750907+0000","last_undegraded":"2024-09-10T06:26:37.750907+0000","last_fullsized":"2024-09-10T06:26:37.750907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:37.750588+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.750588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:21.168972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.466097+0000","last_change":"2024-09-10T06:26:25.465949+0000","last_active":"2024-09-10T06:26:25.466097+0000","last_peered":"2024-09-10T06:26:25.466097+0000","last_clean":"2024-09-10T06:26:25.466097+0000","last_became_active":"2024-09-10T06:22:31.807102+0000","last_became_peered":"2024-09-10T06:22:31.807102+0000","last_unstale":"2024-09-10T06:26:25.466097+0000","last_undegraded":"2024-09-10T06:26:25.466097+0000","last_fullsized":"2024-09-10T06:26:25.466097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:25.465745+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.465745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:11.750138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.801096+0000","last_change":"2024-09-10T06:26:53.800884+0000","last_active":"2024-09-10T06:26:53.801096+0000","last_peered":"2024-09-10T06:26:53.801096+0000","last_clean":"2024-09-10T06:26:53.801096+0000","last_became_active":"2024-09-10T06:22:35.835470+0000","last_became_peered":"2024-09-10T06:22:35.835470+0000","last_unstale":"2024-09-10T06:26:53.801096+0000","last_undegraded":"2024-09-10T06:26:53.801096+0000","last_fullsized":"2024-09-10T06:26:53.801096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.800700+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.800700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:36.270704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.491790+0000","last_change":"2024-09-10T06:27:22.491790+0000","last_active":"2024-09-10T06:27:22.491790+0000","last_peered":"2024-09-10T06:27:22.491790+0000","last_clean":"2024-09-10T06:27:22.491790+0000","last_became_active":"2024-09-10T06:22:37.862649+0000","last_became_peered":"2024-09-10T06:22:37.862649+0000","last_unstale":"2024-09-10T06:27:22.491790+0000","last_undegraded":"2024-09-10T06:27:22.491790+0000","last_fullsized":"2024-09-10T06:27:22.491790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:22.491604+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:22.491604+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.491604+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:19.805771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.112633+0000","last_change":"2024-09-10T06:27:12.112633+0000","last_active":"2024-09-10T06:27:12.112633+0000","last_peered":"2024-09-10T06:27:12.112633+0000","last_clean":"2024-09-10T06:27:12.112633+0000","last_became_active":"2024-09-10T06:22:39.847675+0000","last_became_peered":"2024-09-10T06:22:39.847675+0000","last_unstale":"2024-09-10T06:27:12.112633+0000","last_undegraded":"2024-09-10T06:27:12.112633+0000","last_fullsized":"2024-09-10T06:27:12.112633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.112450+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.112450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:50.224384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.778437+0000","last_change":"2024-09-10T06:27:17.778437+0000","last_active":"2024-09-10T06:27:17.778437+0000","last_peered":"2024-09-10T06:27:17.778437+0000","last_clean":"2024-09-10T06:27:17.778437+0000","last_became_active":"2024-09-10T06:22:41.885166+0000","last_became_peered":"2024-09-10T06:22:41.885166+0000","last_unstale":"2024-09-10T06:27:17.778437+0000","last_undegraded":"2024-09-10T06:27:17.778437+0000","last_fullsized":"2024-09-10T06:27:17.778437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:27:17.778228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.778228+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:33.125552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.592620+0000","last_change":"2024-09-10T06:26:37.592443+0000","last_active":"2024-09-10T06:26:37.592620+0000","last_peered":"2024-09-10T06:26:37.592620+0000","last_clean":"2024-09-10T06:26:37.592620+0000","last_became_active":"2024-09-10T06:22:33.840669+0000","last_became_peered":"2024-09-10T06:22:33.840669+0000","last_unstale":"2024-09-10T06:26:37.592620+0000","last_undegraded":"2024-09-10T06:26:37.592620+0000","last_fullsized":"2024-09-10T06:26:37.592620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:37.592235+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.592235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:10.519860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.222626+0000","last_change":"2024-09-10T06:26:34.222379+0000","last_active":"2024-09-10T06:26:34.222626+0000","last_peered":"2024-09-10T06:26:34.222626+0000","last_clean":"2024-09-10T06:26:34.222626+0000","last_became_active":"2024-09-10T06:22:31.833103+0000","last_became_peered":"2024-09-10T06:22:31.833103+0000","last_unstale":"2024-09-10T06:26:34.222626+0000","last_undegraded":"2024-09-10T06:26:34.222626+0000","last_fullsized":"2024-09-10T06:26:34.222626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:34.222107+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.222107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:52.398385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.836789+0000","last_change":"2024-09-10T06:26:54.836508+0000","last_active":"2024-09-10T06:26:54.836789+0000","last_peered":"2024-09-10T06:26:54.836789+0000","last_clean":"2024-09-10T06:26:54.836789+0000","last_became_active":"2024-09-10T06:22:35.835084+0000","last_became_peered":"2024-09-10T06:22:35.835084+0000","last_unstale":"2024-09-10T06:26:54.836789+0000","last_undegraded":"2024-09-10T06:26:54.836789+0000","last_fullsized":"2024-09-10T06:26:54.836789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.836286+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.836286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:31.547637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.432564+0000","last_change":"2024-09-10T06:27:20.432564+0000","last_active":"2024-09-10T06:27:20.432564+0000","last_peered":"2024-09-10T06:27:20.432564+0000","last_clean":"2024-09-10T06:27:20.432564+0000","last_became_active":"2024-09-10T06:22:37.856710+0000","last_became_peered":"2024-09-10T06:22:37.856710+0000","last_unstale":"2024-09-10T06:27:20.432564+0000","last_undegraded":"2024-09-10T06:27:20.432564+0000","last_fullsized":"2024-09-10T06:27:20.432564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-10T06:27:20.432343+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-10T06:27:20.432343+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.432343+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:48.527923+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'286","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.141755+0000","last_change":"2024-09-10T06:27:13.141755+0000","last_active":"2024-09-10T06:27:13.141755+0000","last_peered":"2024-09-10T06:27:13.141755+0000","last_clean":"2024-09-10T06:27:13.141755+0000","last_became_active":"2024-09-10T06:22:39.847722+0000","last_became_peered":"2024-09-10T06:22:39.847722+0000","last_unstale":"2024-09-10T06:27:13.141755+0000","last_undegraded":"2024-09-10T06:27:13.141755+0000","last_fullsized":"2024-09-10T06:27:13.141755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:13.141565+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.141565+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:08.899954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.110762+0000","last_change":"2024-09-10T06:27:19.110762+0000","last_active":"2024-09-10T06:27:19.110762+0000","last_peered":"2024-09-10T06:27:19.110762+0000","last_clean":"2024-09-10T06:27:19.110762+0000","last_became_active":"2024-09-10T06:22:41.878767+0000","last_became_peered":"2024-09-10T06:22:41.878767+0000","last_unstale":"2024-09-10T06:27:19.110762+0000","last_undegraded":"2024-09-10T06:27:19.110762+0000","last_fullsized":"2024-09-10T06:27:19.110762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:19.110583+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:19.110583+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.110583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:11.937942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.631870+0000","last_change":"2024-09-10T06:26:38.631720+0000","last_active":"2024-09-10T06:26:38.631870+0000","last_peered":"2024-09-10T06:26:38.631870+0000","last_clean":"2024-09-10T06:26:38.631870+0000","last_became_active":"2024-09-10T06:22:33.821524+0000","last_became_peered":"2024-09-10T06:22:33.821524+0000","last_unstale":"2024-09-10T06:26:38.631870+0000","last_undegraded":"2024-09-10T06:26:38.631870+0000","last_fullsized":"2024-09-10T06:26:38.631870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.631513+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.631513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:27.113368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.205169+0000","last_change":"2024-09-10T06:26:33.205009+0000","last_active":"2024-09-10T06:26:33.205169+0000","last_peered":"2024-09-10T06:26:33.205169+0000","last_clean":"2024-09-10T06:26:33.205169+0000","last_became_active":"2024-09-10T06:22:31.830713+0000","last_became_peered":"2024-09-10T06:22:31.830713+0000","last_unstale":"2024-09-10T06:26:33.205169+0000","last_undegraded":"2024-09-10T06:26:33.205169+0000","last_fullsized":"2024-09-10T06:26:33.205169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:33.204830+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.204830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:06.417787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:49.807872+0000","last_change":"2024-09-10T06:26:49.807716+0000","last_active":"2024-09-10T06:26:49.807872+0000","last_peered":"2024-09-10T06:26:49.807872+0000","last_clean":"2024-09-10T06:26:49.807872+0000","last_became_active":"2024-09-10T06:22:35.835437+0000","last_became_peered":"2024-09-10T06:22:35.835437+0000","last_unstale":"2024-09-10T06:26:49.807872+0000","last_undegraded":"2024-09-10T06:26:49.807872+0000","last_fullsized":"2024-09-10T06:26:49.807872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:49.807510+0000","last_clean_scrub_stamp":"2024-09-10T06:26:49.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:23.493668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'66","reported_seq":140,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.469172+0000","last_change":"2024-09-10T06:27:21.469172+0000","last_active":"2024-09-10T06:27:21.469172+0000","last_peered":"2024-09-10T06:27:21.469172+0000","last_clean":"2024-09-10T06:27:21.469172+0000","last_became_active":"2024-09-10T06:22:37.857317+0000","last_became_peered":"2024-09-10T06:22:37.857317+0000","last_unstale":"2024-09-10T06:27:21.469172+0000","last_undegraded":"2024-09-10T06:27:21.469172+0000","last_fullsized":"2024-09-10T06:27:21.469172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-09-10T06:27:21.468908+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-09-10T06:27:21.468908+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.468908+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:39.066879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:08.147438+0000","last_change":"2024-09-10T06:27:08.147438+0000","last_active":"2024-09-10T06:27:08.147438+0000","last_peered":"2024-09-10T06:27:08.147438+0000","last_clean":"2024-09-10T06:27:08.147438+0000","last_became_active":"2024-09-10T06:22:39.862717+0000","last_became_peered":"2024-09-10T06:22:39.862717+0000","last_unstale":"2024-09-10T06:27:08.147438+0000","last_undegraded":"2024-09-10T06:27:08.147438+0000","last_fullsized":"2024-09-10T06:27:08.147438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:08.147252+0000","last_clean_scrub_stamp":"2024-09-10T06:27:08.147252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:13.917297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.163705+0000","last_change":"2024-09-10T06:27:20.163705+0000","last_active":"2024-09-10T06:27:20.163705+0000","last_peered":"2024-09-10T06:27:20.163705+0000","last_clean":"2024-09-10T06:27:20.163705+0000","last_became_active":"2024-09-10T06:22:41.861118+0000","last_became_peered":"2024-09-10T06:22:41.861118+0000","last_unstale":"2024-09-10T06:27:20.163705+0000","last_undegraded":"2024-09-10T06:27:20.163705+0000","last_fullsized":"2024-09-10T06:27:20.163705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-09-10T06:27:20.163437+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-09-10T06:27:20.163437+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.163437+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:17.246644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.681020+0000","last_change":"2024-09-10T06:26:39.680863+0000","last_active":"2024-09-10T06:26:39.681020+0000","last_peered":"2024-09-10T06:26:39.681020+0000","last_clean":"2024-09-10T06:26:39.681020+0000","last_became_active":"2024-09-10T06:22:33.823015+0000","last_became_peered":"2024-09-10T06:22:33.823015+0000","last_unstale":"2024-09-10T06:26:39.681020+0000","last_undegraded":"2024-09-10T06:26:39.681020+0000","last_fullsized":"2024-09-10T06:26:39.681020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:39.680672+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.680672+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:43.246870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.091359+0000","last_change":"2024-09-10T06:26:23.091180+0000","last_active":"2024-09-10T06:26:23.091359+0000","last_peered":"2024-09-10T06:26:23.091359+0000","last_clean":"2024-09-10T06:26:23.091359+0000","last_became_active":"2024-09-10T06:22:31.826809+0000","last_became_peered":"2024-09-10T06:22:31.826809+0000","last_unstale":"2024-09-10T06:26:23.091359+0000","last_undegraded":"2024-09-10T06:26:23.091359+0000","last_fullsized":"2024-09-10T06:26:23.091359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.091001+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.091001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:02.894224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.727201+0000","last_change":"2024-09-10T06:26:52.727049+0000","last_active":"2024-09-10T06:26:52.727201+0000","last_peered":"2024-09-10T06:26:52.727201+0000","last_clean":"2024-09-10T06:26:52.727201+0000","last_became_active":"2024-09-10T06:22:35.829908+0000","last_became_peered":"2024-09-10T06:22:35.829908+0000","last_unstale":"2024-09-10T06:26:52.727201+0000","last_undegraded":"2024-09-10T06:26:52.727201+0000","last_fullsized":"2024-09-10T06:26:52.727201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:52.726845+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.726845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.812634+0000","last_change":"2024-09-10T06:27:06.812490+0000","last_active":"2024-09-10T06:27:06.812634+0000","last_peered":"2024-09-10T06:27:06.812634+0000","last_clean":"2024-09-10T06:27:06.812634+0000","last_became_active":"2024-09-10T06:22:37.839721+0000","last_became_peered":"2024-09-10T06:22:37.839721+0000","last_unstale":"2024-09-10T06:27:06.812634+0000","last_undegraded":"2024-09-10T06:27:06.812634+0000","last_fullsized":"2024-09-10T06:27:06.812634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:06.812279+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.812279+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:02.301733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:35.419777+0000","last_change":"2024-09-10T06:27:35.419777+0000","last_active":"2024-09-10T06:27:35.419777+0000","last_peered":"2024-09-10T06:27:35.419777+0000","last_clean":"2024-09-10T06:27:35.419777+0000","last_became_active":"2024-09-10T06:22:39.876477+0000","last_became_peered":"2024-09-10T06:22:39.876477+0000","last_unstale":"2024-09-10T06:27:35.419777+0000","last_undegraded":"2024-09-10T06:27:35.419777+0000","last_fullsized":"2024-09-10T06:27:35.419777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:35.419600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:35.419600+0000","last_clean_scrub_stamp":"2024-09-10T06:27:35.419600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:56.537869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:37.461814+0000","last_change":"2024-09-10T06:27:37.461814+0000","last_active":"2024-09-10T06:27:37.461814+0000","last_peered":"2024-09-10T06:27:37.461814+0000","last_clean":"2024-09-10T06:27:37.461814+0000","last_became_active":"2024-09-10T06:22:41.888989+0000","last_became_peered":"2024-09-10T06:22:41.888989+0000","last_unstale":"2024-09-10T06:27:37.461814+0000","last_undegraded":"2024-09-10T06:27:37.461814+0000","last_fullsized":"2024-09-10T06:27:37.461814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:37.461626+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:37.461626+0000","last_clean_scrub_stamp":"2024-09-10T06:27:37.461626+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:02.340216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.209176+0000","last_change":"2024-09-10T06:26:55.209024+0000","last_active":"2024-09-10T06:26:55.209176+0000","last_peered":"2024-09-10T06:26:55.209176+0000","last_clean":"2024-09-10T06:26:55.209176+0000","last_became_active":"2024-09-10T06:22:33.836452+0000","last_became_peered":"2024-09-10T06:22:33.836452+0000","last_unstale":"2024-09-10T06:26:55.209176+0000","last_undegraded":"2024-09-10T06:26:55.209176+0000","last_fullsized":"2024-09-10T06:26:55.209176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:55.208816+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.208816+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:39.866888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.181095+0000","last_change":"2024-09-10T06:26:32.180956+0000","last_active":"2024-09-10T06:26:32.181095+0000","last_peered":"2024-09-10T06:26:32.181095+0000","last_clean":"2024-09-10T06:26:32.181095+0000","last_became_active":"2024-09-10T06:22:31.826179+0000","last_became_peered":"2024-09-10T06:22:31.826179+0000","last_unstale":"2024-09-10T06:26:32.181095+0000","last_undegraded":"2024-09-10T06:26:32.181095+0000","last_fullsized":"2024-09-10T06:26:32.181095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:32.180772+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.180772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:44.519421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.771357+0000","last_change":"2024-09-10T06:26:50.771226+0000","last_active":"2024-09-10T06:26:50.771357+0000","last_peered":"2024-09-10T06:26:50.771357+0000","last_clean":"2024-09-10T06:26:50.771357+0000","last_became_active":"2024-09-10T06:22:35.835122+0000","last_became_peered":"2024-09-10T06:22:35.835122+0000","last_unstale":"2024-09-10T06:26:50.771357+0000","last_undegraded":"2024-09-10T06:26:50.771357+0000","last_fullsized":"2024-09-10T06:26:50.771357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:50.771046+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.771046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:01.764276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.886754+0000","last_change":"2024-09-10T06:27:00.886670+0000","last_active":"2024-09-10T06:27:00.886754+0000","last_peered":"2024-09-10T06:27:00.886754+0000","last_clean":"2024-09-10T06:27:00.886754+0000","last_became_active":"2024-09-10T06:22:37.829161+0000","last_became_peered":"2024-09-10T06:22:37.829161+0000","last_unstale":"2024-09-10T06:27:00.886754+0000","last_undegraded":"2024-09-10T06:27:00.886754+0000","last_fullsized":"2024-09-10T06:27:00.886754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-09-10T06:27:00.886552+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.886552+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:20.328951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'286","reported_seq":418,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.950698+0000","last_change":"2024-09-10T06:27:06.950515+0000","last_active":"2024-09-10T06:27:06.950698+0000","last_peered":"2024-09-10T06:27:06.950698+0000","last_clean":"2024-09-10T06:27:06.950698+0000","last_became_active":"2024-09-10T06:22:39.845871+0000","last_became_peered":"2024-09-10T06:22:39.845871+0000","last_unstale":"2024-09-10T06:27:06.950698+0000","last_undegraded":"2024-09-10T06:27:06.950698+0000","last_fullsized":"2024-09-10T06:27:06.950698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:06.950332+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.950332+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:45.058450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.048195+0000","last_change":"2024-09-10T06:27:16.048195+0000","last_active":"2024-09-10T06:27:16.048195+0000","last_peered":"2024-09-10T06:27:16.048195+0000","last_clean":"2024-09-10T06:27:16.048195+0000","last_became_active":"2024-09-10T06:22:41.877109+0000","last_became_peered":"2024-09-10T06:22:41.877109+0000","last_unstale":"2024-09-10T06:27:16.048195+0000","last_undegraded":"2024-09-10T06:27:16.048195+0000","last_fullsized":"2024-09-10T06:27:16.048195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-09-10T06:27:16.048009+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.048009+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:54.490977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.678158+0000","last_change":"2024-09-10T06:26:39.678024+0000","last_active":"2024-09-10T06:26:39.678158+0000","last_peered":"2024-09-10T06:26:39.678158+0000","last_clean":"2024-09-10T06:26:39.678158+0000","last_became_active":"2024-09-10T06:22:33.844214+0000","last_became_peered":"2024-09-10T06:22:33.844214+0000","last_unstale":"2024-09-10T06:26:39.678158+0000","last_undegraded":"2024-09-10T06:26:39.678158+0000","last_fullsized":"2024-09-10T06:26:39.678158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:39.677842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.677842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:41.426578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.226344+0000","last_change":"2024-09-10T06:26:31.226136+0000","last_active":"2024-09-10T06:26:31.226344+0000","last_peered":"2024-09-10T06:26:31.226344+0000","last_clean":"2024-09-10T06:26:31.226344+0000","last_became_active":"2024-09-10T06:22:31.822531+0000","last_became_peered":"2024-09-10T06:22:31.822531+0000","last_unstale":"2024-09-10T06:26:31.226344+0000","last_undegraded":"2024-09-10T06:26:31.226344+0000","last_fullsized":"2024-09-10T06:26:31.226344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.225929+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.225929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.477037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.623077+0000","last_change":"2024-09-10T06:26:56.622943+0000","last_active":"2024-09-10T06:26:56.623077+0000","last_peered":"2024-09-10T06:26:56.623077+0000","last_clean":"2024-09-10T06:26:56.623077+0000","last_became_active":"2024-09-10T06:22:35.831935+0000","last_became_peered":"2024-09-10T06:22:35.831935+0000","last_unstale":"2024-09-10T06:26:56.623077+0000","last_undegraded":"2024-09-10T06:26:56.623077+0000","last_fullsized":"2024-09-10T06:26:56.623077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.622754+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.622754+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:30.308911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.492419+0000","last_change":"2024-09-10T06:27:23.492419+0000","last_active":"2024-09-10T06:27:23.492419+0000","last_peered":"2024-09-10T06:27:23.492419+0000","last_clean":"2024-09-10T06:27:23.492419+0000","last_became_active":"2024-09-10T06:22:37.863234+0000","last_became_peered":"2024-09-10T06:22:37.863234+0000","last_unstale":"2024-09-10T06:27:23.492419+0000","last_undegraded":"2024-09-10T06:27:23.492419+0000","last_fullsized":"2024-09-10T06:27:23.492419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:23.492227+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:23.492227+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.492227+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:30.078203+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'286","reported_seq":480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.790722+0000","last_change":"2024-09-10T06:27:11.790567+0000","last_active":"2024-09-10T06:27:11.790722+0000","last_peered":"2024-09-10T06:27:11.790722+0000","last_clean":"2024-09-10T06:27:11.790722+0000","last_became_active":"2024-09-10T06:22:39.866648+0000","last_became_peered":"2024-09-10T06:22:39.866648+0000","last_unstale":"2024-09-10T06:27:11.790722+0000","last_undegraded":"2024-09-10T06:27:11.790722+0000","last_fullsized":"2024-09-10T06:27:11.790722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:11.790389+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.790389+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:15.981073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.008058+0000","last_change":"2024-09-10T06:27:12.008058+0000","last_active":"2024-09-10T06:27:12.008058+0000","last_peered":"2024-09-10T06:27:12.008058+0000","last_clean":"2024-09-10T06:27:12.008058+0000","last_became_active":"2024-09-10T06:22:41.877242+0000","last_became_peered":"2024-09-10T06:22:41.877242+0000","last_unstale":"2024-09-10T06:27:12.008058+0000","last_undegraded":"2024-09-10T06:27:12.008058+0000","last_fullsized":"2024-09-10T06:27:12.008058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:12.007872+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.007872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:58.932903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.706591+0000","last_change":"2024-09-10T06:26:38.706449+0000","last_active":"2024-09-10T06:26:38.706591+0000","last_peered":"2024-09-10T06:26:38.706591+0000","last_clean":"2024-09-10T06:26:38.706591+0000","last_became_active":"2024-09-10T06:22:33.822442+0000","last_became_peered":"2024-09-10T06:22:33.822442+0000","last_unstale":"2024-09-10T06:26:38.706591+0000","last_undegraded":"2024-09-10T06:26:38.706591+0000","last_fullsized":"2024-09-10T06:26:38.706591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:38.706224+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.706224+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:22.987665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.163027+0000","last_change":"2024-09-10T06:26:29.162880+0000","last_active":"2024-09-10T06:26:29.163027+0000","last_peered":"2024-09-10T06:26:29.163027+0000","last_clean":"2024-09-10T06:26:29.163027+0000","last_became_active":"2024-09-10T06:22:31.829384+0000","last_became_peered":"2024-09-10T06:22:31.829384+0000","last_unstale":"2024-09-10T06:26:29.163027+0000","last_undegraded":"2024-09-10T06:26:29.163027+0000","last_fullsized":"2024-09-10T06:26:29.163027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.162701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.162701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:58.415388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.421200+0000","last_change":"2024-09-10T06:27:12.421200+0000","last_active":"2024-09-10T06:27:12.421200+0000","last_peered":"2024-09-10T06:27:12.421200+0000","last_clean":"2024-09-10T06:27:12.421200+0000","last_became_active":"2024-09-10T06:22:35.824853+0000","last_became_peered":"2024-09-10T06:22:35.824853+0000","last_unstale":"2024-09-10T06:27:12.421200+0000","last_undegraded":"2024-09-10T06:27:12.421200+0000","last_fullsized":"2024-09-10T06:27:12.421200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.421025+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.421025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:07.088348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.793831+0000","last_change":"2024-09-10T06:27:07.793669+0000","last_active":"2024-09-10T06:27:07.793831+0000","last_peered":"2024-09-10T06:27:07.793831+0000","last_clean":"2024-09-10T06:27:07.793831+0000","last_became_active":"2024-09-10T06:22:37.835317+0000","last_became_peered":"2024-09-10T06:22:37.835317+0000","last_unstale":"2024-09-10T06:27:07.793831+0000","last_undegraded":"2024-09-10T06:27:07.793831+0000","last_fullsized":"2024-09-10T06:27:07.793831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:27:07.793475+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.793475+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:45.277415+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.913742+0000","last_change":"2024-09-10T06:27:05.913496+0000","last_active":"2024-09-10T06:27:05.913742+0000","last_peered":"2024-09-10T06:27:05.913742+0000","last_clean":"2024-09-10T06:27:05.913742+0000","last_became_active":"2024-09-10T06:22:39.878156+0000","last_became_peered":"2024-09-10T06:22:39.878156+0000","last_unstale":"2024-09-10T06:27:05.913742+0000","last_undegraded":"2024-09-10T06:27:05.913742+0000","last_fullsized":"2024-09-10T06:27:05.913742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.913303+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.913303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:22.053524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.795898+0000","last_change":"2024-09-10T06:27:16.795898+0000","last_active":"2024-09-10T06:27:16.795898+0000","last_peered":"2024-09-10T06:27:16.795898+0000","last_clean":"2024-09-10T06:27:16.795898+0000","last_became_active":"2024-09-10T06:22:41.870310+0000","last_became_peered":"2024-09-10T06:22:41.870310+0000","last_unstale":"2024-09-10T06:27:16.795898+0000","last_undegraded":"2024-09-10T06:27:16.795898+0000","last_fullsized":"2024-09-10T06:27:16.795898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-09-10T06:27:16.795716+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.795716+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:39.359169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":66,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.183922+0000","last_change":"2024-09-10T06:26:52.183922+0000","last_active":"2024-09-10T06:26:52.183922+0000","last_peered":"2024-09-10T06:26:52.183922+0000","last_clean":"2024-09-10T06:26:52.183922+0000","last_became_active":"2024-09-10T06:22:33.829426+0000","last_became_peered":"2024-09-10T06:22:33.829426+0000","last_unstale":"2024-09-10T06:26:52.183922+0000","last_undegraded":"2024-09-10T06:26:52.183922+0000","last_fullsized":"2024-09-10T06:26:52.183922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.183746+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.183746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:24.557171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.430887+0000","last_change":"2024-09-10T06:26:21.430739+0000","last_active":"2024-09-10T06:26:21.430887+0000","last_peered":"2024-09-10T06:26:21.430887+0000","last_clean":"2024-09-10T06:26:21.430887+0000","last_became_active":"2024-09-10T06:22:19.009064+0000","last_became_peered":"2024-09-10T06:22:19.009064+0000","last_unstale":"2024-09-10T06:26:21.430887+0000","last_undegraded":"2024-09-10T06:26:21.430887+0000","last_fullsized":"2024-09-10T06:26:21.430887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-09-10T06:26:21.430530+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.430530+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.906584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.133425+0000","last_change":"2024-09-10T06:26:25.133287+0000","last_active":"2024-09-10T06:26:25.133425+0000","last_peered":"2024-09-10T06:26:25.133425+0000","last_clean":"2024-09-10T06:26:25.133425+0000","last_became_active":"2024-09-10T06:22:23.862099+0000","last_became_peered":"2024-09-10T06:22:23.862099+0000","last_unstale":"2024-09-10T06:26:25.133425+0000","last_undegraded":"2024-09-10T06:26:25.133425+0000","last_fullsized":"2024-09-10T06:26:25.133425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:25.133112+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.133112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:31.494004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017573599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.114495+0000","last_change":"2024-09-10T06:26:27.114356+0000","last_active":"2024-09-10T06:26:27.114495+0000","last_peered":"2024-09-10T06:26:27.114495+0000","last_clean":"2024-09-10T06:26:27.114495+0000","last_became_active":"2024-09-10T06:22:31.826767+0000","last_became_peered":"2024-09-10T06:22:31.826767+0000","last_unstale":"2024-09-10T06:26:27.114495+0000","last_undegraded":"2024-09-10T06:26:27.114495+0000","last_fullsized":"2024-09-10T06:26:27.114495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.114182+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.114182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:12.450302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.706809+0000","last_change":"2024-09-10T06:27:02.706809+0000","last_active":"2024-09-10T06:27:02.706809+0000","last_peered":"2024-09-10T06:27:02.706809+0000","last_clean":"2024-09-10T06:27:02.706809+0000","last_became_active":"2024-09-10T06:22:35.828287+0000","last_became_peered":"2024-09-10T06:22:35.828287+0000","last_unstale":"2024-09-10T06:27:02.706809+0000","last_undegraded":"2024-09-10T06:27:02.706809+0000","last_fullsized":"2024-09-10T06:27:02.706809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:02.706627+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.706627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:58.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.459814+0000","last_change":"2024-09-10T06:27:19.459814+0000","last_active":"2024-09-10T06:27:19.459814+0000","last_peered":"2024-09-10T06:27:19.459814+0000","last_clean":"2024-09-10T06:27:19.459814+0000","last_became_active":"2024-09-10T06:22:37.860224+0000","last_became_peered":"2024-09-10T06:22:37.860224+0000","last_unstale":"2024-09-10T06:27:19.459814+0000","last_undegraded":"2024-09-10T06:27:19.459814+0000","last_fullsized":"2024-09-10T06:27:19.459814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-09-10T06:27:19.459618+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-09-10T06:27:19.459618+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.459618+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:53.674058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.133402+0000","last_change":"2024-09-10T06:27:07.133402+0000","last_active":"2024-09-10T06:27:07.133402+0000","last_peered":"2024-09-10T06:27:07.133402+0000","last_clean":"2024-09-10T06:27:07.133402+0000","last_became_active":"2024-09-10T06:22:39.873898+0000","last_became_peered":"2024-09-10T06:22:39.873898+0000","last_unstale":"2024-09-10T06:27:07.133402+0000","last_undegraded":"2024-09-10T06:27:07.133402+0000","last_fullsized":"2024-09-10T06:27:07.133402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.133224+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.133224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:15.988185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'84","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.982002+0000","last_change":"2024-09-10T06:27:13.982002+0000","last_active":"2024-09-10T06:27:13.982002+0000","last_peered":"2024-09-10T06:27:13.982002+0000","last_clean":"2024-09-10T06:27:13.982002+0000","last_became_active":"2024-09-10T06:22:41.875867+0000","last_became_peered":"2024-09-10T06:22:41.875867+0000","last_unstale":"2024-09-10T06:27:13.982002+0000","last_undegraded":"2024-09-10T06:27:13.982002+0000","last_fullsized":"2024-09-10T06:27:13.982002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-09-10T06:27:13.981774+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.981774+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:13.403816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.220282+0000","last_change":"2024-09-10T06:26:54.220282+0000","last_active":"2024-09-10T06:26:54.220282+0000","last_peered":"2024-09-10T06:26:54.220282+0000","last_clean":"2024-09-10T06:26:54.220282+0000","last_became_active":"2024-09-10T06:22:33.811448+0000","last_became_peered":"2024-09-10T06:22:33.811448+0000","last_unstale":"2024-09-10T06:26:54.220282+0000","last_undegraded":"2024-09-10T06:26:54.220282+0000","last_fullsized":"2024-09-10T06:26:54.220282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:54.220103+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.220103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:38.687973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.062353+0000","last_change":"2024-09-10T06:26:23.062225+0000","last_active":"2024-09-10T06:26:23.062353+0000","last_peered":"2024-09-10T06:26:23.062353+0000","last_clean":"2024-09-10T06:26:23.062353+0000","last_became_active":"2024-09-10T06:22:23.863966+0000","last_became_peered":"2024-09-10T06:22:23.863966+0000","last_unstale":"2024-09-10T06:26:23.062353+0000","last_undegraded":"2024-09-10T06:26:23.062353+0000","last_fullsized":"2024-09-10T06:26:23.062353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:23.062051+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.062051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:53.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001287933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.133509+0000","last_change":"2024-09-10T06:26:27.133378+0000","last_active":"2024-09-10T06:26:27.133509+0000","last_peered":"2024-09-10T06:26:27.133509+0000","last_clean":"2024-09-10T06:26:27.133509+0000","last_became_active":"2024-09-10T06:22:31.811807+0000","last_became_peered":"2024-09-10T06:22:31.811807+0000","last_unstale":"2024-09-10T06:26:27.133509+0000","last_undegraded":"2024-09-10T06:26:27.133509+0000","last_fullsized":"2024-09-10T06:26:27.133509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:27.133202+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.133202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.725768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:11.373888+0000","last_change":"2024-09-10T06:27:11.373888+0000","last_active":"2024-09-10T06:27:11.373888+0000","last_peered":"2024-09-10T06:27:11.373888+0000","last_clean":"2024-09-10T06:27:11.373888+0000","last_became_active":"2024-09-10T06:22:35.826100+0000","last_became_peered":"2024-09-10T06:22:35.826100+0000","last_unstale":"2024-09-10T06:27:11.373888+0000","last_undegraded":"2024-09-10T06:27:11.373888+0000","last_fullsized":"2024-09-10T06:27:11.373888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:11.373710+0000","last_clean_scrub_stamp":"2024-09-10T06:27:11.373710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:50.802747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'295","reported_seq":522,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.787324+0000","last_change":"2024-09-10T06:27:05.787324+0000","last_active":"2024-09-10T06:27:05.787324+0000","last_peered":"2024-09-10T06:27:05.787324+0000","last_clean":"2024-09-10T06:27:05.787324+0000","last_became_active":"2024-09-10T06:22:37.853569+0000","last_became_peered":"2024-09-10T06:22:37.853569+0000","last_unstale":"2024-09-10T06:27:05.787324+0000","last_undegraded":"2024-09-10T06:27:05.787324+0000","last_fullsized":"2024-09-10T06:27:05.787324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'295","last_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_deep_scrub":"32'295","last_deep_scrub_stamp":"2024-09-10T06:27:05.787116+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.787116+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:29.185370+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:29.415683+0000","last_change":"2024-09-10T06:27:29.415683+0000","last_active":"2024-09-10T06:27:29.415683+0000","last_peered":"2024-09-10T06:27:29.415683+0000","last_clean":"2024-09-10T06:27:29.415683+0000","last_became_active":"2024-09-10T06:22:39.876926+0000","last_became_peered":"2024-09-10T06:22:39.876926+0000","last_unstale":"2024-09-10T06:27:29.415683+0000","last_undegraded":"2024-09-10T06:27:29.415683+0000","last_fullsized":"2024-09-10T06:27:29.415683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:29.415507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:29.415507+0000","last_clean_scrub_stamp":"2024-09-10T06:27:29.415507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:37.164265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.729857+0000","last_change":"2024-09-10T06:27:18.729857+0000","last_active":"2024-09-10T06:27:18.729857+0000","last_peered":"2024-09-10T06:27:18.729857+0000","last_clean":"2024-09-10T06:27:18.729857+0000","last_became_active":"2024-09-10T06:22:41.883887+0000","last_became_peered":"2024-09-10T06:22:41.883887+0000","last_unstale":"2024-09-10T06:27:18.729857+0000","last_undegraded":"2024-09-10T06:27:18.729857+0000","last_fullsized":"2024-09-10T06:27:18.729857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:18.729674+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:18.729674+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.729674+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:56.841608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.938954+0000","last_change":"2024-09-10T06:26:37.938819+0000","last_active":"2024-09-10T06:26:37.938954+0000","last_peered":"2024-09-10T06:26:37.938954+0000","last_clean":"2024-09-10T06:26:37.938954+0000","last_became_active":"2024-09-10T06:22:33.829547+0000","last_became_peered":"2024-09-10T06:22:33.829547+0000","last_unstale":"2024-09-10T06:26:37.938954+0000","last_undegraded":"2024-09-10T06:26:37.938954+0000","last_fullsized":"2024-09-10T06:26:37.938954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:37.938636+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.938636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:58.249435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.534176+0000","last_change":"2024-09-10T06:26:22.533999+0000","last_active":"2024-09-10T06:26:22.534176+0000","last_peered":"2024-09-10T06:26:22.534176+0000","last_clean":"2024-09-10T06:26:22.534176+0000","last_became_active":"2024-09-10T06:22:23.863627+0000","last_became_peered":"2024-09-10T06:22:23.863627+0000","last_unstale":"2024-09-10T06:26:22.534176+0000","last_undegraded":"2024-09-10T06:26:22.534176+0000","last_fullsized":"2024-09-10T06:26:22.534176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.533815+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.533815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:40.223076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00091760300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:32.986222+0000","last_change":"2024-09-10T06:26:32.986222+0000","last_active":"2024-09-10T06:26:32.986222+0000","last_peered":"2024-09-10T06:26:32.986222+0000","last_clean":"2024-09-10T06:26:32.986222+0000","last_became_active":"2024-09-10T06:22:31.812439+0000","last_became_peered":"2024-09-10T06:22:31.812439+0000","last_unstale":"2024-09-10T06:26:32.986222+0000","last_undegraded":"2024-09-10T06:26:32.986222+0000","last_fullsized":"2024-09-10T06:26:32.986222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:32.986038+0000","last_clean_scrub_stamp":"2024-09-10T06:26:32.986038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:36.552236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.774001+0000","last_change":"2024-09-10T06:26:51.773755+0000","last_active":"2024-09-10T06:26:51.774001+0000","last_peered":"2024-09-10T06:26:51.774001+0000","last_clean":"2024-09-10T06:26:51.774001+0000","last_became_active":"2024-09-10T06:22:35.818838+0000","last_became_peered":"2024-09-10T06:22:35.818838+0000","last_unstale":"2024-09-10T06:26:51.774001+0000","last_undegraded":"2024-09-10T06:26:51.774001+0000","last_fullsized":"2024-09-10T06:26:51.774001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:51.773529+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.773529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:00.851784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.865605+0000","last_change":"2024-09-10T06:26:57.865605+0000","last_active":"2024-09-10T06:26:57.865605+0000","last_peered":"2024-09-10T06:26:57.865605+0000","last_clean":"2024-09-10T06:26:57.865605+0000","last_became_active":"2024-09-10T06:22:37.836747+0000","last_became_peered":"2024-09-10T06:22:37.836747+0000","last_unstale":"2024-09-10T06:26:57.865605+0000","last_undegraded":"2024-09-10T06:26:57.865605+0000","last_fullsized":"2024-09-10T06:26:57.865605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-09-10T06:26:57.865375+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.865375+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:00.148660+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:05.048056+0000","last_change":"2024-09-10T06:27:05.048056+0000","last_active":"2024-09-10T06:27:05.048056+0000","last_peered":"2024-09-10T06:27:05.048056+0000","last_clean":"2024-09-10T06:27:05.048056+0000","last_became_active":"2024-09-10T06:22:39.873788+0000","last_became_peered":"2024-09-10T06:22:39.873788+0000","last_unstale":"2024-09-10T06:27:05.048056+0000","last_undegraded":"2024-09-10T06:27:05.048056+0000","last_fullsized":"2024-09-10T06:27:05.048056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:05.047881+0000","last_clean_scrub_stamp":"2024-09-10T06:27:05.047881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:09.238565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:38.486349+0000","last_change":"2024-09-10T06:27:38.486349+0000","last_active":"2024-09-10T06:27:38.486349+0000","last_peered":"2024-09-10T06:27:38.486349+0000","last_clean":"2024-09-10T06:27:38.486349+0000","last_became_active":"2024-09-10T06:22:41.892660+0000","last_became_peered":"2024-09-10T06:22:41.892660+0000","last_unstale":"2024-09-10T06:27:38.486349+0000","last_undegraded":"2024-09-10T06:27:38.486349+0000","last_fullsized":"2024-09-10T06:27:38.486349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:38.486166+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:38.486166+0000","last_clean_scrub_stamp":"2024-09-10T06:27:38.486166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:22.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'20","reported_seq":116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.937901+0000","last_change":"2024-09-10T06:26:35.937768+0000","last_active":"2024-09-10T06:26:35.937901+0000","last_peered":"2024-09-10T06:26:35.937901+0000","last_clean":"2024-09-10T06:26:35.937901+0000","last_became_active":"2024-09-10T06:22:33.843228+0000","last_became_peered":"2024-09-10T06:22:33.843228+0000","last_unstale":"2024-09-10T06:26:35.937901+0000","last_undegraded":"2024-09-10T06:26:35.937901+0000","last_fullsized":"2024-09-10T06:26:35.937901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:26:35.937562+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.937562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:19.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":102,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"32'3","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.110596+0000","last_change":"2024-09-10T06:26:24.110300+0000","last_active":"2024-09-10T06:26:24.110596+0000","last_peered":"2024-09-10T06:26:24.110596+0000","last_clean":"2024-09-10T06:26:24.110596+0000","last_became_active":"2024-09-10T06:22:23.863680+0000","last_became_peered":"2024-09-10T06:22:23.863680+0000","last_unstale":"2024-09-10T06:26:24.110596+0000","last_undegraded":"2024-09-10T06:26:24.110596+0000","last_fullsized":"2024-09-10T06:26:24.110596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:26:24.110079+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.110079+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:06.285600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021445000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:23.521768+0000","last_change":"2024-09-10T06:26:23.521588+0000","last_active":"2024-09-10T06:26:23.521768+0000","last_peered":"2024-09-10T06:26:23.521768+0000","last_clean":"2024-09-10T06:26:23.521768+0000","last_became_active":"2024-09-10T06:22:31.809806+0000","last_became_peered":"2024-09-10T06:22:31.809806+0000","last_unstale":"2024-09-10T06:26:23.521768+0000","last_undegraded":"2024-09-10T06:26:23.521768+0000","last_fullsized":"2024-09-10T06:26:23.521768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:23.521400+0000","last_clean_scrub_stamp":"2024-09-10T06:26:23.521400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.804217+0000","last_change":"2024-09-10T06:26:47.804089+0000","last_active":"2024-09-10T06:26:47.804217+0000","last_peered":"2024-09-10T06:26:47.804217+0000","last_clean":"2024-09-10T06:26:47.804217+0000","last_became_active":"2024-09-10T06:22:35.815720+0000","last_became_peered":"2024-09-10T06:22:35.815720+0000","last_unstale":"2024-09-10T06:26:47.804217+0000","last_undegraded":"2024-09-10T06:26:47.804217+0000","last_fullsized":"2024-09-10T06:26:47.804217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:47.803914+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.803914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:48.283325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.438193+0000","last_change":"2024-09-10T06:27:18.438193+0000","last_active":"2024-09-10T06:27:18.438193+0000","last_peered":"2024-09-10T06:27:18.438193+0000","last_clean":"2024-09-10T06:27:18.438193+0000","last_became_active":"2024-09-10T06:22:37.861123+0000","last_became_peered":"2024-09-10T06:22:37.861123+0000","last_unstale":"2024-09-10T06:27:18.438193+0000","last_undegraded":"2024-09-10T06:27:18.438193+0000","last_fullsized":"2024-09-10T06:27:18.438193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-09-10T06:27:18.437997+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.437997+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:56.198406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:30.399446+0000","last_change":"2024-09-10T06:27:30.399446+0000","last_active":"2024-09-10T06:27:30.399446+0000","last_peered":"2024-09-10T06:27:30.399446+0000","last_clean":"2024-09-10T06:27:30.399446+0000","last_became_active":"2024-09-10T06:22:39.876622+0000","last_became_peered":"2024-09-10T06:22:39.876622+0000","last_unstale":"2024-09-10T06:27:30.399446+0000","last_undegraded":"2024-09-10T06:27:30.399446+0000","last_fullsized":"2024-09-10T06:27:30.399446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:30.399207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:30.399207+0000","last_clean_scrub_stamp":"2024-09-10T06:27:30.399207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:58.496224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:19.691447+0000","last_change":"2024-09-10T06:27:19.691447+0000","last_active":"2024-09-10T06:27:19.691447+0000","last_peered":"2024-09-10T06:27:19.691447+0000","last_clean":"2024-09-10T06:27:19.691447+0000","last_became_active":"2024-09-10T06:22:41.889962+0000","last_became_peered":"2024-09-10T06:22:41.889962+0000","last_unstale":"2024-09-10T06:27:19.691447+0000","last_undegraded":"2024-09-10T06:27:19.691447+0000","last_fullsized":"2024-09-10T06:27:19.691447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:19.691241+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:19.691241+0000","last_clean_scrub_stamp":"2024-09-10T06:27:19.691241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:15.449630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.689351+0000","last_change":"2024-09-10T06:26:35.689163+0000","last_active":"2024-09-10T06:26:35.689351+0000","last_peered":"2024-09-10T06:26:35.689351+0000","last_clean":"2024-09-10T06:26:35.689351+0000","last_became_active":"2024-09-10T06:22:33.828574+0000","last_became_peered":"2024-09-10T06:22:33.828574+0000","last_unstale":"2024-09-10T06:26:35.689351+0000","last_undegraded":"2024-09-10T06:26:35.689351+0000","last_fullsized":"2024-09-10T06:26:35.689351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:35.688987+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.688987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:31.604105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.490317+0000","last_change":"2024-09-10T06:26:24.490106+0000","last_active":"2024-09-10T06:26:24.490317+0000","last_peered":"2024-09-10T06:26:24.490317+0000","last_clean":"2024-09-10T06:26:24.490317+0000","last_became_active":"2024-09-10T06:22:31.809642+0000","last_became_peered":"2024-09-10T06:22:31.809642+0000","last_unstale":"2024-09-10T06:26:24.490317+0000","last_undegraded":"2024-09-10T06:26:24.490317+0000","last_fullsized":"2024-09-10T06:26:24.490317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:24.489901+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.489901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:12.908340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.051982+0000","last_change":"2024-09-10T06:26:22.051863+0000","last_active":"2024-09-10T06:26:22.051982+0000","last_peered":"2024-09-10T06:26:22.051982+0000","last_clean":"2024-09-10T06:26:22.051982+0000","last_became_active":"2024-09-10T06:22:23.862390+0000","last_became_peered":"2024-09-10T06:22:23.862390+0000","last_unstale":"2024-09-10T06:26:22.051982+0000","last_undegraded":"2024-09-10T06:26:22.051982+0000","last_fullsized":"2024-09-10T06:26:22.051982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.051670+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.051670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:16.319555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001139754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.777642+0000","last_change":"2024-09-10T06:26:52.777642+0000","last_active":"2024-09-10T06:26:52.777642+0000","last_peered":"2024-09-10T06:26:52.777642+0000","last_clean":"2024-09-10T06:26:52.777642+0000","last_became_active":"2024-09-10T06:22:35.822436+0000","last_became_peered":"2024-09-10T06:22:35.822436+0000","last_unstale":"2024-09-10T06:26:52.777642+0000","last_undegraded":"2024-09-10T06:26:52.777642+0000","last_fullsized":"2024-09-10T06:26:52.777642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:52.777465+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.777465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:35.701349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'78","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.890446+0000","last_change":"2024-09-10T06:26:57.890446+0000","last_active":"2024-09-10T06:26:57.890446+0000","last_peered":"2024-09-10T06:26:57.890446+0000","last_clean":"2024-09-10T06:26:57.890446+0000","last_became_active":"2024-09-10T06:22:37.853747+0000","last_became_peered":"2024-09-10T06:22:37.853747+0000","last_unstale":"2024-09-10T06:26:57.890446+0000","last_undegraded":"2024-09-10T06:26:57.890446+0000","last_fullsized":"2024-09-10T06:26:57.890446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-09-10T06:26:57.890180+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.890180+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:20.654790+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.912572+0000","last_change":"2024-09-10T06:27:04.912572+0000","last_active":"2024-09-10T06:27:04.912572+0000","last_peered":"2024-09-10T06:27:04.912572+0000","last_clean":"2024-09-10T06:27:04.912572+0000","last_became_active":"2024-09-10T06:22:39.845206+0000","last_became_peered":"2024-09-10T06:22:39.845206+0000","last_unstale":"2024-09-10T06:27:04.912572+0000","last_undegraded":"2024-09-10T06:27:04.912572+0000","last_fullsized":"2024-09-10T06:27:04.912572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:04.912401+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.912401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:17.835171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:22.161827+0000","last_change":"2024-09-10T06:27:22.161827+0000","last_active":"2024-09-10T06:27:22.161827+0000","last_peered":"2024-09-10T06:27:22.161827+0000","last_clean":"2024-09-10T06:27:22.161827+0000","last_became_active":"2024-09-10T06:22:41.874190+0000","last_became_peered":"2024-09-10T06:22:41.874190+0000","last_unstale":"2024-09-10T06:27:22.161827+0000","last_undegraded":"2024-09-10T06:27:22.161827+0000","last_fullsized":"2024-09-10T06:27:22.161827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-09-10T06:27:22.161636+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-09-10T06:27:22.161636+0000","last_clean_scrub_stamp":"2024-09-10T06:27:22.161636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:05.740437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.722988+0000","last_change":"2024-09-10T06:26:36.722846+0000","last_active":"2024-09-10T06:26:36.722988+0000","last_peered":"2024-09-10T06:26:36.722988+0000","last_clean":"2024-09-10T06:26:36.722988+0000","last_became_active":"2024-09-10T06:22:33.823955+0000","last_became_peered":"2024-09-10T06:22:33.823955+0000","last_unstale":"2024-09-10T06:26:36.722988+0000","last_undegraded":"2024-09-10T06:26:36.722988+0000","last_fullsized":"2024-09-10T06:26:36.722988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:36.722678+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.722678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:48.489772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.119809+0000","last_change":"2024-09-10T06:26:26.119665+0000","last_active":"2024-09-10T06:26:26.119809+0000","last_peered":"2024-09-10T06:26:26.119809+0000","last_clean":"2024-09-10T06:26:26.119809+0000","last_became_active":"2024-09-10T06:22:31.811049+0000","last_became_peered":"2024-09-10T06:22:31.811049+0000","last_unstale":"2024-09-10T06:26:26.119809+0000","last_undegraded":"2024-09-10T06:26:26.119809+0000","last_fullsized":"2024-09-10T06:26:26.119809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.119470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.119470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:37.159096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.160188+0000","last_change":"2024-09-10T06:26:26.160035+0000","last_active":"2024-09-10T06:26:26.160188+0000","last_peered":"2024-09-10T06:26:26.160188+0000","last_clean":"2024-09-10T06:26:26.160188+0000","last_became_active":"2024-09-10T06:22:23.865665+0000","last_became_peered":"2024-09-10T06:22:23.865665+0000","last_unstale":"2024-09-10T06:26:26.160188+0000","last_undegraded":"2024-09-10T06:26:26.160188+0000","last_fullsized":"2024-09-10T06:26:26.160188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.159855+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.159855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:31.433358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022838580000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"32'2","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.403837+0000","last_change":"2024-09-10T06:27:10.403837+0000","last_active":"2024-09-10T06:27:10.403837+0000","last_peered":"2024-09-10T06:27:10.403837+0000","last_clean":"2024-09-10T06:27:10.403837+0000","last_became_active":"2024-09-10T06:23:12.861009+0000","last_became_peered":"2024-09-10T06:23:12.861009+0000","last_unstale":"2024-09-10T06:27:10.403837+0000","last_undegraded":"2024-09-10T06:27:10.403837+0000","last_fullsized":"2024-09-10T06:27:10.403837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:10.403652+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.403652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:32.480460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'23","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.796424+0000","last_change":"2024-09-10T06:27:04.796424+0000","last_active":"2024-09-10T06:27:04.796424+0000","last_peered":"2024-09-10T06:27:04.796424+0000","last_clean":"2024-09-10T06:27:04.796424+0000","last_became_active":"2024-09-10T06:22:37.854152+0000","last_became_peered":"2024-09-10T06:22:37.854152+0000","last_unstale":"2024-09-10T06:27:04.796424+0000","last_undegraded":"2024-09-10T06:27:04.796424+0000","last_fullsized":"2024-09-10T06:27:04.796424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-09-10T06:27:04.796219+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.796219+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:27.560828+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'286","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.790398+0000","last_change":"2024-09-10T06:27:10.790398+0000","last_active":"2024-09-10T06:27:10.790398+0000","last_peered":"2024-09-10T06:27:10.790398+0000","last_clean":"2024-09-10T06:27:10.790398+0000","last_became_active":"2024-09-10T06:22:39.860603+0000","last_became_peered":"2024-09-10T06:22:39.860603+0000","last_unstale":"2024-09-10T06:27:10.790398+0000","last_undegraded":"2024-09-10T06:27:10.790398+0000","last_fullsized":"2024-09-10T06:27:10.790398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.790197+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.790197+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:52.737759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:39.500049+0000","last_change":"2024-09-10T06:27:39.500049+0000","last_active":"2024-09-10T06:27:39.500049+0000","last_peered":"2024-09-10T06:27:39.500049+0000","last_clean":"2024-09-10T06:27:39.500049+0000","last_became_active":"2024-09-10T06:22:41.893575+0000","last_became_peered":"2024-09-10T06:22:41.893575+0000","last_unstale":"2024-09-10T06:27:39.500049+0000","last_undegraded":"2024-09-10T06:27:39.500049+0000","last_fullsized":"2024-09-10T06:27:39.500049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:27:39.499865+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:27:39.499865+0000","last_clean_scrub_stamp":"2024-09-10T06:27:39.499865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:36.600493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:50.209654+0000","last_change":"2024-09-10T06:26:50.209654+0000","last_active":"2024-09-10T06:26:50.209654+0000","last_peered":"2024-09-10T06:26:50.209654+0000","last_clean":"2024-09-10T06:26:50.209654+0000","last_became_active":"2024-09-10T06:22:33.834943+0000","last_became_peered":"2024-09-10T06:22:33.834943+0000","last_unstale":"2024-09-10T06:26:50.209654+0000","last_undegraded":"2024-09-10T06:26:50.209654+0000","last_fullsized":"2024-09-10T06:26:50.209654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:50.209478+0000","last_clean_scrub_stamp":"2024-09-10T06:26:50.209478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:06.513527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.188162+0000","last_change":"2024-09-10T06:26:30.188003+0000","last_active":"2024-09-10T06:26:30.188162+0000","last_peered":"2024-09-10T06:26:30.188162+0000","last_clean":"2024-09-10T06:26:30.188162+0000","last_became_active":"2024-09-10T06:22:31.818975+0000","last_became_peered":"2024-09-10T06:22:31.818975+0000","last_unstale":"2024-09-10T06:26:30.188162+0000","last_undegraded":"2024-09-10T06:26:30.188162+0000","last_fullsized":"2024-09-10T06:26:30.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.187831+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.187831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:12.704769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:21.007778+0000","last_change":"2024-09-10T06:26:21.007725+0000","last_active":"2024-09-10T06:26:21.007778+0000","last_peered":"2024-09-10T06:26:21.007778+0000","last_clean":"2024-09-10T06:26:21.007778+0000","last_became_active":"2024-09-10T06:22:23.864082+0000","last_became_peered":"2024-09-10T06:22:23.864082+0000","last_unstale":"2024-09-10T06:26:21.007778+0000","last_undegraded":"2024-09-10T06:26:21.007778+0000","last_fullsized":"2024-09-10T06:26:21.007778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:21.007653+0000","last_clean_scrub_stamp":"2024-09-10T06:26:21.007653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:45.011060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092105300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.355791+0000","last_change":"2024-09-10T06:27:09.355791+0000","last_active":"2024-09-10T06:27:09.355791+0000","last_peered":"2024-09-10T06:27:09.355791+0000","last_clean":"2024-09-10T06:27:09.355791+0000","last_became_active":"2024-09-10T06:22:35.817782+0000","last_became_peered":"2024-09-10T06:22:35.817782+0000","last_unstale":"2024-09-10T06:27:09.355791+0000","last_undegraded":"2024-09-10T06:27:09.355791+0000","last_fullsized":"2024-09-10T06:27:09.355791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.355613+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.355613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:07.390539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:17.420797+0000","last_change":"2024-09-10T06:27:17.420797+0000","last_active":"2024-09-10T06:27:17.420797+0000","last_peered":"2024-09-10T06:27:17.420797+0000","last_clean":"2024-09-10T06:27:17.420797+0000","last_became_active":"2024-09-10T06:22:37.862180+0000","last_became_peered":"2024-09-10T06:22:37.862180+0000","last_unstale":"2024-09-10T06:27:17.420797+0000","last_undegraded":"2024-09-10T06:27:17.420797+0000","last_fullsized":"2024-09-10T06:27:17.420797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:17.420603+0000","last_clean_scrub_stamp":"2024-09-10T06:27:17.420603+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:02.195942+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'286","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:04.048731+0000","last_change":"2024-09-10T06:27:04.048731+0000","last_active":"2024-09-10T06:27:04.048731+0000","last_peered":"2024-09-10T06:27:04.048731+0000","last_clean":"2024-09-10T06:27:04.048731+0000","last_became_active":"2024-09-10T06:22:39.848267+0000","last_became_peered":"2024-09-10T06:22:39.848267+0000","last_unstale":"2024-09-10T06:27:04.048731+0000","last_undegraded":"2024-09-10T06:27:04.048731+0000","last_fullsized":"2024-09-10T06:27:04.048731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:04.048546+0000","last_clean_scrub_stamp":"2024-09-10T06:27:04.048546+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:45.996107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:20.664065+0000","last_change":"2024-09-10T06:27:20.664065+0000","last_active":"2024-09-10T06:27:20.664065+0000","last_peered":"2024-09-10T06:27:20.664065+0000","last_clean":"2024-09-10T06:27:20.664065+0000","last_became_active":"2024-09-10T06:22:41.889927+0000","last_became_peered":"2024-09-10T06:22:41.889927+0000","last_unstale":"2024-09-10T06:27:20.664065+0000","last_undegraded":"2024-09-10T06:27:20.664065+0000","last_fullsized":"2024-09-10T06:27:20.664065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-09-10T06:27:20.663869+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-09-10T06:27:20.663869+0000","last_clean_scrub_stamp":"2024-09-10T06:27:20.663869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:20.440525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:35.502161+0000","last_change":"2024-09-10T06:26:35.501999+0000","last_active":"2024-09-10T06:26:35.502161+0000","last_peered":"2024-09-10T06:26:35.502161+0000","last_clean":"2024-09-10T06:26:35.502161+0000","last_became_active":"2024-09-10T06:22:33.835510+0000","last_became_peered":"2024-09-10T06:22:33.835510+0000","last_unstale":"2024-09-10T06:26:35.502161+0000","last_undegraded":"2024-09-10T06:26:35.502161+0000","last_fullsized":"2024-09-10T06:26:35.502161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:35.501822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.501822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:29.856717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:22.433328+0000","last_change":"2024-09-10T06:26:22.433192+0000","last_active":"2024-09-10T06:26:22.433328+0000","last_peered":"2024-09-10T06:26:22.433328+0000","last_clean":"2024-09-10T06:26:22.433328+0000","last_became_active":"2024-09-10T06:22:31.814022+0000","last_became_peered":"2024-09-10T06:22:31.814022+0000","last_unstale":"2024-09-10T06:26:22.433328+0000","last_undegraded":"2024-09-10T06:26:22.433328+0000","last_fullsized":"2024-09-10T06:26:22.433328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.433009+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.433009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:03.297315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.163161+0000","last_change":"2024-09-10T06:26:28.163027+0000","last_active":"2024-09-10T06:26:28.163161+0000","last_peered":"2024-09-10T06:26:28.163161+0000","last_clean":"2024-09-10T06:26:28.163161+0000","last_became_active":"2024-09-10T06:22:24.254085+0000","last_became_peered":"2024-09-10T06:22:24.254085+0000","last_unstale":"2024-09-10T06:26:28.163161+0000","last_undegraded":"2024-09-10T06:26:28.163161+0000","last_fullsized":"2024-09-10T06:26:28.163161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:28.162858+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.162858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:23.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025254370000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.345259+0000","last_change":"2024-09-10T06:27:07.345259+0000","last_active":"2024-09-10T06:27:07.345259+0000","last_peered":"2024-09-10T06:27:07.345259+0000","last_clean":"2024-09-10T06:27:07.345259+0000","last_became_active":"2024-09-10T06:22:35.817785+0000","last_became_peered":"2024-09-10T06:22:35.817785+0000","last_unstale":"2024-09-10T06:27:07.345259+0000","last_undegraded":"2024-09-10T06:27:07.345259+0000","last_fullsized":"2024-09-10T06:27:07.345259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.345085+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.345085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:01.226244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'99","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.822092+0000","last_change":"2024-09-10T06:26:58.822092+0000","last_active":"2024-09-10T06:26:58.822092+0000","last_peered":"2024-09-10T06:26:58.822092+0000","last_clean":"2024-09-10T06:26:58.822092+0000","last_became_active":"2024-09-10T06:22:37.853493+0000","last_became_peered":"2024-09-10T06:22:37.853493+0000","last_unstale":"2024-09-10T06:26:58.822092+0000","last_undegraded":"2024-09-10T06:26:58.822092+0000","last_fullsized":"2024-09-10T06:26:58.822092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'99","last_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_deep_scrub":"32'99","last_deep_scrub_stamp":"2024-09-10T06:26:58.821871+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.821871+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:30.069598+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:06.089281+0000","last_change":"2024-09-10T06:27:06.089281+0000","last_active":"2024-09-10T06:27:06.089281+0000","last_peered":"2024-09-10T06:27:06.089281+0000","last_clean":"2024-09-10T06:27:06.089281+0000","last_became_active":"2024-09-10T06:22:39.862887+0000","last_became_peered":"2024-09-10T06:22:39.862887+0000","last_unstale":"2024-09-10T06:27:06.089281+0000","last_undegraded":"2024-09-10T06:27:06.089281+0000","last_fullsized":"2024-09-10T06:27:06.089281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:06.089099+0000","last_clean_scrub_stamp":"2024-09-10T06:27:06.089099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:07.920671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.993365+0000","last_change":"2024-09-10T06:27:14.993365+0000","last_active":"2024-09-10T06:27:14.993365+0000","last_peered":"2024-09-10T06:27:14.993365+0000","last_clean":"2024-09-10T06:27:14.993365+0000","last_became_active":"2024-09-10T06:22:41.880192+0000","last_became_peered":"2024-09-10T06:22:41.880192+0000","last_unstale":"2024-09-10T06:27:14.993365+0000","last_undegraded":"2024-09-10T06:27:14.993365+0000","last_fullsized":"2024-09-10T06:27:14.993365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.993162+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.993162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:56.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:16.936482+0000","last_change":"2024-09-10T06:27:16.936482+0000","last_active":"2024-09-10T06:27:16.936482+0000","last_peered":"2024-09-10T06:27:16.936482+0000","last_clean":"2024-09-10T06:27:16.936482+0000","last_became_active":"2024-09-10T06:22:41.875693+0000","last_became_peered":"2024-09-10T06:22:41.875693+0000","last_unstale":"2024-09-10T06:27:16.936482+0000","last_undegraded":"2024-09-10T06:27:16.936482+0000","last_fullsized":"2024-09-10T06:27:16.936482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:16.936302+0000","last_clean_scrub_stamp":"2024-09-10T06:27:16.936302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:29.989302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.698416+0000","last_change":"2024-09-10T06:26:41.698211+0000","last_active":"2024-09-10T06:26:41.698416+0000","last_peered":"2024-09-10T06:26:41.698416+0000","last_clean":"2024-09-10T06:26:41.698416+0000","last_became_active":"2024-09-10T06:22:33.835293+0000","last_became_peered":"2024-09-10T06:22:33.835293+0000","last_unstale":"2024-09-10T06:26:41.698416+0000","last_undegraded":"2024-09-10T06:26:41.698416+0000","last_fullsized":"2024-09-10T06:26:41.698416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.698029+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.698029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.247060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:37.306906+0000","last_change":"2024-09-10T06:26:37.306783+0000","last_active":"2024-09-10T06:26:37.306906+0000","last_peered":"2024-09-10T06:26:37.306906+0000","last_clean":"2024-09-10T06:26:37.306906+0000","last_became_active":"2024-09-10T06:22:31.826118+0000","last_became_peered":"2024-09-10T06:22:31.826118+0000","last_unstale":"2024-09-10T06:26:37.306906+0000","last_undegraded":"2024-09-10T06:26:37.306906+0000","last_fullsized":"2024-09-10T06:26:37.306906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.306607+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.306607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:41.035747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:57.651045+0000","last_change":"2024-09-10T06:26:57.650913+0000","last_active":"2024-09-10T06:26:57.651045+0000","last_peered":"2024-09-10T06:26:57.651045+0000","last_clean":"2024-09-10T06:26:57.651045+0000","last_became_active":"2024-09-10T06:22:35.832547+0000","last_became_peered":"2024-09-10T06:22:35.832547+0000","last_unstale":"2024-09-10T06:26:57.651045+0000","last_undegraded":"2024-09-10T06:26:57.651045+0000","last_fullsized":"2024-09-10T06:26:57.651045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:57.650735+0000","last_clean_scrub_stamp":"2024-09-10T06:26:57.650735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:08.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:32.375155+0000","last_change":"2024-09-10T06:27:32.375155+0000","last_active":"2024-09-10T06:27:32.375155+0000","last_peered":"2024-09-10T06:27:32.375155+0000","last_clean":"2024-09-10T06:27:32.375155+0000","last_became_active":"2024-09-10T06:22:37.852975+0000","last_became_peered":"2024-09-10T06:22:37.852975+0000","last_unstale":"2024-09-10T06:27:32.375155+0000","last_undegraded":"2024-09-10T06:27:32.375155+0000","last_fullsized":"2024-09-10T06:27:32.375155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:32.374922+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:32.374922+0000","last_clean_scrub_stamp":"2024-09-10T06:27:32.374922+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:05.701290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:31.385277+0000","last_change":"2024-09-10T06:27:31.385277+0000","last_active":"2024-09-10T06:27:31.385277+0000","last_peered":"2024-09-10T06:27:31.385277+0000","last_clean":"2024-09-10T06:27:31.385277+0000","last_became_active":"2024-09-10T06:22:39.878126+0000","last_became_peered":"2024-09-10T06:22:39.878126+0000","last_unstale":"2024-09-10T06:27:31.385277+0000","last_undegraded":"2024-09-10T06:27:31.385277+0000","last_fullsized":"2024-09-10T06:27:31.385277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:31.385092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:31.385092+0000","last_clean_scrub_stamp":"2024-09-10T06:27:31.385092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:43.558550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.118082+0000","last_change":"2024-09-10T06:27:23.118082+0000","last_active":"2024-09-10T06:27:23.118082+0000","last_peered":"2024-09-10T06:27:23.118082+0000","last_clean":"2024-09-10T06:27:23.118082+0000","last_became_active":"2024-09-10T06:22:41.861251+0000","last_became_peered":"2024-09-10T06:22:41.861251+0000","last_unstale":"2024-09-10T06:27:23.118082+0000","last_undegraded":"2024-09-10T06:27:23.118082+0000","last_fullsized":"2024-09-10T06:27:23.118082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:23.117913+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:23.117913+0000","last_clean_scrub_stamp":"2024-09-10T06:27:23.117913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:32.325145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.686921+0000","last_change":"2024-09-10T06:26:40.686734+0000","last_active":"2024-09-10T06:26:40.686921+0000","last_peered":"2024-09-10T06:26:40.686921+0000","last_clean":"2024-09-10T06:26:40.686921+0000","last_became_active":"2024-09-10T06:22:33.823505+0000","last_became_peered":"2024-09-10T06:22:33.823505+0000","last_unstale":"2024-09-10T06:26:40.686921+0000","last_undegraded":"2024-09-10T06:26:40.686921+0000","last_fullsized":"2024-09-10T06:26:40.686921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.686561+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.686561+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:13.693128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.467865+0000","last_change":"2024-09-10T06:26:27.467698+0000","last_active":"2024-09-10T06:26:27.467865+0000","last_peered":"2024-09-10T06:26:27.467865+0000","last_clean":"2024-09-10T06:26:27.467865+0000","last_became_active":"2024-09-10T06:22:31.833996+0000","last_became_peered":"2024-09-10T06:22:31.833996+0000","last_unstale":"2024-09-10T06:26:27.467865+0000","last_undegraded":"2024-09-10T06:26:27.467865+0000","last_fullsized":"2024-09-10T06:26:27.467865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:27.467505+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.467505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:10.628970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.402798+0000","last_change":"2024-09-10T06:27:14.402653+0000","last_active":"2024-09-10T06:27:14.402798+0000","last_peered":"2024-09-10T06:27:14.402798+0000","last_clean":"2024-09-10T06:27:14.402798+0000","last_became_active":"2024-09-10T06:23:12.866570+0000","last_became_peered":"2024-09-10T06:23:12.866570+0000","last_unstale":"2024-09-10T06:27:14.402798+0000","last_undegraded":"2024-09-10T06:27:14.402798+0000","last_fullsized":"2024-09-10T06:27:14.402798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.402479+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.402479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:30.712632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.999318+0000","last_change":"2024-09-10T06:27:02.999232+0000","last_active":"2024-09-10T06:27:02.999318+0000","last_peered":"2024-09-10T06:27:02.999318+0000","last_clean":"2024-09-10T06:27:02.999318+0000","last_became_active":"2024-09-10T06:22:37.830126+0000","last_became_peered":"2024-09-10T06:22:37.830126+0000","last_unstale":"2024-09-10T06:27:02.999318+0000","last_undegraded":"2024-09-10T06:27:02.999318+0000","last_fullsized":"2024-09-10T06:27:02.999318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:02.999134+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.999134+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:14.858999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.001609+0000","last_change":"2024-09-10T06:27:09.001426+0000","last_active":"2024-09-10T06:27:09.001609+0000","last_peered":"2024-09-10T06:27:09.001609+0000","last_clean":"2024-09-10T06:27:09.001609+0000","last_became_active":"2024-09-10T06:22:39.847608+0000","last_became_peered":"2024-09-10T06:22:39.847608+0000","last_unstale":"2024-09-10T06:27:09.001609+0000","last_undegraded":"2024-09-10T06:27:09.001609+0000","last_fullsized":"2024-09-10T06:27:09.001609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.001237+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.001237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:24.656485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.205524+0000","last_change":"2024-09-10T06:27:21.205339+0000","last_active":"2024-09-10T06:27:21.205524+0000","last_peered":"2024-09-10T06:27:21.205524+0000","last_clean":"2024-09-10T06:27:21.205524+0000","last_became_active":"2024-09-10T06:22:41.881392+0000","last_became_peered":"2024-09-10T06:22:41.881392+0000","last_unstale":"2024-09-10T06:27:21.205524+0000","last_undegraded":"2024-09-10T06:27:21.205524+0000","last_fullsized":"2024-09-10T06:27:21.205524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:21.205145+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:21.205145+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.205145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:59.013920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.840752+0000","last_change":"2024-09-10T06:26:42.840670+0000","last_active":"2024-09-10T06:26:42.840752+0000","last_peered":"2024-09-10T06:26:42.840752+0000","last_clean":"2024-09-10T06:26:42.840752+0000","last_became_active":"2024-09-10T06:22:33.816947+0000","last_became_peered":"2024-09-10T06:22:33.816947+0000","last_unstale":"2024-09-10T06:26:42.840752+0000","last_undegraded":"2024-09-10T06:26:42.840752+0000","last_fullsized":"2024-09-10T06:26:42.840752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.840563+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.840563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:01.593470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.412780+0000","last_change":"2024-09-10T06:26:30.412608+0000","last_active":"2024-09-10T06:26:30.412780+0000","last_peered":"2024-09-10T06:26:30.412780+0000","last_clean":"2024-09-10T06:26:30.412780+0000","last_became_active":"2024-09-10T06:22:31.823499+0000","last_became_peered":"2024-09-10T06:22:31.823499+0000","last_unstale":"2024-09-10T06:26:30.412780+0000","last_undegraded":"2024-09-10T06:26:30.412780+0000","last_fullsized":"2024-09-10T06:26:30.412780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-09-10T06:26:30.412443+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.412443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:27.375871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:53.706963+0000","last_change":"2024-09-10T06:26:53.706775+0000","last_active":"2024-09-10T06:26:53.706963+0000","last_peered":"2024-09-10T06:26:53.706963+0000","last_clean":"2024-09-10T06:26:53.706963+0000","last_became_active":"2024-09-10T06:22:35.830792+0000","last_became_peered":"2024-09-10T06:22:35.830792+0000","last_unstale":"2024-09-10T06:26:53.706963+0000","last_undegraded":"2024-09-10T06:26:53.706963+0000","last_fullsized":"2024-09-10T06:26:53.706963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:53.706565+0000","last_clean_scrub_stamp":"2024-09-10T06:26:53.706565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:21.763699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'49","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.868501+0000","last_change":"2024-09-10T06:26:55.868369+0000","last_active":"2024-09-10T06:26:55.868501+0000","last_peered":"2024-09-10T06:26:55.868501+0000","last_clean":"2024-09-10T06:26:55.868501+0000","last_became_active":"2024-09-10T06:22:37.835778+0000","last_became_peered":"2024-09-10T06:22:37.835778+0000","last_unstale":"2024-09-10T06:26:55.868501+0000","last_undegraded":"2024-09-10T06:26:55.868501+0000","last_fullsized":"2024-09-10T06:26:55.868501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-09-10T06:26:55.868167+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.868167+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:51.332406+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:12.806036+0000","last_change":"2024-09-10T06:27:12.805908+0000","last_active":"2024-09-10T06:27:12.806036+0000","last_peered":"2024-09-10T06:27:12.806036+0000","last_clean":"2024-09-10T06:27:12.806036+0000","last_became_active":"2024-09-10T06:22:39.855293+0000","last_became_peered":"2024-09-10T06:22:39.855293+0000","last_unstale":"2024-09-10T06:27:12.806036+0000","last_undegraded":"2024-09-10T06:27:12.806036+0000","last_fullsized":"2024-09-10T06:27:12.806036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:12.805731+0000","last_clean_scrub_stamp":"2024-09-10T06:27:12.805731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:14.637303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:46.563463+0000","last_change":"2024-09-10T06:27:46.563463+0000","last_active":"2024-09-10T06:27:46.563463+0000","last_peered":"2024-09-10T06:27:46.563463+0000","last_clean":"2024-09-10T06:27:46.563463+0000","last_became_active":"2024-09-10T06:22:41.893458+0000","last_became_peered":"2024-09-10T06:22:41.893458+0000","last_unstale":"2024-09-10T06:27:46.563463+0000","last_undegraded":"2024-09-10T06:27:46.563463+0000","last_fullsized":"2024-09-10T06:27:46.563463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:46.563261+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:46.563261+0000","last_clean_scrub_stamp":"2024-09-10T06:27:46.563261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:11.206546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.197383+0000","last_change":"2024-09-10T06:26:56.197236+0000","last_active":"2024-09-10T06:26:56.197383+0000","last_peered":"2024-09-10T06:26:56.197383+0000","last_clean":"2024-09-10T06:26:56.197383+0000","last_became_active":"2024-09-10T06:22:33.836923+0000","last_became_peered":"2024-09-10T06:22:33.836923+0000","last_unstale":"2024-09-10T06:26:56.197383+0000","last_undegraded":"2024-09-10T06:26:56.197383+0000","last_fullsized":"2024-09-10T06:26:56.197383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-09-10T06:26:56.197045+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.197045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:27.788695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'5","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.483548+0000","last_change":"2024-09-10T06:26:24.483285+0000","last_active":"2024-09-10T06:26:24.483548+0000","last_peered":"2024-09-10T06:26:24.483548+0000","last_clean":"2024-09-10T06:26:24.483548+0000","last_became_active":"2024-09-10T06:22:31.824280+0000","last_became_peered":"2024-09-10T06:22:31.824280+0000","last_unstale":"2024-09-10T06:26:24.483548+0000","last_undegraded":"2024-09-10T06:26:24.483548+0000","last_fullsized":"2024-09-10T06:26:24.483548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:24.483039+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.483039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:30.019052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:13.449473+0000","last_change":"2024-09-10T06:27:13.449345+0000","last_active":"2024-09-10T06:27:13.449473+0000","last_peered":"2024-09-10T06:27:13.449473+0000","last_clean":"2024-09-10T06:27:13.449473+0000","last_became_active":"2024-09-10T06:22:35.820364+0000","last_became_peered":"2024-09-10T06:22:35.820364+0000","last_unstale":"2024-09-10T06:27:13.449473+0000","last_undegraded":"2024-09-10T06:27:13.449473+0000","last_fullsized":"2024-09-10T06:27:13.449473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:13.449177+0000","last_clean_scrub_stamp":"2024-09-10T06:27:13.449177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:41.642297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.921176+0000","last_change":"2024-09-10T06:27:01.921006+0000","last_active":"2024-09-10T06:27:01.921176+0000","last_peered":"2024-09-10T06:27:01.921176+0000","last_clean":"2024-09-10T06:27:01.921176+0000","last_became_active":"2024-09-10T06:22:37.828184+0000","last_became_peered":"2024-09-10T06:22:37.828184+0000","last_unstale":"2024-09-10T06:27:01.921176+0000","last_undegraded":"2024-09-10T06:27:01.921176+0000","last_fullsized":"2024-09-10T06:27:01.921176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.920831+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.920831+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:20.056861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:07.983740+0000","last_change":"2024-09-10T06:27:07.983513+0000","last_active":"2024-09-10T06:27:07.983740+0000","last_peered":"2024-09-10T06:27:07.983740+0000","last_clean":"2024-09-10T06:27:07.983740+0000","last_became_active":"2024-09-10T06:22:39.852454+0000","last_became_peered":"2024-09-10T06:22:39.852454+0000","last_unstale":"2024-09-10T06:27:07.983740+0000","last_undegraded":"2024-09-10T06:27:07.983740+0000","last_fullsized":"2024-09-10T06:27:07.983740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:07.983266+0000","last_clean_scrub_stamp":"2024-09-10T06:27:07.983266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.860758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:02.277414+0000","last_change":"2024-09-10T06:27:02.277414+0000","last_active":"2024-09-10T06:27:02.277414+0000","last_peered":"2024-09-10T06:27:02.277414+0000","last_clean":"2024-09-10T06:27:02.277414+0000","last_became_active":"2024-09-10T06:22:33.814242+0000","last_became_peered":"2024-09-10T06:22:33.814242+0000","last_unstale":"2024-09-10T06:27:02.277414+0000","last_undegraded":"2024-09-10T06:27:02.277414+0000","last_fullsized":"2024-09-10T06:27:02.277414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:02.277228+0000","last_clean_scrub_stamp":"2024-09-10T06:27:02.277228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:05.739551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.321180+0000","last_change":"2024-09-10T06:26:38.321035+0000","last_active":"2024-09-10T06:26:38.321180+0000","last_peered":"2024-09-10T06:26:38.321180+0000","last_clean":"2024-09-10T06:26:38.321180+0000","last_became_active":"2024-09-10T06:22:31.830177+0000","last_became_peered":"2024-09-10T06:22:31.830177+0000","last_unstale":"2024-09-10T06:26:38.321180+0000","last_undegraded":"2024-09-10T06:26:38.321180+0000","last_fullsized":"2024-09-10T06:26:38.321180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:38.320842+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.320842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:44.932697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.937445+0000","last_change":"2024-09-10T06:27:00.937445+0000","last_active":"2024-09-10T06:27:00.937445+0000","last_peered":"2024-09-10T06:27:00.937445+0000","last_clean":"2024-09-10T06:27:00.937445+0000","last_became_active":"2024-09-10T06:22:35.821379+0000","last_became_peered":"2024-09-10T06:22:35.821379+0000","last_unstale":"2024-09-10T06:27:00.937445+0000","last_undegraded":"2024-09-10T06:27:00.937445+0000","last_fullsized":"2024-09-10T06:27:00.937445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.937205+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.937205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:38.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'65","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:58.901835+0000","last_change":"2024-09-10T06:26:58.901653+0000","last_active":"2024-09-10T06:26:58.901835+0000","last_peered":"2024-09-10T06:26:58.901835+0000","last_clean":"2024-09-10T06:26:58.901835+0000","last_became_active":"2024-09-10T06:22:37.829344+0000","last_became_peered":"2024-09-10T06:22:37.829344+0000","last_unstale":"2024-09-10T06:26:58.901835+0000","last_undegraded":"2024-09-10T06:26:58.901835+0000","last_fullsized":"2024-09-10T06:26:58.901835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-09-10T06:26:58.901461+0000","last_clean_scrub_stamp":"2024-09-10T06:26:58.901461+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:22.299716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.993938+0000","last_change":"2024-09-10T06:27:09.993773+0000","last_active":"2024-09-10T06:27:09.993938+0000","last_peered":"2024-09-10T06:27:09.993938+0000","last_clean":"2024-09-10T06:27:09.993938+0000","last_became_active":"2024-09-10T06:22:39.846548+0000","last_became_peered":"2024-09-10T06:22:39.846548+0000","last_unstale":"2024-09-10T06:27:09.993938+0000","last_undegraded":"2024-09-10T06:27:09.993938+0000","last_fullsized":"2024-09-10T06:27:09.993938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:09.993589+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.993589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:47.114955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:18.114573+0000","last_change":"2024-09-10T06:27:18.114433+0000","last_active":"2024-09-10T06:27:18.114573+0000","last_peered":"2024-09-10T06:27:18.114573+0000","last_clean":"2024-09-10T06:27:18.114573+0000","last_became_active":"2024-09-10T06:22:41.877468+0000","last_became_peered":"2024-09-10T06:22:41.877468+0000","last_unstale":"2024-09-10T06:27:18.114573+0000","last_undegraded":"2024-09-10T06:27:18.114573+0000","last_fullsized":"2024-09-10T06:27:18.114573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:27:18.114233+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:27:18.114233+0000","last_clean_scrub_stamp":"2024-09-10T06:27:18.114233+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:21.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'16","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.985592+0000","last_change":"2024-09-10T06:26:33.985592+0000","last_active":"2024-09-10T06:26:33.985592+0000","last_peered":"2024-09-10T06:26:33.985592+0000","last_clean":"2024-09-10T06:26:33.985592+0000","last_became_active":"2024-09-10T06:22:33.819756+0000","last_became_peered":"2024-09-10T06:22:33.819756+0000","last_unstale":"2024-09-10T06:26:33.985592+0000","last_undegraded":"2024-09-10T06:26:33.985592+0000","last_fullsized":"2024-09-10T06:26:33.985592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:33.985394+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.985394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:06.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.488405+0000","last_change":"2024-09-10T06:26:25.488251+0000","last_active":"2024-09-10T06:26:25.488405+0000","last_peered":"2024-09-10T06:26:25.488405+0000","last_clean":"2024-09-10T06:26:25.488405+0000","last_became_active":"2024-09-10T06:22:31.824267+0000","last_became_peered":"2024-09-10T06:22:31.824267+0000","last_unstale":"2024-09-10T06:26:25.488405+0000","last_undegraded":"2024-09-10T06:26:25.488405+0000","last_fullsized":"2024-09-10T06:26:25.488405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.488065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.488065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:13.168721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:56.813155+0000","last_change":"2024-09-10T06:26:56.813155+0000","last_active":"2024-09-10T06:26:56.813155+0000","last_peered":"2024-09-10T06:26:56.813155+0000","last_clean":"2024-09-10T06:26:56.813155+0000","last_became_active":"2024-09-10T06:22:35.818749+0000","last_became_peered":"2024-09-10T06:22:35.818749+0000","last_unstale":"2024-09-10T06:26:56.813155+0000","last_undegraded":"2024-09-10T06:26:56.813155+0000","last_fullsized":"2024-09-10T06:26:56.813155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-10T06:26:56.812957+0000","last_clean_scrub_stamp":"2024-09-10T06:26:56.812957+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:18.279075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:27.487988+0000","last_change":"2024-09-10T06:27:27.487856+0000","last_active":"2024-09-10T06:27:27.487988+0000","last_peered":"2024-09-10T06:27:27.487988+0000","last_clean":"2024-09-10T06:27:27.487988+0000","last_became_active":"2024-09-10T06:22:37.858979+0000","last_became_peered":"2024-09-10T06:22:37.858979+0000","last_unstale":"2024-09-10T06:27:27.487988+0000","last_undegraded":"2024-09-10T06:27:27.487988+0000","last_fullsized":"2024-09-10T06:27:27.487988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-09-10T06:27:27.487666+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-09-10T06:27:27.487666+0000","last_clean_scrub_stamp":"2024-09-10T06:27:27.487666+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:04.623090+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.796664+0000","last_change":"2024-09-10T06:27:15.796522+0000","last_active":"2024-09-10T06:27:15.796664+0000","last_peered":"2024-09-10T06:27:15.796664+0000","last_clean":"2024-09-10T06:27:15.796664+0000","last_became_active":"2024-09-10T06:22:39.876311+0000","last_became_peered":"2024-09-10T06:22:39.876311+0000","last_unstale":"2024-09-10T06:27:15.796664+0000","last_undegraded":"2024-09-10T06:27:15.796664+0000","last_fullsized":"2024-09-10T06:27:15.796664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.796342+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.796342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.065806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:42.547709+0000","last_change":"2024-09-10T06:27:42.547709+0000","last_active":"2024-09-10T06:27:42.547709+0000","last_peered":"2024-09-10T06:27:42.547709+0000","last_clean":"2024-09-10T06:27:42.547709+0000","last_became_active":"2024-09-10T06:22:41.889416+0000","last_became_peered":"2024-09-10T06:22:41.889416+0000","last_unstale":"2024-09-10T06:27:42.547709+0000","last_undegraded":"2024-09-10T06:27:42.547709+0000","last_fullsized":"2024-09-10T06:27:42.547709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:42.547505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:42.547505+0000","last_clean_scrub_stamp":"2024-09-10T06:27:42.547505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:26:21.257127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'16","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.308720+0000","last_change":"2024-09-10T06:27:01.308555+0000","last_active":"2024-09-10T06:27:01.308720+0000","last_peered":"2024-09-10T06:27:01.308720+0000","last_clean":"2024-09-10T06:27:01.308720+0000","last_became_active":"2024-09-10T06:22:33.836416+0000","last_became_peered":"2024-09-10T06:22:33.836416+0000","last_unstale":"2024-09-10T06:27:01.308720+0000","last_undegraded":"2024-09-10T06:27:01.308720+0000","last_fullsized":"2024-09-10T06:27:01.308720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:27:01.308357+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.308357+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:22.145053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.473124+0000","last_change":"2024-09-10T06:26:26.472997+0000","last_active":"2024-09-10T06:26:26.473124+0000","last_peered":"2024-09-10T06:26:26.473124+0000","last_clean":"2024-09-10T06:26:26.473124+0000","last_became_active":"2024-09-10T06:22:31.798286+0000","last_became_peered":"2024-09-10T06:22:31.798286+0000","last_unstale":"2024-09-10T06:26:26.473124+0000","last_undegraded":"2024-09-10T06:26:26.473124+0000","last_fullsized":"2024-09-10T06:26:26.473124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:26.472822+0000","last_clean_scrub_stamp":"2024-09-10T06:26:26.472822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:54.495647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:55.792520+0000","last_change":"2024-09-10T06:26:55.792297+0000","last_active":"2024-09-10T06:26:55.792520+0000","last_peered":"2024-09-10T06:26:55.792520+0000","last_clean":"2024-09-10T06:26:55.792520+0000","last_became_active":"2024-09-10T06:22:35.822521+0000","last_became_peered":"2024-09-10T06:22:35.822521+0000","last_unstale":"2024-09-10T06:26:55.792520+0000","last_undegraded":"2024-09-10T06:26:55.792520+0000","last_fullsized":"2024-09-10T06:26:55.792520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:55.792027+0000","last_clean_scrub_stamp":"2024-09-10T06:26:55.792027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:33.611842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.936936+0000","last_change":"2024-09-10T06:26:59.936936+0000","last_active":"2024-09-10T06:26:59.936936+0000","last_peered":"2024-09-10T06:26:59.936936+0000","last_clean":"2024-09-10T06:26:59.936936+0000","last_became_active":"2024-09-10T06:22:37.829639+0000","last_became_peered":"2024-09-10T06:22:37.829639+0000","last_unstale":"2024-09-10T06:26:59.936936+0000","last_undegraded":"2024-09-10T06:26:59.936936+0000","last_fullsized":"2024-09-10T06:26:59.936936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-09-10T06:26:59.936687+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.936687+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:55.426141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:15.067168+0000","last_change":"2024-09-10T06:27:15.067168+0000","last_active":"2024-09-10T06:27:15.067168+0000","last_peered":"2024-09-10T06:27:15.067168+0000","last_clean":"2024-09-10T06:27:15.067168+0000","last_became_active":"2024-09-10T06:22:39.855722+0000","last_became_peered":"2024-09-10T06:22:39.855722+0000","last_unstale":"2024-09-10T06:27:15.067168+0000","last_undegraded":"2024-09-10T06:27:15.067168+0000","last_fullsized":"2024-09-10T06:27:15.067168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:15.066985+0000","last_clean_scrub_stamp":"2024-09-10T06:27:15.066985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:17.002362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:41.508745+0000","last_change":"2024-09-10T06:27:41.508745+0000","last_active":"2024-09-10T06:27:41.508745+0000","last_peered":"2024-09-10T06:27:41.508745+0000","last_clean":"2024-09-10T06:27:41.508745+0000","last_became_active":"2024-09-10T06:22:41.885041+0000","last_became_peered":"2024-09-10T06:22:41.885041+0000","last_unstale":"2024-09-10T06:27:41.508745+0000","last_undegraded":"2024-09-10T06:27:41.508745+0000","last_fullsized":"2024-09-10T06:27:41.508745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-09-10T06:27:41.508561+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-09-10T06:27:41.508561+0000","last_clean_scrub_stamp":"2024-09-10T06:27:41.508561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:24.585390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.845164+0000","last_change":"2024-09-10T06:26:41.845005+0000","last_active":"2024-09-10T06:26:41.845164+0000","last_peered":"2024-09-10T06:26:41.845164+0000","last_clean":"2024-09-10T06:26:41.845164+0000","last_became_active":"2024-09-10T06:22:33.842439+0000","last_became_peered":"2024-09-10T06:22:33.842439+0000","last_unstale":"2024-09-10T06:26:41.845164+0000","last_undegraded":"2024-09-10T06:26:41.845164+0000","last_fullsized":"2024-09-10T06:26:41.845164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:41.844823+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.844823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:18.354085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.272054+0000","last_change":"2024-09-10T06:26:40.271903+0000","last_active":"2024-09-10T06:26:40.272054+0000","last_peered":"2024-09-10T06:26:40.272054+0000","last_clean":"2024-09-10T06:26:40.272054+0000","last_became_active":"2024-09-10T06:22:31.818929+0000","last_became_peered":"2024-09-10T06:22:31.818929+0000","last_unstale":"2024-09-10T06:26:40.272054+0000","last_undegraded":"2024-09-10T06:26:40.272054+0000","last_fullsized":"2024-09-10T06:26:40.272054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:40.271701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.271701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.922441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.747156+0000","last_change":"2024-09-10T06:27:03.747006+0000","last_active":"2024-09-10T06:27:03.747156+0000","last_peered":"2024-09-10T06:27:03.747156+0000","last_clean":"2024-09-10T06:27:03.747156+0000","last_became_active":"2024-09-10T06:22:35.826636+0000","last_became_peered":"2024-09-10T06:22:35.826636+0000","last_unstale":"2024-09-10T06:27:03.747156+0000","last_undegraded":"2024-09-10T06:27:03.747156+0000","last_fullsized":"2024-09-10T06:27:03.747156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:03.746826+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.746826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:06.502760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:28.444051+0000","last_change":"2024-09-10T06:27:28.444051+0000","last_active":"2024-09-10T06:27:28.444051+0000","last_peered":"2024-09-10T06:27:28.444051+0000","last_clean":"2024-09-10T06:27:28.444051+0000","last_became_active":"2024-09-10T06:22:37.860499+0000","last_became_peered":"2024-09-10T06:22:37.860499+0000","last_unstale":"2024-09-10T06:27:28.444051+0000","last_undegraded":"2024-09-10T06:27:28.444051+0000","last_fullsized":"2024-09-10T06:27:28.444051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-09-10T06:27:28.443831+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-09-10T06:27:28.443831+0000","last_clean_scrub_stamp":"2024-09-10T06:27:28.443831+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:14.033657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'286","reported_seq":432,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.961886+0000","last_change":"2024-09-10T06:27:10.961886+0000","last_active":"2024-09-10T06:27:10.961886+0000","last_peered":"2024-09-10T06:27:10.961886+0000","last_clean":"2024-09-10T06:27:10.961886+0000","last_became_active":"2024-09-10T06:22:39.875190+0000","last_became_peered":"2024-09-10T06:22:39.875190+0000","last_unstale":"2024-09-10T06:27:10.961886+0000","last_undegraded":"2024-09-10T06:27:10.961886+0000","last_fullsized":"2024-09-10T06:27:10.961886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-09-10T06:27:10.961678+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.961678+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:56.160209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:40.536955+0000","last_change":"2024-09-10T06:27:40.536955+0000","last_active":"2024-09-10T06:27:40.536955+0000","last_peered":"2024-09-10T06:27:40.536955+0000","last_clean":"2024-09-10T06:27:40.536955+0000","last_became_active":"2024-09-10T06:22:41.884654+0000","last_became_peered":"2024-09-10T06:22:41.884654+0000","last_unstale":"2024-09-10T06:27:40.536955+0000","last_undegraded":"2024-09-10T06:27:40.536955+0000","last_fullsized":"2024-09-10T06:27:40.536955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:40.536770+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:40.536770+0000","last_clean_scrub_stamp":"2024-09-10T06:27:40.536770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:17.276384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.766439+0000","last_change":"2024-09-10T06:26:43.766249+0000","last_active":"2024-09-10T06:26:43.766439+0000","last_peered":"2024-09-10T06:26:43.766439+0000","last_clean":"2024-09-10T06:26:43.766439+0000","last_became_active":"2024-09-10T06:22:33.837159+0000","last_became_peered":"2024-09-10T06:22:33.837159+0000","last_unstale":"2024-09-10T06:26:43.766439+0000","last_undegraded":"2024-09-10T06:26:43.766439+0000","last_fullsized":"2024-09-10T06:26:43.766439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:43.766065+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.766065+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:03.179883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:27.514821+0000","last_change":"2024-09-10T06:26:27.514686+0000","last_active":"2024-09-10T06:26:27.514821+0000","last_peered":"2024-09-10T06:26:27.514821+0000","last_clean":"2024-09-10T06:26:27.514821+0000","last_became_active":"2024-09-10T06:22:31.827268+0000","last_became_peered":"2024-09-10T06:22:31.827268+0000","last_unstale":"2024-09-10T06:26:27.514821+0000","last_undegraded":"2024-09-10T06:26:27.514821+0000","last_fullsized":"2024-09-10T06:26:27.514821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:27.514477+0000","last_clean_scrub_stamp":"2024-09-10T06:26:27.514477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:51.644214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.736111+0000","last_change":"2024-09-10T06:27:00.735972+0000","last_active":"2024-09-10T06:27:00.736111+0000","last_peered":"2024-09-10T06:27:00.736111+0000","last_clean":"2024-09-10T06:27:00.736111+0000","last_became_active":"2024-09-10T06:22:35.832096+0000","last_became_peered":"2024-09-10T06:22:35.832096+0000","last_unstale":"2024-09-10T06:27:00.736111+0000","last_undegraded":"2024-09-10T06:27:00.736111+0000","last_fullsized":"2024-09-10T06:27:00.736111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:00.735767+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.735767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:16:43.205771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'47","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:09.833705+0000","last_change":"2024-09-10T06:27:09.833538+0000","last_active":"2024-09-10T06:27:09.833705+0000","last_peered":"2024-09-10T06:27:09.833705+0000","last_clean":"2024-09-10T06:27:09.833705+0000","last_became_active":"2024-09-10T06:22:37.835159+0000","last_became_peered":"2024-09-10T06:22:37.835159+0000","last_unstale":"2024-09-10T06:27:09.833705+0000","last_undegraded":"2024-09-10T06:27:09.833705+0000","last_fullsized":"2024-09-10T06:27:09.833705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-09-10T06:27:09.833326+0000","last_clean_scrub_stamp":"2024-09-10T06:27:09.833326+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:21.693191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:14.090894+0000","last_change":"2024-09-10T06:27:14.090734+0000","last_active":"2024-09-10T06:27:14.090894+0000","last_peered":"2024-09-10T06:27:14.090894+0000","last_clean":"2024-09-10T06:27:14.090894+0000","last_became_active":"2024-09-10T06:22:39.851286+0000","last_became_peered":"2024-09-10T06:22:39.851286+0000","last_unstale":"2024-09-10T06:27:14.090894+0000","last_undegraded":"2024-09-10T06:27:14.090894+0000","last_fullsized":"2024-09-10T06:27:14.090894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:14.090548+0000","last_clean_scrub_stamp":"2024-09-10T06:27:14.090548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:13.867204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:21.700085+0000","last_change":"2024-09-10T06:27:21.699967+0000","last_active":"2024-09-10T06:27:21.700085+0000","last_peered":"2024-09-10T06:27:21.700085+0000","last_clean":"2024-09-10T06:27:21.700085+0000","last_became_active":"2024-09-10T06:22:41.879012+0000","last_became_peered":"2024-09-10T06:22:41.879012+0000","last_unstale":"2024-09-10T06:27:21.700085+0000","last_undegraded":"2024-09-10T06:27:21.700085+0000","last_fullsized":"2024-09-10T06:27:21.700085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:21.699787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:21.699787+0000","last_clean_scrub_stamp":"2024-09-10T06:27:21.699787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:23.635164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.853525+0000","last_change":"2024-09-10T06:26:48.853350+0000","last_active":"2024-09-10T06:26:48.853525+0000","last_peered":"2024-09-10T06:26:48.853525+0000","last_clean":"2024-09-10T06:26:48.853525+0000","last_became_active":"2024-09-10T06:22:33.821988+0000","last_became_peered":"2024-09-10T06:22:33.821988+0000","last_unstale":"2024-09-10T06:26:48.853525+0000","last_undegraded":"2024-09-10T06:26:48.853525+0000","last_fullsized":"2024-09-10T06:26:48.853525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:48.853173+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.853173+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.980423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.320984+0000","last_change":"2024-09-10T06:26:39.320847+0000","last_active":"2024-09-10T06:26:39.320984+0000","last_peered":"2024-09-10T06:26:39.320984+0000","last_clean":"2024-09-10T06:26:39.320984+0000","last_became_active":"2024-09-10T06:22:31.832807+0000","last_became_peered":"2024-09-10T06:22:31.832807+0000","last_unstale":"2024-09-10T06:26:39.320984+0000","last_undegraded":"2024-09-10T06:26:39.320984+0000","last_fullsized":"2024-09-10T06:26:39.320984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.320667+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.320667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:50.205168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:54.749093+0000","last_change":"2024-09-10T06:26:54.748950+0000","last_active":"2024-09-10T06:26:54.749093+0000","last_peered":"2024-09-10T06:26:54.749093+0000","last_clean":"2024-09-10T06:26:54.749093+0000","last_became_active":"2024-09-10T06:22:35.826044+0000","last_became_peered":"2024-09-10T06:22:35.826044+0000","last_unstale":"2024-09-10T06:26:54.749093+0000","last_undegraded":"2024-09-10T06:26:54.749093+0000","last_fullsized":"2024-09-10T06:26:54.749093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:54.748750+0000","last_clean_scrub_stamp":"2024-09-10T06:26:54.748750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:36.180223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.954965+0000","last_change":"2024-09-10T06:27:01.954819+0000","last_active":"2024-09-10T06:27:01.954965+0000","last_peered":"2024-09-10T06:27:01.954965+0000","last_clean":"2024-09-10T06:27:01.954965+0000","last_became_active":"2024-09-10T06:22:37.831573+0000","last_became_peered":"2024-09-10T06:22:37.831573+0000","last_unstale":"2024-09-10T06:27:01.954965+0000","last_undegraded":"2024-09-10T06:27:01.954965+0000","last_fullsized":"2024-09-10T06:27:01.954965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-09-10T06:27:01.954628+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.954628+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:38.462199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:34.419137+0000","last_change":"2024-09-10T06:27:34.419137+0000","last_active":"2024-09-10T06:27:34.419137+0000","last_peered":"2024-09-10T06:27:34.419137+0000","last_clean":"2024-09-10T06:27:34.419137+0000","last_became_active":"2024-09-10T06:22:39.874899+0000","last_became_peered":"2024-09-10T06:22:39.874899+0000","last_unstale":"2024-09-10T06:27:34.419137+0000","last_undegraded":"2024-09-10T06:27:34.419137+0000","last_fullsized":"2024-09-10T06:27:34.419137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:34.418958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:34.418958+0000","last_clean_scrub_stamp":"2024-09-10T06:27:34.418958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:59.933728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:45.555017+0000","last_change":"2024-09-10T06:27:45.555017+0000","last_active":"2024-09-10T06:27:45.555017+0000","last_peered":"2024-09-10T06:27:45.555017+0000","last_clean":"2024-09-10T06:27:45.555017+0000","last_became_active":"2024-09-10T06:22:41.893213+0000","last_became_peered":"2024-09-10T06:22:41.893213+0000","last_unstale":"2024-09-10T06:27:45.555017+0000","last_undegraded":"2024-09-10T06:27:45.555017+0000","last_fullsized":"2024-09-10T06:27:45.555017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:45.554842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:45.554842+0000","last_clean_scrub_stamp":"2024-09-10T06:27:45.554842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:45.907791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:00.265847+0000","last_change":"2024-09-10T06:27:00.265691+0000","last_active":"2024-09-10T06:27:00.265847+0000","last_peered":"2024-09-10T06:27:00.265847+0000","last_clean":"2024-09-10T06:27:00.265847+0000","last_became_active":"2024-09-10T06:22:33.813747+0000","last_became_peered":"2024-09-10T06:22:33.813747+0000","last_unstale":"2024-09-10T06:27:00.265847+0000","last_undegraded":"2024-09-10T06:27:00.265847+0000","last_fullsized":"2024-09-10T06:27:00.265847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:27:00.265499+0000","last_clean_scrub_stamp":"2024-09-10T06:27:00.265499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:33.791297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:24.100568+0000","last_change":"2024-09-10T06:26:24.100296+0000","last_active":"2024-09-10T06:26:24.100568+0000","last_peered":"2024-09-10T06:26:24.100568+0000","last_clean":"2024-09-10T06:26:24.100568+0000","last_became_active":"2024-09-10T06:22:31.811903+0000","last_became_peered":"2024-09-10T06:22:31.811903+0000","last_unstale":"2024-09-10T06:26:24.100568+0000","last_undegraded":"2024-09-10T06:26:24.100568+0000","last_fullsized":"2024-09-10T06:26:24.100568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:24.100028+0000","last_clean_scrub_stamp":"2024-09-10T06:26:24.100028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:50.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:59.731922+0000","last_change":"2024-09-10T06:26:59.731771+0000","last_active":"2024-09-10T06:26:59.731922+0000","last_peered":"2024-09-10T06:26:59.731922+0000","last_clean":"2024-09-10T06:26:59.731922+0000","last_became_active":"2024-09-10T06:22:35.834046+0000","last_became_peered":"2024-09-10T06:22:35.834046+0000","last_unstale":"2024-09-10T06:26:59.731922+0000","last_undegraded":"2024-09-10T06:26:59.731922+0000","last_fullsized":"2024-09-10T06:26:59.731922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:59.731593+0000","last_clean_scrub_stamp":"2024-09-10T06:26:59.731593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:42.655477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'32","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:26.470500+0000","last_change":"2024-09-10T06:27:26.470330+0000","last_active":"2024-09-10T06:27:26.470500+0000","last_peered":"2024-09-10T06:27:26.470500+0000","last_clean":"2024-09-10T06:27:26.470500+0000","last_became_active":"2024-09-10T06:22:37.859381+0000","last_became_peered":"2024-09-10T06:22:37.859381+0000","last_unstale":"2024-09-10T06:27:26.470500+0000","last_undegraded":"2024-09-10T06:27:26.470500+0000","last_fullsized":"2024-09-10T06:27:26.470500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-09-10T06:27:26.470147+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-09-10T06:27:26.470147+0000","last_clean_scrub_stamp":"2024-09-10T06:27:26.470147+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:41.832598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:36.431561+0000","last_change":"2024-09-10T06:27:36.431400+0000","last_active":"2024-09-10T06:27:36.431561+0000","last_peered":"2024-09-10T06:27:36.431561+0000","last_clean":"2024-09-10T06:27:36.431561+0000","last_became_active":"2024-09-10T06:22:39.876558+0000","last_became_peered":"2024-09-10T06:22:39.876558+0000","last_unstale":"2024-09-10T06:27:36.431561+0000","last_undegraded":"2024-09-10T06:27:36.431561+0000","last_fullsized":"2024-09-10T06:27:36.431561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:36.431202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:36.431202+0000","last_clean_scrub_stamp":"2024-09-10T06:27:36.431202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:34.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:44.589927+0000","last_change":"2024-09-10T06:27:44.589927+0000","last_active":"2024-09-10T06:27:44.589927+0000","last_peered":"2024-09-10T06:27:44.589927+0000","last_clean":"2024-09-10T06:27:44.589927+0000","last_became_active":"2024-09-10T06:22:41.893141+0000","last_became_peered":"2024-09-10T06:22:41.893141+0000","last_unstale":"2024-09-10T06:27:44.589927+0000","last_undegraded":"2024-09-10T06:27:44.589927+0000","last_fullsized":"2024-09-10T06:27:44.589927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:27:44.589746+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:27:44.589746+0000","last_clean_scrub_stamp":"2024-09-10T06:27:44.589746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:39.085289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.677926+0000","last_change":"2024-09-10T06:26:40.677762+0000","last_active":"2024-09-10T06:26:40.677926+0000","last_peered":"2024-09-10T06:26:40.677926+0000","last_clean":"2024-09-10T06:26:40.677926+0000","last_became_active":"2024-09-10T06:22:33.841050+0000","last_became_peered":"2024-09-10T06:22:33.841050+0000","last_unstale":"2024-09-10T06:26:40.677926+0000","last_undegraded":"2024-09-10T06:26:40.677926+0000","last_fullsized":"2024-09-10T06:26:40.677926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:40.677546+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.677546+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:35.665500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:28.482430+0000","last_change":"2024-09-10T06:26:28.482269+0000","last_active":"2024-09-10T06:26:28.482430+0000","last_peered":"2024-09-10T06:26:28.482430+0000","last_clean":"2024-09-10T06:26:28.482430+0000","last_became_active":"2024-09-10T06:22:31.803606+0000","last_became_peered":"2024-09-10T06:22:31.803606+0000","last_unstale":"2024-09-10T06:26:28.482430+0000","last_undegraded":"2024-09-10T06:26:28.482430+0000","last_fullsized":"2024-09-10T06:26:28.482430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:28.482098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:28.482098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:08.791707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:01.690811+0000","last_change":"2024-09-10T06:27:01.690671+0000","last_active":"2024-09-10T06:27:01.690811+0000","last_peered":"2024-09-10T06:27:01.690811+0000","last_clean":"2024-09-10T06:27:01.690811+0000","last_became_active":"2024-09-10T06:22:35.834236+0000","last_became_peered":"2024-09-10T06:22:35.834236+0000","last_unstale":"2024-09-10T06:27:01.690811+0000","last_undegraded":"2024-09-10T06:27:01.690811+0000","last_fullsized":"2024-09-10T06:27:01.690811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-10T06:27:01.690490+0000","last_clean_scrub_stamp":"2024-09-10T06:27:01.690490+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:38.401842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'40","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.507743+0000","last_change":"2024-09-10T06:27:25.507599+0000","last_active":"2024-09-10T06:27:25.507743+0000","last_peered":"2024-09-10T06:27:25.507743+0000","last_clean":"2024-09-10T06:27:25.507743+0000","last_became_active":"2024-09-10T06:22:37.853483+0000","last_became_peered":"2024-09-10T06:22:37.853483+0000","last_unstale":"2024-09-10T06:27:25.507743+0000","last_undegraded":"2024-09-10T06:27:25.507743+0000","last_fullsized":"2024-09-10T06:27:25.507743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-09-10T06:27:25.507393+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-09-10T06:27:25.507393+0000","last_clean_scrub_stamp":"2024-09-10T06:27:25.507393+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:47.341354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:10.112954+0000","last_change":"2024-09-10T06:27:10.112787+0000","last_active":"2024-09-10T06:27:10.112954+0000","last_peered":"2024-09-10T06:27:10.112954+0000","last_clean":"2024-09-10T06:27:10.112954+0000","last_became_active":"2024-09-10T06:22:39.851604+0000","last_became_peered":"2024-09-10T06:22:39.851604+0000","last_unstale":"2024-09-10T06:27:10.112954+0000","last_undegraded":"2024-09-10T06:27:10.112954+0000","last_fullsized":"2024-09-10T06:27:10.112954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:27:10.112602+0000","last_clean_scrub_stamp":"2024-09-10T06:27:10.112602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:32.676055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:43.552995+0000","last_change":"2024-09-10T06:27:43.552995+0000","last_active":"2024-09-10T06:27:43.552995+0000","last_peered":"2024-09-10T06:27:43.552995+0000","last_clean":"2024-09-10T06:27:43.552995+0000","last_became_active":"2024-09-10T06:22:41.894984+0000","last_became_peered":"2024-09-10T06:22:41.894984+0000","last_unstale":"2024-09-10T06:27:43.552995+0000","last_undegraded":"2024-09-10T06:27:43.552995+0000","last_fullsized":"2024-09-10T06:27:43.552995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:43.552824+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:43.552824+0000","last_clean_scrub_stamp":"2024-09-10T06:27:43.552824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:34.623496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.779775+0000","last_change":"2024-09-10T06:26:43.779653+0000","last_active":"2024-09-10T06:26:43.779775+0000","last_peered":"2024-09-10T06:26:43.779775+0000","last_clean":"2024-09-10T06:26:43.779775+0000","last_became_active":"2024-09-10T06:22:33.824178+0000","last_became_peered":"2024-09-10T06:22:33.824178+0000","last_unstale":"2024-09-10T06:26:43.779775+0000","last_undegraded":"2024-09-10T06:26:43.779775+0000","last_fullsized":"2024-09-10T06:26:43.779775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.779476+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.779476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:31.036552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.433609+0000","last_change":"2024-09-10T06:26:29.433336+0000","last_active":"2024-09-10T06:26:29.433609+0000","last_peered":"2024-09-10T06:26:29.433609+0000","last_clean":"2024-09-10T06:26:29.433609+0000","last_became_active":"2024-09-10T06:22:31.808751+0000","last_became_peered":"2024-09-10T06:22:31.808751+0000","last_unstale":"2024-09-10T06:26:29.433609+0000","last_undegraded":"2024-09-10T06:26:29.433609+0000","last_fullsized":"2024-09-10T06:26:29.433609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:29.433088+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.433088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:15.744029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.839137+0000","last_change":"2024-09-10T06:26:45.838993+0000","last_active":"2024-09-10T06:26:45.839137+0000","last_peered":"2024-09-10T06:26:45.839137+0000","last_clean":"2024-09-10T06:26:45.839137+0000","last_became_active":"2024-09-10T06:22:33.841909+0000","last_became_peered":"2024-09-10T06:22:33.841909+0000","last_unstale":"2024-09-10T06:26:45.839137+0000","last_undegraded":"2024-09-10T06:26:45.839137+0000","last_fullsized":"2024-09-10T06:26:45.839137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-09-10T06:26:45.838814+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.838814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:56.402021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.047162+0000","last_change":"2024-09-10T06:26:29.046913+0000","last_active":"2024-09-10T06:26:29.047162+0000","last_peered":"2024-09-10T06:26:29.047162+0000","last_clean":"2024-09-10T06:26:29.047162+0000","last_became_active":"2024-09-10T06:22:31.809201+0000","last_became_peered":"2024-09-10T06:22:31.809201+0000","last_unstale":"2024-09-10T06:26:29.047162+0000","last_undegraded":"2024-09-10T06:26:29.047162+0000","last_fullsized":"2024-09-10T06:26:29.047162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.046701+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.046701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:29.715468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.781650+0000","last_change":"2024-09-10T06:26:44.781486+0000","last_active":"2024-09-10T06:26:44.781650+0000","last_peered":"2024-09-10T06:26:44.781650+0000","last_clean":"2024-09-10T06:26:44.781650+0000","last_became_active":"2024-09-10T06:23:12.853559+0000","last_became_peered":"2024-09-10T06:23:12.853559+0000","last_unstale":"2024-09-10T06:26:44.781650+0000","last_undegraded":"2024-09-10T06:26:44.781650+0000","last_fullsized":"2024-09-10T06:26:44.781650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.781299+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.781299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:57.451138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.302408+0000","last_change":"2024-09-10T06:26:41.302121+0000","last_active":"2024-09-10T06:26:41.302408+0000","last_peered":"2024-09-10T06:26:41.302408+0000","last_clean":"2024-09-10T06:26:41.302408+0000","last_became_active":"2024-09-10T06:22:31.822711+0000","last_became_peered":"2024-09-10T06:22:31.822711+0000","last_unstale":"2024-09-10T06:26:41.302408+0000","last_undegraded":"2024-09-10T06:26:41.302408+0000","last_fullsized":"2024-09-10T06:26:41.302408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:41.301927+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.301927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:41.492149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.808725+0000","last_change":"2024-09-10T06:26:46.808544+0000","last_active":"2024-09-10T06:26:46.808725+0000","last_peered":"2024-09-10T06:26:46.808725+0000","last_clean":"2024-09-10T06:26:46.808725+0000","last_became_active":"2024-09-10T06:22:33.842587+0000","last_became_peered":"2024-09-10T06:22:33.842587+0000","last_unstale":"2024-09-10T06:26:46.808725+0000","last_undegraded":"2024-09-10T06:26:46.808725+0000","last_fullsized":"2024-09-10T06:26:46.808725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:46.808370+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.808370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:30.378145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.079366+0000","last_change":"2024-09-10T06:26:25.079186+0000","last_active":"2024-09-10T06:26:25.079366+0000","last_peered":"2024-09-10T06:26:25.079366+0000","last_clean":"2024-09-10T06:26:25.079366+0000","last_became_active":"2024-09-10T06:22:31.812708+0000","last_became_peered":"2024-09-10T06:22:31.812708+0000","last_unstale":"2024-09-10T06:26:25.079366+0000","last_undegraded":"2024-09-10T06:26:25.079366+0000","last_fullsized":"2024-09-10T06:26:25.079366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:25.079003+0000","last_clean_scrub_stamp":"2024-09-10T06:26:25.079003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:58.821283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:40.891740+0000","last_change":"2024-09-10T06:26:40.891588+0000","last_active":"2024-09-10T06:26:40.891740+0000","last_peered":"2024-09-10T06:26:40.891740+0000","last_clean":"2024-09-10T06:26:40.891740+0000","last_became_active":"2024-09-10T06:22:33.817391+0000","last_became_peered":"2024-09-10T06:22:33.817391+0000","last_unstale":"2024-09-10T06:26:40.891740+0000","last_undegraded":"2024-09-10T06:26:40.891740+0000","last_fullsized":"2024-09-10T06:26:40.891740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:40.891412+0000","last_clean_scrub_stamp":"2024-09-10T06:26:40.891412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:16.731907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.995214+0000","last_change":"2024-09-10T06:26:31.995009+0000","last_active":"2024-09-10T06:26:31.995214+0000","last_peered":"2024-09-10T06:26:31.995214+0000","last_clean":"2024-09-10T06:26:31.995214+0000","last_became_active":"2024-09-10T06:22:31.809149+0000","last_became_peered":"2024-09-10T06:22:31.809149+0000","last_unstale":"2024-09-10T06:26:31.995214+0000","last_undegraded":"2024-09-10T06:26:31.995214+0000","last_fullsized":"2024-09-10T06:26:31.995214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.994787+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.994787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:49.297894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.735118+0000","last_change":"2024-09-10T06:26:42.734856+0000","last_active":"2024-09-10T06:26:42.735118+0000","last_peered":"2024-09-10T06:26:42.735118+0000","last_clean":"2024-09-10T06:26:42.735118+0000","last_became_active":"2024-09-10T06:22:33.829368+0000","last_became_peered":"2024-09-10T06:22:33.829368+0000","last_unstale":"2024-09-10T06:26:42.735118+0000","last_undegraded":"2024-09-10T06:26:42.735118+0000","last_fullsized":"2024-09-10T06:26:42.735118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:42.734628+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.734628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:25.938010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:29.497928+0000","last_change":"2024-09-10T06:26:29.497669+0000","last_active":"2024-09-10T06:26:29.497928+0000","last_peered":"2024-09-10T06:26:29.497928+0000","last_clean":"2024-09-10T06:26:29.497928+0000","last_became_active":"2024-09-10T06:22:31.833363+0000","last_became_peered":"2024-09-10T06:22:31.833363+0000","last_unstale":"2024-09-10T06:26:29.497928+0000","last_undegraded":"2024-09-10T06:26:29.497928+0000","last_fullsized":"2024-09-10T06:26:29.497928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.497454+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.497454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:45.426363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.888535+0000","last_change":"2024-09-10T06:26:43.888535+0000","last_active":"2024-09-10T06:26:43.888535+0000","last_peered":"2024-09-10T06:26:43.888535+0000","last_clean":"2024-09-10T06:26:43.888535+0000","last_became_active":"2024-09-10T06:22:33.819954+0000","last_became_peered":"2024-09-10T06:22:33.819954+0000","last_unstale":"2024-09-10T06:26:43.888535+0000","last_undegraded":"2024-09-10T06:26:43.888535+0000","last_fullsized":"2024-09-10T06:26:43.888535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:43.888359+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.888359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:39.822929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:31.393901+0000","last_change":"2024-09-10T06:26:31.393760+0000","last_active":"2024-09-10T06:26:31.393901+0000","last_peered":"2024-09-10T06:26:31.393901+0000","last_clean":"2024-09-10T06:26:31.393901+0000","last_became_active":"2024-09-10T06:22:31.830436+0000","last_became_peered":"2024-09-10T06:22:31.830436+0000","last_unstale":"2024-09-10T06:26:31.393901+0000","last_undegraded":"2024-09-10T06:26:31.393901+0000","last_fullsized":"2024-09-10T06:26:31.393901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.393581+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.393581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:26.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.725882+0000","last_change":"2024-09-10T06:26:41.725569+0000","last_active":"2024-09-10T06:26:41.725882+0000","last_peered":"2024-09-10T06:26:41.725882+0000","last_clean":"2024-09-10T06:26:41.725882+0000","last_became_active":"2024-09-10T06:22:33.818470+0000","last_became_peered":"2024-09-10T06:22:33.818470+0000","last_unstale":"2024-09-10T06:26:41.725882+0000","last_undegraded":"2024-09-10T06:26:41.725882+0000","last_fullsized":"2024-09-10T06:26:41.725882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:41.725350+0000","last_clean_scrub_stamp":"2024-09-10T06:26:41.725350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:08.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:34.946847+0000","last_change":"2024-09-10T06:26:34.946711+0000","last_active":"2024-09-10T06:26:34.946847+0000","last_peered":"2024-09-10T06:26:34.946847+0000","last_clean":"2024-09-10T06:26:34.946847+0000","last_became_active":"2024-09-10T06:22:31.808701+0000","last_became_peered":"2024-09-10T06:22:31.808701+0000","last_unstale":"2024-09-10T06:26:34.946847+0000","last_undegraded":"2024-09-10T06:26:34.946847+0000","last_fullsized":"2024-09-10T06:26:34.946847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:34.946534+0000","last_clean_scrub_stamp":"2024-09-10T06:26:34.946534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:24.024731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'16","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:48.735037+0000","last_change":"2024-09-10T06:26:48.734871+0000","last_active":"2024-09-10T06:26:48.735037+0000","last_peered":"2024-09-10T06:26:48.735037+0000","last_clean":"2024-09-10T06:26:48.735037+0000","last_became_active":"2024-09-10T06:22:33.844563+0000","last_became_peered":"2024-09-10T06:22:33.844563+0000","last_unstale":"2024-09-10T06:26:48.735037+0000","last_undegraded":"2024-09-10T06:26:48.735037+0000","last_fullsized":"2024-09-10T06:26:48.735037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-09-10T06:26:48.734684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:48.734684+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.243947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.259823+0000","last_change":"2024-09-10T06:26:42.259572+0000","last_active":"2024-09-10T06:26:42.259823+0000","last_peered":"2024-09-10T06:26:42.259823+0000","last_clean":"2024-09-10T06:26:42.259823+0000","last_became_active":"2024-09-10T06:22:31.822813+0000","last_became_peered":"2024-09-10T06:22:31.822813+0000","last_unstale":"2024-09-10T06:26:42.259823+0000","last_undegraded":"2024-09-10T06:26:42.259823+0000","last_fullsized":"2024-09-10T06:26:42.259823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:42.259331+0000","last_clean_scrub_stamp":"2024-09-10T06:26:42.259331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:33.896423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:27:03.252229+0000","last_change":"2024-09-10T06:27:03.252022+0000","last_active":"2024-09-10T06:27:03.252229+0000","last_peered":"2024-09-10T06:27:03.252229+0000","last_clean":"2024-09-10T06:27:03.252229+0000","last_became_active":"2024-09-10T06:22:33.846277+0000","last_became_peered":"2024-09-10T06:22:33.846277+0000","last_unstale":"2024-09-10T06:27:03.252229+0000","last_undegraded":"2024-09-10T06:27:03.252229+0000","last_fullsized":"2024-09-10T06:27:03.252229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:27:03.251851+0000","last_clean_scrub_stamp":"2024-09-10T06:27:03.251851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:40.452395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:39.928843+0000","last_change":"2024-09-10T06:26:39.928711+0000","last_active":"2024-09-10T06:26:39.928843+0000","last_peered":"2024-09-10T06:26:39.928843+0000","last_clean":"2024-09-10T06:26:39.928843+0000","last_became_active":"2024-09-10T06:22:31.811234+0000","last_became_peered":"2024-09-10T06:22:31.811234+0000","last_unstale":"2024-09-10T06:26:39.928843+0000","last_undegraded":"2024-09-10T06:26:39.928843+0000","last_fullsized":"2024-09-10T06:26:39.928843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:39.928507+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.928507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:38.868895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.881242+0000","last_change":"2024-09-10T06:26:44.881074+0000","last_active":"2024-09-10T06:26:44.881242+0000","last_peered":"2024-09-10T06:26:44.881242+0000","last_clean":"2024-09-10T06:26:44.881242+0000","last_became_active":"2024-09-10T06:22:33.817462+0000","last_became_peered":"2024-09-10T06:22:33.817462+0000","last_unstale":"2024-09-10T06:26:44.881242+0000","last_undegraded":"2024-09-10T06:26:44.881242+0000","last_fullsized":"2024-09-10T06:26:44.881242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:44.880889+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.880889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:04.889584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:30.509812+0000","last_change":"2024-09-10T06:26:30.509659+0000","last_active":"2024-09-10T06:26:30.509812+0000","last_peered":"2024-09-10T06:26:30.509812+0000","last_clean":"2024-09-10T06:26:30.509812+0000","last_became_active":"2024-09-10T06:22:31.812269+0000","last_became_peered":"2024-09-10T06:22:31.812269+0000","last_unstale":"2024-09-10T06:26:30.509812+0000","last_undegraded":"2024-09-10T06:26:30.509812+0000","last_fullsized":"2024-09-10T06:26:30.509812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:30.509470+0000","last_clean_scrub_stamp":"2024-09-10T06:26:30.509470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:04.251749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:47.757313+0000","last_change":"2024-09-10T06:26:47.757058+0000","last_active":"2024-09-10T06:26:47.757313+0000","last_peered":"2024-09-10T06:26:47.757313+0000","last_clean":"2024-09-10T06:26:47.757313+0000","last_became_active":"2024-09-10T06:22:33.810108+0000","last_became_peered":"2024-09-10T06:22:33.810108+0000","last_unstale":"2024-09-10T06:26:47.757313+0000","last_undegraded":"2024-09-10T06:26:47.757313+0000","last_fullsized":"2024-09-10T06:26:47.757313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:47.756834+0000","last_clean_scrub_stamp":"2024-09-10T06:26:47.756834+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:23.597329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:33.629425+0000","last_change":"2024-09-10T06:26:33.629278+0000","last_active":"2024-09-10T06:26:33.629425+0000","last_peered":"2024-09-10T06:26:33.629425+0000","last_clean":"2024-09-10T06:26:33.629425+0000","last_became_active":"2024-09-10T06:22:31.809404+0000","last_became_peered":"2024-09-10T06:22:31.809404+0000","last_unstale":"2024-09-10T06:26:33.629425+0000","last_undegraded":"2024-09-10T06:26:33.629425+0000","last_fullsized":"2024-09-10T06:26:33.629425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.629098+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.629098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:15.221664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'14","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.753260+0000","last_change":"2024-09-10T06:26:46.753129+0000","last_active":"2024-09-10T06:26:46.753260+0000","last_peered":"2024-09-10T06:26:46.753260+0000","last_clean":"2024-09-10T06:26:46.753260+0000","last_became_active":"2024-09-10T06:22:33.828588+0000","last_became_peered":"2024-09-10T06:22:33.828588+0000","last_unstale":"2024-09-10T06:26:46.753260+0000","last_undegraded":"2024-09-10T06:26:46.753260+0000","last_fullsized":"2024-09-10T06:26:46.753260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:46.752953+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.752953+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:45.693341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:43.246133+0000","last_change":"2024-09-10T06:26:43.245879+0000","last_active":"2024-09-10T06:26:43.246133+0000","last_peered":"2024-09-10T06:26:43.246133+0000","last_clean":"2024-09-10T06:26:43.246133+0000","last_became_active":"2024-09-10T06:22:31.822930+0000","last_became_peered":"2024-09-10T06:22:31.822930+0000","last_unstale":"2024-09-10T06:26:43.246133+0000","last_undegraded":"2024-09-10T06:26:43.246133+0000","last_fullsized":"2024-09-10T06:26:43.246133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:43.245659+0000","last_clean_scrub_stamp":"2024-09-10T06:26:43.245659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:35.348752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'14","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.746268+0000","last_change":"2024-09-10T06:26:45.746074+0000","last_active":"2024-09-10T06:26:45.746268+0000","last_peered":"2024-09-10T06:26:45.746268+0000","last_clean":"2024-09-10T06:26:45.746268+0000","last_became_active":"2024-09-10T06:22:33.845291+0000","last_became_peered":"2024-09-10T06:22:33.845291+0000","last_unstale":"2024-09-10T06:26:45.746268+0000","last_undegraded":"2024-09-10T06:26:45.746268+0000","last_fullsized":"2024-09-10T06:26:45.746268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-09-10T06:26:45.745895+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.745895+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:13.731142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.219000+0000","last_change":"2024-09-10T06:26:44.218872+0000","last_active":"2024-09-10T06:26:44.219000+0000","last_peered":"2024-09-10T06:26:44.219000+0000","last_clean":"2024-09-10T06:26:44.219000+0000","last_became_active":"2024-09-10T06:22:31.836242+0000","last_became_peered":"2024-09-10T06:22:31.836242+0000","last_unstale":"2024-09-10T06:26:44.219000+0000","last_undegraded":"2024-09-10T06:26:44.219000+0000","last_fullsized":"2024-09-10T06:26:44.219000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:44.218685+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.218685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:25.615106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.828112+0000","last_change":"2024-09-10T06:26:46.827937+0000","last_active":"2024-09-10T06:26:46.828112+0000","last_peered":"2024-09-10T06:26:46.828112+0000","last_clean":"2024-09-10T06:26:46.828112+0000","last_became_active":"2024-09-10T06:23:12.863336+0000","last_became_peered":"2024-09-10T06:23:12.863336+0000","last_unstale":"2024-09-10T06:26:46.828112+0000","last_undegraded":"2024-09-10T06:26:46.828112+0000","last_fullsized":"2024-09-10T06:26:46.828112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:46.827760+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.827760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:10.751238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:36.549345+0000","last_change":"2024-09-10T06:26:36.549201+0000","last_active":"2024-09-10T06:26:36.549345+0000","last_peered":"2024-09-10T06:26:36.549345+0000","last_clean":"2024-09-10T06:26:36.549345+0000","last_became_active":"2024-09-10T06:22:31.831583+0000","last_became_peered":"2024-09-10T06:22:31.831583+0000","last_unstale":"2024-09-10T06:26:36.549345+0000","last_undegraded":"2024-09-10T06:26:36.549345+0000","last_fullsized":"2024-09-10T06:26:36.549345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:36.549021+0000","last_clean_scrub_stamp":"2024-09-10T06:26:36.549021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:42.805736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:44.754846+0000","last_change":"2024-09-10T06:26:44.754694+0000","last_active":"2024-09-10T06:26:44.754846+0000","last_peered":"2024-09-10T06:26:44.754846+0000","last_clean":"2024-09-10T06:26:44.754846+0000","last_became_active":"2024-09-10T06:22:33.818633+0000","last_became_peered":"2024-09-10T06:22:33.818633+0000","last_unstale":"2024-09-10T06:26:44.754846+0000","last_undegraded":"2024-09-10T06:26:44.754846+0000","last_fullsized":"2024-09-10T06:26:44.754846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-10T06:26:44.754512+0000","last_clean_scrub_stamp":"2024-09-10T06:26:44.754512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:05.065310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:45.239297+0000","last_change":"2024-09-10T06:26:45.239130+0000","last_active":"2024-09-10T06:26:45.239297+0000","last_peered":"2024-09-10T06:26:45.239297+0000","last_clean":"2024-09-10T06:26:45.239297+0000","last_became_active":"2024-09-10T06:22:31.822958+0000","last_became_peered":"2024-09-10T06:22:31.822958+0000","last_unstale":"2024-09-10T06:26:45.239297+0000","last_undegraded":"2024-09-10T06:26:45.239297+0000","last_fullsized":"2024-09-10T06:26:45.239297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:45.238956+0000","last_clean_scrub_stamp":"2024-09-10T06:26:45.238956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:09.120153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:46.192359+0000","last_change":"2024-09-10T06:26:46.192191+0000","last_active":"2024-09-10T06:26:46.192359+0000","last_peered":"2024-09-10T06:26:46.192359+0000","last_clean":"2024-09-10T06:26:46.192359+0000","last_became_active":"2024-09-10T06:22:31.822203+0000","last_became_peered":"2024-09-10T06:22:31.822203+0000","last_unstale":"2024-09-10T06:26:46.192359+0000","last_undegraded":"2024-09-10T06:26:46.192359+0000","last_fullsized":"2024-09-10T06:26:46.192359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-09-10T06:26:46.192012+0000","last_clean_scrub_stamp":"2024-09-10T06:26:46.192012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:04.479544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:51.752748+0000","last_change":"2024-09-10T06:26:51.752609+0000","last_active":"2024-09-10T06:26:51.752748+0000","last_peered":"2024-09-10T06:26:51.752748+0000","last_clean":"2024-09-10T06:26:51.752748+0000","last_became_active":"2024-09-10T06:22:33.834053+0000","last_became_peered":"2024-09-10T06:22:33.834053+0000","last_unstale":"2024-09-10T06:26:51.752748+0000","last_undegraded":"2024-09-10T06:26:51.752748+0000","last_fullsized":"2024-09-10T06:26:51.752748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-09-10T06:26:51.752428+0000","last_clean_scrub_stamp":"2024-09-10T06:26:51.752428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:35.735944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:38.934803+0000","last_change":"2024-09-10T06:26:38.934649+0000","last_active":"2024-09-10T06:26:38.934803+0000","last_peered":"2024-09-10T06:26:38.934803+0000","last_clean":"2024-09-10T06:26:38.934803+0000","last_became_active":"2024-09-10T06:22:31.813395+0000","last_became_peered":"2024-09-10T06:22:31.813395+0000","last_unstale":"2024-09-10T06:26:38.934803+0000","last_undegraded":"2024-09-10T06:26:38.934803+0000","last_fullsized":"2024-09-10T06:26:38.934803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:38.934464+0000","last_clean_scrub_stamp":"2024-09-10T06:26:38.934464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:00:06.919711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T06:26:52.649018+0000","last_change":"2024-09-10T06:26:52.648863+0000","last_active":"2024-09-10T06:26:52.649018+0000","last_peered":"2024-09-10T06:26:52.649018+0000","last_clean":"2024-09-10T06:26:52.649018+0000","last_became_active":"2024-09-10T06:22:33.823915+0000","last_became_peered":"2024-09-10T06:22:33.823915+0000","last_unstale":"2024-09-10T06:26:52.649018+0000","last_undegraded":"2024-09-10T06:26:52.649018+0000","last_fullsized":"2024-09-10T06:26:52.649018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-10T06:26:52.648684+0000","last_clean_scrub_stamp":"2024-09-10T06:26:52.648684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:03.211891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1656,"num_read_kb":1546,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640328,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":136601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640330,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":987136,"data_stored":725251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673033,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40488,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331352,"statfs":{"total":96636764160,"available":96595304448,"internally_reserved":0,"allocated":1007616,"data_stored":724587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673034,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44080,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327760,"statfs":{"total":96636764160,"available":96591626240,"internally_reserved":0,"allocated":425984,"data_stored":135733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:28:04.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T06:28:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe35a603640 1 Processor -- start 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe35a603640 1 -- start start 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe35a603640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe35412f4b0 0x7fe35412f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe35a603640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35409bd60 con 0x7fe35412fdd0 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe35a603640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe35409aea0 con 0x7fe35412f4b0 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe353fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe35412f4b0 0x7fe35412f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe3537fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe35412fdd0 0x7fe354099680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47248/0 (socket says 172.21.15.84:47248) 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe3537fe640 1 -- 172.21.15.84:0/830236488 learned_addr learned my addr 172.21.15.84:0/830236488 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe353fff640 1 -- 172.21.15.84:0/830236488 >> v1:172.21.15.84:6789/0 conn(0x7fe35412fdd0 legacy=0x7fe354099680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe353fff640 1 -- 172.21.15.84:0/830236488 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe354099d90 con 0x7fe35412f4b0 2024-09-10T06:28:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe352ffd640 1 -- 172.21.15.84:0/830236488 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776374862 0 0) 0x7fe35409bd60 con 0x7fe35412fdd0 2024-09-10T06:28:04.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe353fff640 1 --2- 172.21.15.84:0/830236488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe35412f890 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe344009740 tx=0x7fe34401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd616f989a496345 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.638+0000 7fe352ffd640 1 -- 172.21.15.84:0/830236488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3440b0070 con 0x7fe35412f4b0 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe352ffd640 1 -- 172.21.15.84:0/830236488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3440ab530 con 0x7fe35412f4b0 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe352ffd640 1 -- 172.21.15.84:0/830236488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3440ab830 con 0x7fe35412f4b0 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/830236488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 msgr2=0x7fe35412f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 --2- 172.21.15.84:0/830236488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe35412f890 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe344009740 tx=0x7fe34401c370 comp rx=0 tx=0).stop 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/830236488 shutdown_connections 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 --2- 172.21.15.84:0/830236488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe35412f890 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/830236488 >> 172.21.15.84:0/830236488 conn(0x7fe3540a0010 msgr2=0x7fe3540a0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/830236488 shutdown_connections 2024-09-10T06:28:04.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/830236488 wait complete. 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 Processor -- start 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- start start 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3541382d0 con 0x7fe35412f4b0 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe353fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe353fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58360/0 (socket says 172.21.15.84:58360) 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe353fff640 1 -- 172.21.15.84:0/2604607627 learned_addr learned my addr 172.21.15.84:0/2604607627 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe353fff640 1 -- 172.21.15.84:0/2604607627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35412a8c0 con 0x7fe35412f4b0 2024-09-10T06:28:04.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe353fff640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe3440ae040 tx=0x7fe344019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3440b8020 con 0x7fe35412f4b0 2024-09-10T06:28:04.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3440aa800 con 0x7fe35412f4b0 2024-09-10T06:28:04.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3541279b0 con 0x7fe35412f4b0 2024-09-10T06:28:04.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3440b0040 con 0x7fe35412f4b0 2024-09-10T06:28:04.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe354127e10 con 0x7fe35412f4b0 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.642+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354129c70 con 0x7fe35412f4b0 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.646+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3440bb020 con 0x7fe35412f4b0 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.646+0000 7fe350ff9640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 0x7fe34003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.646+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe3440e9790 con 0x7fe35412f4b0 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.646+0000 7fe3537fe640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 0x7fe34003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T06:28:04.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.646+0000 7fe3537fe640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 0x7fe34003d6c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe348007fd0 tx=0x7fe3480078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T06:28:04.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.650+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe3440c2030 con 0x7fe35412f4b0 2024-09-10T06:28:04.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.834+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe354068e50 con 0x7fe35412f4b0 2024-09-10T06:28:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fe344015ff0 con 0x7fe35412f4b0 2024-09-10T06:28:04.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe350ff9640 1 -- 172.21.15.84:0/2604607627 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe3440b2d40 con 0x7fe35412f4b0 2024-09-10T06:28:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 msgr2=0x7fe34003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe35a603640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 0x7fe34003d6c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe348007fd0 tx=0x7fe3480078e0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 msgr2=0x7fe354127470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T06:28:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.838+0000 7fe35a603640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe3440ae040 tx=0x7fe344019110 comp rx=0 tx=0).stop 2024-09-10T06:28:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 shutdown_connections 2024-09-10T06:28:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.117:6824/1600442043,v1:172.21.15.117:6825/1600442043] conn(0x7fe34003b200 0x7fe34003d6c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 --2- 172.21.15.84:0/2604607627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe35412f4b0 0x7fe354127470 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T06:28:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 >> 172.21.15.84:0/2604607627 conn(0x7fe3540a0010 msgr2=0x7fe354133bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T06:28:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 shutdown_connections 2024-09-10T06:28:04.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T06:28:04.842+0000 7fe35a603640 1 -- 172.21.15.84:0/2604607627 wait complete. 2024-09-10T06:28:04.856 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T06:28:04.857 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T06:28:04.857 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T06:28:04.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:04.928 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T06:28:04.928 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T06:28:04.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:05.012 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T06:28:05.013 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:05.109 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T06:28:05.109 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T06:28:05.110 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:05.205 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T06:28:05.205 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T06:28:05.206 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T06:28:05.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:05.240 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T06:28:05.240 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T06:28:05.241 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T06:28:05.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:05.258 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T06:28:05.258 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T06:28:05.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-10T06:28:05.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T06:28:05.316 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T06:28:05.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:28:05.603 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T06:28:05.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:28:05.802 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T06:28:06.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:28:06.018 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T06:28:06.193 INFO:tasks.ceph:Archiving mon data... 2024-09-10T06:28:06.194 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/data/mon.a.tgz 2024-09-10T06:28:06.194 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-10T06:28:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.0Z9ePXzzn3 2024-09-10T06:28:06.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0Z9ePXzzn3 2024-09-10T06:28:06.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.0Z9ePXzzn3 2024-09-10T06:28:06.394 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.0Z9ePXzzn3 is 279KB 2024-09-10T06:28:06.455 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.0Z9ePXzzn3 2024-09-10T06:28:06.460 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T06:28:06.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:28:06.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:28:06.566 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:28:06.571 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:28:06.571 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T06:28:06.573 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi084/crash 2024-09-10T06:28:06.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:28:06.630 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi117/crash 2024-09-10T06:28:06.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:28:06.665 INFO:tasks.ceph:Compressing logs... 2024-09-10T06:28:06.666 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:28:06.699 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:28:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25150.log 2024-09-10T06:28:06.720 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24420.log 2024-09-10T06:28:06.721 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24358.log 2024-09-10T06:28:06.722 INFO:teuthology.orchestra.run.smithi084.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25150.log.gz 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24261.log 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24420.log.gz 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24748.log 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24261.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24358.log.gz 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24261.log.gz 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22717.log 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24748.log.gz 2024-09-10T06:28:06.723 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24306.log 2024-09-10T06:28:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.22717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24198.log 2024-09-10T06:28:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24306.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.22717.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25255.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24306.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24864.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24198.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25255.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24864.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25255.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25046.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24864.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24722.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24421.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24722.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25046.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24521.log 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24722.log.gz 2024-09-10T06:28:06.727 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24421.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21470.log 2024-09-10T06:28:06.728 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24421.log.gz 2024-09-10T06:28:06.728 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25124.log 2024-09-10T06:28:06.728 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24521.log.gz 2024-09-10T06:28:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.21470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24422.log 2024-09-10T06:28:06.730 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21470.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24942.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25124.log: /var/log/ceph/ceph-client.admin.24422.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25124.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24916.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24422.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24236.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24942.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25072.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24916.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24236.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24236.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24416.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25072.log.gz 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25098.log 2024-09-10T06:28:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.24416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22787.log 2024-09-10T06:28:06.732 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24416.log.gz 2024-09-10T06:28:06.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.25098.log: -- /var/log/ceph/ceph-client.admin.25020.log 2024-09-10T06:28:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.22787.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25098.log.gz 2024-09-10T06:28:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24332.log 2024-09-10T06:28:06.746 INFO:teuthology.orchestra.run.smithi084.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.22787.log.gz 2024-09-10T06:28:06.746 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25281.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25020.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24332.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24332.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25305.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25281.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24526.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25305.log: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24286.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25305.log.gz 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24522.log 2024-09-10T06:28:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24526.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24526.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24626.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22828.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24286.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24522.log: /var/log/ceph/ceph-client.admin.24626.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24522.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24624.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24626.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.22828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24630.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24624.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22828.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25176.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24624.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24890.log 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24630.log.gz 2024-09-10T06:28:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24774.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25176.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24838.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24774.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24890.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24625.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24774.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24994.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24838.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24512.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24625.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24384.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24994.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25229.log 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24512.log.gz 2024-09-10T06:28:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24968.log 2024-09-10T06:28:06.750 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24384.log.gz 2024-09-10T06:28:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25203.log 2024-09-10T06:28:06.750 INFO:teuthology.orchestra.run.smithi084.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25229.log.gz 2024-09-10T06:28:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.24968.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24968.log.gz 2024-09-10T06:28:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.25203.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.25203.log.gz 2024-09-10T06:28:06.760 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33308.log 2024-09-10T06:28:06.760 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86970.log 2024-09-10T06:28:06.760 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.33308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31544.log 2024-09-10T06:28:06.760 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.86970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43338.log 2024-09-10T06:28:06.760 INFO:teuthology.orchestra.run.smithi117.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.33308.log.gz 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.31544.log: /var/log/ceph/ceph-client.0.43338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74610.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86970.log.gz 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80480.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65168.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43338.log.gz 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.80480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30364.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.74610.log: /var/log/ceph/ceph-client.0.65168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.30364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69888.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.25082.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80480.log.gz 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66938.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr: 85.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81070.log 2024-09-10T06:28:06.761 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65168.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.69888.log: -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31544.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.0.66938.log: -5 --verbose -- /var/log/ceph/ceph-client.0.76970.log 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74610.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30364.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.81070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79890.log 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.76970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71658.log 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.69888.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46878.log 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.79890.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81070.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.71658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49238.log 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.76970.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66938.log.gz 2024-09-10T06:28:06.762 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83430.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.49238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58678.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56318.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.83430.log: /var/log/ceph/ceph-client.0.58678.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45108.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.46878.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.79890.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71658.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49238.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.56318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58088.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25010.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.45108.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.58678.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.58088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30954.log 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56318.log.gz 2024-09-10T06:28:06.763 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83430.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.25010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81660.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.25010.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.30954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77554.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62808.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.81660.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.58088.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45108.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.77554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29057.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.62808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40978.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.29057.log: gzip -5 --verbose 91.7% -- -- replaced with /var/log/ceph/ceph-client.0.30954.log.gz /var/log/ceph/ceph-client.0.82250.log 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77554.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29057.log.gz 2024-09-10T06:28:06.764 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.40978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75200.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84020.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81660.log.gz 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.82250.log: /var/log/ceph/ceph-client.0.75200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56908.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.62808.log.gz 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.84020.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40978.log.gz 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66348.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.56908.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29081.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75200.log.gz 91.2% -- replaced with /var/log/ceph/ceph-client.0.82250.log.gz 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.66348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59858.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84020.log.gz 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43928.log 2024-09-10T06:28:06.765 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.29081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52778.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29081.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.59858.log: /var/log/ceph/ceph-client.0.43928.log: gzip 91.4% -5 -- replaced with /var/log/ceph/ceph-client.0.56908.log.gz --verbose 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.0.40388.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60448.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.66348.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.52778.log: /var/log/ceph/ceph-client.0.40388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87560.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.60448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32724.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59858.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43928.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.87560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84610.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.32724.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40388.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65758.log 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.52778.log.gz 2024-09-10T06:28:06.766 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.84610.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87560.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.32724.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60448.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84610.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67528.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.65758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37438.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.67528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61038.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.37438.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65758.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.61038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63988.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42158.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.0.63988.log: 91.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25058.log 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.67528.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37438.log.gz 2024-09-10T06:28:06.767 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.42158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51008.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.25058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36258.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.25058.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63988.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.51008.log: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61038.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42158.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52188.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.36258.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78138.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47468.log 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51008.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.52188.log: /var/log/ceph/ceph-client.0.78138.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36258.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78138.log.gz 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38618.log 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.47468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35078.log 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.38618.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52188.log.gz 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72838.log 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62218.log 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.35078.log: /var/log/ceph/ceph-client.0.72838.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.47468.log.gz 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76380.log 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.38618.log.gz 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35078.log.gz 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72838.log.gz 2024-09-10T06:28:06.775 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.62218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57498.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.76380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42748.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.57498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68118.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62218.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.42748.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51598.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.76380.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.68118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61628.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.51598.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57498.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42748.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.68118.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51598.log.gz 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T06:28:06.776 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.61628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46288.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29033.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.46288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39208.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.29033.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29033.log.gz 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38028.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46288.log.gz 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.39208.log: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61628.log.gz 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25034.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.38028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29774.log 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39208.log.gz 2024-09-10T06:28:06.777 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.25034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70478.log 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.25034.log.gz 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.29774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35668.log 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.38028.log.gz 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.70478.log: 92.3% -- replaced with /var/log/ceph/ceph-client.0.29774.log.gz 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70478.log.gz 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73428.log 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.35668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85790.log 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.73428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69298.log 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.85790.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35668.log.gz 2024-09-10T06:28:06.778 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85790.log.gz 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33898.log 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73428.log.gz 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86380.log 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.69298.log: /var/log/ceph/ceph-client.0.33898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54548.log 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.86380.log: 91.6% 91.6% -- replaced with /var/log/ceph/ceph-client.0.69298.log.gz 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.33898.log.gz 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34488.log 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86380.log.gz 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63398.log 2024-09-10T06:28:06.781 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.54548.log: /var/log/ceph/ceph-client.0.34488.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.63398.log: 91.6% 91.5% -- replaced with /var/log/ceph/ceph-client.0.54548.log.gz 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.34488.log.gz 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63398.log.gz 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36848.log 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75790.log 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.36848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88179.log 2024-09-10T06:28:06.783 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T06:28:06.784 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.75790.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T06:28:06.784 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.36848.log.gz 2024-09-10T06:28:06.784 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41568.log 2024-09-10T06:28:06.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.88179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85200.log 2024-09-10T06:28:06.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.41568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39798.log 2024-09-10T06:28:06.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.85200.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75790.log.gz 2024-09-10T06:28:06.786 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68708.log 2024-09-10T06:28:06.786 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.39798.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41568.log.gz 2024-09-10T06:28:06.787 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85200.log.gz 2024-09-10T06:28:06.788 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45698.log 2024-09-10T06:28:06.788 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88179.log.gz 2024-09-10T06:28:06.788 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.68708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59268.log 2024-09-10T06:28:06.788 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39798.log.gz 2024-09-10T06:28:06.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.45698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53958.log 2024-09-10T06:28:06.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.59268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74018.log 2024-09-10T06:28:06.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.53958.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68708.log.gz 2024-09-10T06:28:06.789 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.45698.log.gz 2024-09-10T06:28:06.791 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64578.log 2024-09-10T06:28:06.791 INFO:teuthology.orchestra.run.smithi117.stderr: 92.1%/var/log/ceph/ceph-client.0.74018.log: -- replaced with /var/log/ceph/ceph-client.0.59268.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.49828.log 2024-09-10T06:28:06.791 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-10T06:28:06.791 INFO:teuthology.orchestra.run.smithi117.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53958.log.gz 2024-09-10T06:28:06.791 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.64578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48648.log 2024-09-10T06:28:06.792 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.49828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32134.log 2024-09-10T06:28:06.794 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.48648.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74018.log.gz 2024-09-10T06:28:06.794 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49828.log.gz 2024-09-10T06:28:06.794 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82840.log 2024-09-10T06:28:06.794 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.64578.log.gz 2024-09-10T06:28:06.795 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.32134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78722.log 2024-09-10T06:28:06.795 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48648.log.gz 2024-09-10T06:28:06.795 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.82840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55728.log 2024-09-10T06:28:06.795 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.78722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71068.log 2024-09-10T06:28:06.796 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.55728.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78722.log.gz 2024-09-10T06:28:06.796 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.32134.log.gz 2024-09-10T06:28:06.796 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82840.log.gz 2024-09-10T06:28:06.796 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55138.log 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.71068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44518.log 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.55138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50418.log 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55728.log.gz 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.44518.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71068.log.gz 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79306.log 2024-09-10T06:28:06.803 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.50418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53368.log 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55138.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.79306.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44518.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29105.log 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.79306.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.53368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48058.log 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72248.log 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.0.50418.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.29105.log: /var/log/ceph/ceph-client.0.48058.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29105.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.72248.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53368.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48058.log.gz 2024-09-10T06:28:06.804 INFO:teuthology.orchestra.run.smithi117.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72248.log.gz 2024-09-10T06:28:06.832 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T06:28:06.914 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T06:28:07.561 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T06:28:07.598 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T06:28:07.600 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-10T06:28:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m0.898s 2024-09-10T06:28:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m1.058s 2024-09-10T06:28:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.088s 2024-09-10T06:28:07.655 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T06:28:07.664 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T06:28:07.665 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-10T06:28:07.665 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m0.949s 2024-09-10T06:28:07.665 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m2.863s 2024-09-10T06:28:07.665 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.166s 2024-09-10T06:28:07.666 INFO:tasks.ceph:Archiving logs... 2024-09-10T06:28:07.666 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi084/log 2024-09-10T06:28:07.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:28:07.868 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi117/log 2024-09-10T06:28:07.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:28:08.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T06:28:08.346 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T06:28:08.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:28:08.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:28:08.408 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T06:28:08.592 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T06:28:08.593 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:28:08.595 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.073 -1.415 0.703 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout:*hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.121 -0.729 0.864 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout:+hv03.front.sepi 74.6.168.72 3 u 30 64 377 0.122 -0.042 0.897 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi117.stdout:+hv01.front.sepi 67.205.162.81 3 u 30 64 377 0.081 -2.201 1.106 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi117.stdout:+hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.078 -2.078 1.129 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi117.stdout:*hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.081 -0.898 0.648 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:28:08.610 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T06:28:08.619 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T06:28:08.619 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T06:28:08.641 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T06:28:08.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T06:28:08.965 INFO:teuthology.task.internal:Duration was 947.743950 seconds 2024-09-10T06:28:08.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T06:28:09.233 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T06:28:09.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:28:09.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:28:09.273 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T06:28:09.273 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T06:28:09.273 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:28:09.322 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-10T06:28:09.322 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:28:09.332 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T06:28:09.332 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:28:09.371 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:28:09.399 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T06:28:09.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:28:09.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:28:09.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T06:28:09.507 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T06:28:09.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:28:09.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:28:09.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T06:28:09.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:28:09.562 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:28:09.569 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-10T06:28:09.583 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-10T06:28:09.669 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:28:09.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:28:09.718 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:28:09.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:28:09.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T06:28:09.987 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T06:28:09.988 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi084 2024-09-10T06:28:09.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:28:10.011 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898789/remote/smithi117 2024-09-10T06:28:10.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:28:10.033 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T06:28:10.033 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:28:10.050 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:28:10.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T06:28:10.362 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T06:28:10.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T06:28:10.426 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T06:28:10.426 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:28:10.429 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:28:10.433 INFO:teuthology.orchestra.run.smithi084.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:28 /home/ubuntu/cephtest 2024-09-10T06:28:10.435 INFO:teuthology.orchestra.run.smithi117.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:28 /home/ubuntu/cephtest 2024-09-10T06:28:10.437 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T06:28:10.498 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T06:28:10.998 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 947.7439498901367 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T06:28:10.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T06:28:11.070 INFO:teuthology.run:pass